Hi,

So I am running the RGB-Thermal align example. However, unlike the gif image shown on the example page, for me the images don't seem to align properly, especially in objects which are far away form the camera.

I want to use this functionality as I am trying to detect the center line of a small metallic object on the RGB image and then get an array of temperature reading around the pixels of that center line on the Thermal image. So if the RGB-Thermal alignment is good, only then i will be able to get pixel based precision especially for the temperature values on and around the center line of the object.

That is why I am looking for exact alignment and overlap of the RGB and Thermal image on one another.

You can clearly see in the screenshots that the two images aren't aligned properly. Especially the monitor on the right side you can see. I'm guessing it is because of the wide angle of Thermal sensor compared to RGB. How can I resolve it?

Thanks,
Yishu

    Hi yishu_corpex
    In the example you are running, are you receiving any errors that the device is not calibrated? Please follow the guide on the docs page to flash the calibration. Also make sure you are using the latest depthai.

    Thanks,
    Jaka

        • GGol

          • Post #3

          I have the same issue. I'm running this example:
          https://docs.luxonis.com/software/depthai/examples/thermal_align/

          Before the first run, I was getting calibration errors. I followed the following instruction in the example to calibrate the camera:

          If this happens, please download thecalibration data + script, place them into the same folder, connect the camera to the computer and run the script. This will update the calibration and add required extrinsics between the camera sensors.

          but I'm still not getting the alignments right.

          jakaskerl

          Yes, I am using the latest Depthai version 2.30. I initially did get the calibration errors and I followed the instructions for that to update the calibrations. After that the script ran but the images aren't aligned properly as shown in the screenshots above. I guess others are also facing the same issue as highlighted by Gol above.

          Thanks,
          Yishu

            7 days later

            @jakaskerl

            I wanted to reach out and check if you found out what might be the possible issue causing this misalignment?

            Thanks,
            Yishu

            16 days later

            I'm still experiencing the issue. The calibration data for the RGB and Thermal cameras seem to be inaccurate. Any thoughts regarding this issue? @jakaskerl
            I made sure that the most updated calibration was flashed.

              Gol
              Some inaccuracy is expected. If you are testing the example, then likely just the static depth plane position is wrong.
              Can you give me the MXID of the device so I can check the factory calibration?

              Thanks,
              Jaka

                  jakaskerl

                  Even I am facing the same issue. Even after updating the calibration as mentioned by you still the same issue. Here is the MXID of the device I have for your reference: 14442C10D15AA7D700

                  Your help would be highly appreciated as this has been a major blocker for our project.

                  Thanks & Regards
                  Yishu Malhotra

                      yishu_corpex
                      If you move the depth plane (the slider in the example) to 2m. Are objects 2m from the camera properly aligned? Moreover, does this hold true for objects near the camera and far away from the camera if you correctly set the depth plane?

                      Thanks,
                      Jaka