RGB-Thermal Align example doesn't show proper alignment

yishu_corpex

Hi,

So I am running the RGB-Thermal align example. However, unlike the gif image shown on the example page, for me the images don't seem to align properly, especially in objects which are far away form the camera.

I want to use this functionality as I am trying to detect the center line of a small metallic object on the RGB image and then get an array of temperature reading around the pixels of that center line on the Thermal image. So if the RGB-Thermal alignment is good, only then i will be able to get pixel based precision especially for the temperature values on and around the center line of the object.

That is why I am looking for exact alignment and overlap of the RGB and Thermal image on one another.

You can clearly see in the screenshots that the two images aren't aligned properly. Especially the monitor on the right side you can see. I'm guessing it is because of the wide angle of Thermal sensor compared to RGB. How can I resolve it?

Thanks,
Yishu

jakaskerl

Hi yishu_corpex
In the example you are running, are you receiving any errors that the device is not calibrated? Please follow the guide on the docs page to flash the calibration. Also make sure you are using the latest depthai.

Thanks,
Jaka

yishu_corpex

jakaskerl

Yes, I am using the latest Depthai version 2.30. I initially did get the calibration errors and I followed the instructions for that to update the calibrations. After that the script ran but the images aren't aligned properly as shown in the screenshots above. I guess others are also facing the same issue as highlighted by Gol above.

Thanks,
Yishu

Gol

I have the same issue. I'm running this example:
https://docs.luxonis.com/software/depthai/examples/thermal_align/

Before the first run, I was getting calibration errors. I followed the following instruction in the example to calibrate the camera:

If this happens, please download thecalibration data + script, place them into the same folder, connect the camera to the computer and run the script. This will update the calibration and add required extrinsics between the camera sensors.

but I'm still not getting the alignments right.

yishu_corpex

@jakaskerl

I wanted to reach out and check if you found out what might be the possible issue causing this misalignment?

Thanks,
Yishu