Is there a script for aligning depth maps with color maps ？

Mulong

II want to use the second generation pipeline builder to display the depth information of the detected object, but the depth map is not aligned with the color map, there is a deviation.

Brandon

Hi Mulong ,

So we have written an alignment script, but it was actually written for Gen1.

https://github.com/luxonis/depthai-experiments/tree/master/pcl-projection-rgb

So @luxonis-Sachin could write an example for Gen2 I think soon here. I'll discuss with him offline.

Thanks, and sorry about the delay (normally we're a bit faster, European logistics have been consuming a ton of time recently).
-Brandon

Mulong

Okay, thank you for your reply.

Brandon

Hi Mulong ,

So we implemented an initial on-device mapping of RGB and depth.

We did this using LR-check, and then re-centering the depth so that it is positioned at the center of the RGB camera. See below:

So the middle image is the alignment so that the depth is centered via the RGB camera. So the next step is to implement the WARP so that the depth will fit directly onto the RGB (and vice-versa).

So we should have that out relatively quickly.

Thoughts?

Thanks,
Brandon