Hi gloria
To align the depth to color camera you need to specify the stereoconfig:
stereo.config_stereo(align=color)
I also think 1080p is not supported on mono cameras, so they are set to 720p. You will need to downscale the color camera (ispScale 2/3).

If you wish to blend the streams together, i suggest you create a callback function for the visualizer in which you use the code from API version of RGB_depth_align.

Thanks,
Jaka

Hi gloria
"depth" variable in your code is a stereo component. You can call depth.config_stereo(align=color) (sorry, I was using the same naming scheme as in the stock example for mcap-recording)

Hope this helps,
Jaka

Hi Jaka,

Thank you so much for all of your help. If I may bother you with one last question (I am hoping this is the last issue I need to resolve). Please see below the error message I am receiving, I am not sure what might be wrong with the code.

Thanks

    Hi gloria
    Update the AV package, depthai respository (git pull) and depthai_sdk package. Then change the out.depth to out.disparity. It should work, I just tested it myself.

    Thanks,
    Jaka

    Hi Jaka,

    Please see below, it seems like it has an issue with align=color.

    From my understanding, disparity is not the same as depth. Shouldn't I be using out.depth instead?

    Thanks

      Hi gloria
      Could you add your code as well please?

      Disparity is similar to depth in a sense that depth is calculated from disparity. The advantage disparity has over depth is that it can be encoded using VideoEncoder.

      Thanks,
      Jaka

      Hi gloria
      Add this to the top

      import depthai
      import av
      import depthai_sdk
      print('depthai module: ', depthai.__version__)
      print('depthai_sdk module: ', depthai_sdk.__version__)
      print('av module: ', av.__version__)

      I am running the exact same code and I am getting no error.

      Thanks,
      Jaka

      Hi Jaka,

      I would like to thank you for your patience and all of your help. It is working for me now! I do have one last question about how I can get the depth from the disparity? I can't seem to find it in your documentation.

      Warm regards,

      Gloria

      Is there no way to directly record depth as an .mp4 using this method?

        Hi gloria
        Guide here.

        There is no way to record depth with videoencoder on device. You still can record depth, but you have to do it host side. You will have to find/code a way to save UINT16 depth to mp4. I'd suggest GPT for aid.

        Thanks,
        Jaka

        2 years later

        Thanks all in advance for the help. I recorded video with RGB, left and right camera with 20fps. The RGB was collected image with 12 MP and scale it to 1/4 (tried to have maximum FOV) and left/right has 720 P. Is there any solution to align the depth information using disprity map using left+right camera with RGB?

        Thanks

          12 days later