UVC - Disparity and RGB

AlastairB

Hello, we're potentially interested in using a Luxonis OAK-D Short Range camera for our application.
We need to integrate it with our existing C++ software stack, and would as such strongly prefer to use UVC for data capture.

Is it possible to set the camera up to create two UVC streams - one for RGB and one for Disparity, and have these synchronised? If not - what would be the recommended way for streaming disparity data from the camera alongside UVC RGB?

Thanks

Alastair

OskarSonc

Hey AlastairB - OAK-D SR won’t give you two synchronized UVC streams (RGB + raw disparity). UVC is intended for standard video and is not really well supported in our software, while disparity/depth is produced by the StereoDepth pipeline and is best accessed via the DepthAI API.

If you need proper sync and real disparity values, use the DepthAI C++ API to stream RGB + disparity over XLink and sync by timestamps/sequence (or the Sync node).

Thanks,
Oskar

AlastairB

Hi Oskar,

Thanks so much for this info - that's good to know.

Looking at the C++ API I see that it might not be too much work to integrate with our existing setup, I'll keep on investigating.

Cheers

Alastair

OskarSonc

Happy to help, if you have any more question, let me know!