Syncing Depth and detections

tarocal

Hello,

This maybe a simple fix, but I am too in the weeds to figure it out.
How do I sync the detection output and the depth frame to be on the same rate?

I am passing the location of a detected object (from 2D projection) to the 3D depth map. I am hacking the Depth calculator program to find the distance between the camera and the detected object.
But my detections are faster than the process of sending the location (for which the depth is to be calculated) to the depthmap. So I am getting the wrong locations as the object is moving.

Is there a way to fix it? I can alter the blocking, but the input data is not going to change the rate because of that.

System:
Ubuntu 20.04 (VMWare workstation)
Python 3.5+
DepthAI 2.5.0.0

erik

Hello tarocal,
we are currently working on the device-side syncing node, I believe the PR will be this week. But for now, you can do host side syncing based on timestamps, example here. In this example that's exactly what's going on - depth+color+NN output syncing. Result of host side syncing:
Thanks, Erik

tarocal

Hey, thanks for reply.

I noticed that the depthai package was updated on the 13.07.2021.
So I assume device side sync could be instigated now. And I assume that the examples to showcase these are being worked on.

I was hoping that I could get an ETA on when those examples could hit the Github.
If there is an existing branch (or a site), that already has it, please do post it below. I am really looking forward to trying this out as soon as possible.

Thanks.

erik

Hello tarocal ,
I don't think sync node has been merged into develop/main branch yet, I would estimate that it will be available in the next couple of weeks (released).
Thanks, Erik

erik

And I would just like to mention that here you can see the progress of our efforts on the sync node:
https://github.com/luxonis/depthai/issues/238
Thanks, Erik