• DepthAI

  • synchronizing RGB/DEPTH/IMU leadst to 1FPS

Hi.

I'm implementing synchronization between IMU/RGB/DEPTH to be able to reconstruct true position of object in time. I'm following this demo, but after runnning, the shown FPS drops to 1-2FPS. Separate modality works just fine in 30FPS, same as nonsync RGB and DEPTH.

Is there any solution, how to speed it up all?

Thank you, best wishes, Jan

  • erik replied to this.

    Hi JanKanka ,
    Are you using PoE or USB? Perhaps you could try increasing the threshold for the timestmap syncing, which is currently 11ms (hardcoded).
    Thanks, Erik

      Hi @erik I!m using PoE version of thje camera.

      I did try to increase the threshold up to 100 but it went to 10FPS, not even close the 30FPS.

      Thank you.

      Best wishes, Jan

      • erik replied to this.

        JanKanka what's the FPS you receive each stream separately?

          Without synchronisation I tried RGB @ 1080p up to 40FPS without problem. In default I use rgb & depth @ 30FPS.

          • erik replied to this.

            You are right, I do downscale the isp by factor 2/3, my bad.

            So what would be the best solution here? To downscale the Images or somehow crop the images itself?

            Thank you

            • erik replied to this.

              JanKanka You'd want to reduce bandwidth usage to below 700mbps (max bandwidth), please see the docs above on how to do that

                5 days later

                Let me get back to this thread once more again, I'm trying to crop images on camera, but while croping both depth and rgb image the dai rises Fatal error." Please report to developers. Log: 'PipelineBuilder' '2221'"

                I follow this two tutorials: depth crop, color crop

                Thank you

                  After rebooting the camera, everything works. Thank you