High latency, high bandwith usage and low fps

FearlessMailbox

First of all to whoever is reading this, enjoy your weekend. Second of all, i'm experiencing some weird issues with an Oak-D POE camera which i can't seem to figure out.

I'm trying to use an Oak-D POE camera to capture a video stream from the 4k camera, so i can run OpenCV on my pc for object recognition. I was heaving an issue with around a 2 second latency between the camera and my pc, 300mbps of ethernet usage and around 1.8 fps. So i went digging and found out it would probably be best to first let the camera encode the video feed to MJPEG.

I implemented that and these are the results i'm getting using ethernet and 4K images:

329 mpbs traffic

7.9 fps

around 2.4 seconds of latency

I feel like i'm missing something that can make that 2.4 seconds of latency dissapear, could someone point me in the right direction?

FearlessMailbox

Update: I ran some of the provided testscripts, and got these results. Latency is 2.8ms, downlink is 615mbps and uplink is 217mbps. So i'm not sure why the images lag around 2.4 second after capturing, maybe they're stored in a buffer somewhere?

FearlessMailbox

erik

Hi FearlessMailbox ,
I'd suggest going through the https://docs.luxonis.com/projects/api/en/latest/tutorials/low-latency/ and especially the POE part. To me, this sounds like a networking issue. Maybe you could encode frames on-device?
Thanks, Erik

FearlessMailbox

Heyo Erik,

I'm already encoding the frames to MJPEG on the device, which improved the FPS, but not the latency. It's on a network with not a lot of other devices that use bandwith. I see that the LeonOS usage is 100%, maybe this is why there is a lot of latency? Is there something i can do about that?

erik

Hi FearlessMailbox ,
I just added docs on this here: luxonis/depthai-python823
I hope that helps!
Thanks, Erik