OAK-D lite and pro lag in 4k

Bilal003

Hello! I recently purchased an OAK-D lite and an OAK-D pro camera and my goal was to use them in my app. For context my app is based on PyQt5 and Qthread is used to fetch camera frames. Previously I was using a simple webcam but now I want to use the 4k resolution from my OAK cameras in my app.

The issue I'm facing is that when I use the method provided in following link

https://docs.oakchina.cn/projects/api/samples/ColorCamera/rgb_video.html#rgb-video

I get around 20 fps max. My app also does some processing so the final fps I see is around 10-15 which is not good for my use-case. Following is the minimum code to reproduce same situation. Am I doing something wrong in reading the frame perhaps? Any help will be appreciated.

Bilall003/oak-code-demo

jakaskerl

Bilal003
The code seems fine at first glance, but the issue is probably that while you can run processing at 4K30, you still need to send the frames back to the host which is a demanding process for 4K frames at a high framerate. I'd suggest you lower the resolution you are sending back for viewing.

Thanks,
Jaka

Bilal003

jakaskerl If I set preview size lower it helps but I was hoping to use 4k frame. So how about using 4k resolution input and while showing I resize it?

jakaskerl

Bilal003
You can add a VideoEncoder node to encode the 4k stream before sending it to host; decode it on host and display it.

Also setting pipeline.setXLinkChunkSize(0) sometimes helps with FPS and latency.

Thanks,
Jaka