I tried the first option (host-nn-sync.py) because reducing fps did not work
This script works as expected in isolation. But when I tried using this logic in our system, we have a problem that detIn.getSequenceNum() is always 0 (detections sequence number does not increase). This was surprising because we are getting newer detections for new frames (lagging slightly behind the frames, unfortunately). Are there any pointers for me to consider here?
To give a little more clarity, my main problem is that detection boxes lag behind frames (fixed distance lag) for a moving object. Using passthrough frames did not change this and I suspected that periodic detection drops might somehow be the reason. I'm not sure about it anymore. Can you suggest some ideas here please?
I'm not running detections on the frames grabbed from RGB camera directly. In my pipeline, I grab the RGB frame, morph it based on some requirements and send it back to the VPU for inference
If nothing helps, I can share some parts of the code.