I am having trouble synchronizing messages on-host from device.
I am running a C++ version but identical setup to: https://github.com/luxonis/depthai-experiments/tree/master/gen2-pedestrian-reidentification
When I pick up the messages on the host side and then print the sequence numbers, the messages received seem to have different sequences, so I cannot get synchronized frames at faster than 2fps.
color seq num: 0
color seq num: 1
color seq num: 2
color seq num: 3
detection seq num: 0
detection seq num: 1
color seq num: 4
detection seq num: 2
detection seq num: 3
color seq num: 6
color seq num: 7
detection seq num: 4
detection seq num: 6
color seq num: 8
color seq num: 9
detection seq num: 7
detection seq num: 8
color seq num: 10
color seq num: 22
detection seq num: 9
detection seq num: 10
color seq num: 23
color seq num: 25
detection seq num: 22
detection seq num: 23
color seq num: 30
color seq num: 31
detection seq num: 25
detection seq num: 30
color seq num: 35
color seq num: 36
detection seq num: 31
detection seq num: 35
color seq num: 40
color seq num: 41
detection seq num: 36
detection seq num: 40
color seq num: 45
color seq num: 46
detection seq num: 41
detection seq num: 45
color seq num: 50
color seq num: 51
detection seq num: 46
detection seq num: 50
color seq num: 55
color seq num: 56
recognition seq num: 50
detection seq num: 51
color seq num: 60
detection seq num: 55
color seq num: 61
recognition seq num: 51
recognition seq num: 55
detection seq num: 56
detection seq num: 60
color seq num: 65
color seq num: 66
detection seq num: 61
color seq num: 70
detection seq num: 65
color seq num: 71
recognition seq num: 65
detection seq num: 66
color seq num: 75
detection seq num: 70
color seq num: 76
recognition seq num: 66
recognition seq num: 70
So although the messages all come in at around 10 fps. Because the sequence numbers are not aligned, I can get a synchronized frame not so often. Do ImgDetection and NNData not return for every input received?