Problems with spatial_tiny_yolo.py ([SpatialDetectionNetwork(1)] [error] ROI )

Robbal

Hi All

I cannot get the Depthai-python/examples/SpartialDetection/spatial_tiny_yolo.py to work correctly without stopping or giving errors.

I am running ubuntu 20.0.4 and did a pull on the Depthai-python to get the latest changes. When it runs, it starts out fine and the starts to get a list of errores

[SpatialDetectionNetwork(1)] [error] ROI x:0.21822917 y:0 width:0 height:0 is not a valid rectangle

and after a few seconds, it crashes with

RuntimeError: Communication exception - possible device error/misconfiguration. Original message 'Couldn't read data from stream: 'rgb' (X_LINK_ERROR)'

I read somwhere that maybe lowering the spatialDetectionNetwork.setBoundingBoxScaleFactor(0.5) to .02 but that does not help. Any help would be great .. Sees to run fine on spatial_mobilenet.py but I have spent the whole weekend working through the "How to train ssd" and cant figure a way without Roboflow .. and I am not a fan of them! So i want to use yolo.

Thanks

Robby

erik

Hello Robbal ,
Which depthai version are you using? You can check with the python3 -mpip show depthai. If it's not the latest (2.17.2), you can update it with python3 -mpip install depthai -U.
Thanks, Erik

Robbal

Thanks for the response. I did as suggested, but I get the same errors with
[SpatialDetectionNetwork(1)] [error]

and then:
' File "spatial_tiny_yolo.py", line 195, in <module>
cv2.putText(frame, str(label), (x1 + 10, y1 + 20), cv2.FONT_HERSHEY_TRIPLEX, 0.5, 255)
OverflowError: signed integer is less than minimum'

and after a few seconds back to :
RuntimeError: Communication exception - possible device error/misconfiguration. Original message 'Couldn't read data from stream: 'rgb' (X_LINK_ERROR)
I gonna dig a little but I dont have much python experience

Thanks for the help so far

Name: depthai
Version: 2.17.2.0
Summary: DepthAI Python Library
Home-page: https://github.com/luxonis/depthai-python
Author: Luxonis
Author-email: support@luxonis.com
License: MIT
Location: /home/robby/.local/lib/python3.8/site-packages
Requires:
Required-by: depthai-gui, depthai-sdk

erik

Hi Robbal ,
Sorry about the trouble, let me try to reproduce it locally. Which host are you using (Ubuntu 20.0.4 - I assume some laptop)?
Thanks, Erik

Robbal

Hi Erik

No Im using a desktop Ubuntu 20.0.0.4 I9 generation with a nvida graphic card. I have noticed that if I move the opencv window around it makes it worse but thats not causing it. Im remote at the moment but can give you exact specs later

I really appreciate the help, Keep up the good work and products

Robby

erik

Hi Robbal ,
I tried it out, I can't reproduce the issue with the spatial_tiny_yolo.py running depthai 2.17.2. Could you check your USB connection, are you using USB3 cable/mode? Please add device.getUsbSpeed() to the example to check the USB speed (HIGH=USB2, SUPER=USB3). And we are glad you like our products🙂!
Thanks, Erik

Robbal

Hi Erik

Love it so much. I get UsbSpeed.SUPER when I run that.

Thanks

Robby

Robbal

I think somhow it spartial matching or sync thats causing a problem. Maybe I must work out how to slow down the frame rate if thats possible and see if that helps

Thanks

Robby

Robbal

Another thing I noticed... The inference flashes about 30 boxes before it crashes. This is strange as the camera is pointing to a flat white wall... Im starting to think this is something to do with the yolo?.. I wish I can capture it but it quits after

Robbal

Hi Erik

I added

pipeline.setXLinkChunkSize(64*50)

and I am now able to run the Inferenceing without crashing. I reduced the number down until it worked starting at 64*1024. My framerate is now 21fps but its stable. Every now and then I get a SpatialDetectionNetwork(1)] [error] ROI but its workable and does not crash.

I need to look at this a bit more and do some research

Thanks

Robby

erik

Hi Robbal ,
That's really strange, I have never heard about such an issue or such a workaround. Which OAK camera are you using and which settings do we need to reproduce this? I would love to repro this so we can fix it (as it might be some edge case in firmware - with some specific settings).
Thanks again, Erik

Robbal

Hi Erik

This is what I have

python3 spatial_tiny_yolo.py Using Tiny YoloV4 model. If you wish to use Tiny YOLOv3, call 'tiny_yolo.py yolo3' UsbSpeed.SUPER DeviceInfo(name=1.8, mxid=194430108195E11200, X_LINK_BOOTED, X_LINK_USB_VSC, X_LINK_MYRIAD_X, X_LINK_SUCCESS) 194430108195E11200 Output layer names: conv2d_17/BiasAdd/Add, conv2d_20/BiasAdd/Add, [194430108195E11200] [1.8] [48.022] [SpatialDetectionNetwork(1)] [error] ROI x:0.78125 y:0.29135966 width:0 height:0.4724269 is not a valid rectangle. [194430108195E11200] [1.8] [48.022] [SpatialDetectionNetwork(1)] [error] ROI x:0.23387556 y:1 width:0.03129272 height:0 is not a valid rectangle. [194430108195E11200] [1.8] [48.023] [SpatialDetectionNetwork(1)] [error] ROI x:0.21825919 y:1 width:6.0081482e-05 height:0 is not a valid rectangle. [194430108195E11200] [1.8] [48.023] [SpatialDetectionNetwork(1)] [error] ROI x:0.42953604 y:1 width:0.012170941 height:0 is not a valid rectangle. [194430108195E11200] [1.8] [48.023] [SpatialDetectionNetwork(1)] [error] ROI x:0.78125 y:0.050919436 width:0 height:0.101838864 is not a valid rectangle. [194430108195E11200] [1.8] [48.023] [SpatialDetectionNetwork(1)] [error] ROI x:0.23067906 y:1 width:0.004177496 height:0 is not a valid rectangle. [194430108195E11200] [1.8] [48.023] [SpatialDetectionNetwork(1)] [error] ROI x:0.78125 y:0.22736259 width:0 height:0.10957776 is not a valid rectangle. [194430108195E11200] [1.8] [48.023] [SpatialDetectionNetwork(1)] [error] ROI x:0.21829195 y:1 width:0.00012554228 height:0 is not a valid rectangle. [194430108195E11200] [1.8] [48.023] [SpatialDetectionNetwork(1)] [error] ROI x:0.25168473 y:1 width:0.00086545944 height:0 is not a valid rectangle. [194430108195E11200] [1.8] [48.023] [SpatialDetectionNetwork(1)] [error] ROI x:0.49640065 y:1 width:0.08314592 height:0 is not a valid rectangle. [194430108195E11200] [1.8] [48.023] [SpatialDetectionNetwork(1)] [error] ROI x:0.21842119 y:1 width:0.00038404763 height:0 is not a valid rectangle. [194430108195E11200] [1.8] [48.023] [SpatialDetectionNetwork(1)] [error] ROI x:0.2845437 y:1 width:0.13262913 height:0 is not a valid rectangle. [194430108195E11200] [1.8] [48.024] [SpatialDetectionNetwork(1)] [error] ROI x:0.78125 y:0.6247736 width:0 height:0.028585076 is not a valid rectangle.
This is the result of these values

print(device.getUsbSpeed())
UsbSpeed.SUPER

 print(device.getDeviceInfo())
DeviceInfo(name=1.8, mxid=194430108195E11200, X_LINK_BOOTED, X_LINK_USB_VSC, X_LINK_MYRIAD_X, X_LINK_SUCCESS)

print(device.getMxId())
194430108195E11200

What else can I give you

Thanks
Robby