OAK-D crashes on different examples

ThomasH

Hello,

I am experimenting with the OAK-D and have problems with crashes on executing different examples.

When I try this example: luxonis/depthaiblob/main/depthai_sdk/examples/NNComponent/human_pose.py, the script works several seconds and crashes after some time (perhaps 20 seconds): "Device crashed, but no crash dump could be extracted."

When I try Depth AI Demo or Depth AI Viewer, it crashes with the same message when I chose a different model than "mobilenet-ssd".

USB Connection speed is UsbSpeed.SUPER and bandwith_test.py says
Downlink 2229.3 mbps
Uplink 1822.1 mbps

I am using Ubuntu and Python 3.10.12.

Any ideas?

Thanks!

Thomas

jakaskerl

Hi @ThomasH
Can you try running our examples to possibly pinpoint the issue of the crash? Does it only happen when running NN?

Thanks
Jaka

ThomasH

Hi @jakaskerl

Thanks for your reply! I ran several examples now (not all so far). Some worked, some did not - perhaps this does already help to pinpoint the issue? I'll try to test with a different computer next week.

Tests that worked:

ColorCamera, CrashReport, EdgeDetector, FeatureTracker, ImageManip, NeuralNetwork/detection_parser.py, frame_sync.py, mono_depth_mobilenetssd.py, rotated_spatial_detections.py

Tests that crashed:

MobileNet/rgb_mobilenet_4k.py

[18443010C129770E00] [1.1] [1717226390.715] [host] [warning] Device crashed, but no crash dump could be extracted.
Traceback (most recent call last):
  File "...depthai-python/examples/MobileNet/rgb_mobilenet_4k.py", line 88, in <module>
    inVideo = qVideo.tryGet()
RuntimeError: Communication exception - possible device error/misconfiguration. Original message 'Couldn't read data from stream: 'video' (X_LINK_ERROR)'

MobileNet/rgb_mobilenet.py
ObjectTracker/object_tracker.py
Yolo/tiny_yolo.py

For the first, no crash dump could be saved. Here ist the crash dump of the last one:

{"crashReports":[{"crashedThreadId":151060481,"errorSource":"INTERNAL_ERROR_CORE","errorSourceInfo":{"assertContext":{"fileName":"","functionName":"","line":0},"errorId":30,"trapContext":{"trapAddress":0,"trapName":"","trapNumber":0}},"processor":1,"threadCallstack":[{"callStack":[{"callSite":2153609224,"calledTarget":2153625068,"context":"","framePointer":2155532928},{"callSite":2153602520,"calledTarget":2153608968,"context":"","framePointer":2155533024},{"callSite":2150558164,"calledTarget":2153602432,"context":"","framePointer":2155533160},{"callSite":2153624196,"calledTarget":0,"context":"Thread handler","framePointer":2155533272},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155533368},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155533464}],"instructionPointer":2153609224,"stackBottom":2155517176,"stackPointer":2155532928,"stackTop":2155533559,"threadId":167837697,"threadName":"CBTH","threadStatus":"WAITING_FOR_MESSAGE"},{"callStack":[{"callSite":2153595520,"calledTarget":2153625068,"context":"","framePointer":2155565368},{"callSite":2153595940,"calledTarget":2153595432,"context":"","framePointer":2155565536},{"callSite":2152733560,"calledTarget":2153595924,"context":"","framePointer":2155565632},{"callSite":2147609432,"calledTarget":2152733540,"context":"","framePointer":2155565744},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155566192},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155566288},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155566384}],"instructionPointer":2153595520,"stackBottom":2155533712,"stackPointer":2155565368,"stackTop":2155566479,"threadId":184614913,"threadName":"main","threadStatus":"UNKNOWN"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155598856},{"callSite":2149184644,"calledTarget":2153605048,"context":"","framePointer":2155598992},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155599112},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155599208},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155599304}],"instructionPointer":2153605200,"stackBottom":2155566632,"stackPointer":2155598856,"stackTop":2155599399,"threadId":184614914,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155632384},{"callSite":2150250952,"calledTarget":2153605048,"context":"","framePointer":2155632520},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155632616},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155632712},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155632808}],"instructionPointer":2153605200,"stackBottom":2155600136,"stackPointer":2155632384,"stackTop":2155632903,"threadId":184614915,"threadName":"RmtBarrThrd","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155665120},{"callSite":2150936916,"calledTarget":2153605048,"context":"","framePointer":2155665256},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2155665440},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155665536},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155665632},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155665728}],"instructionPointer":2153605200,"stackBottom":2155633056,"stackPointer":2155665120,"stackTop":2155665823,"threadId":184614916,"threadName":"","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155697752},{"callSite":2149848568,"calledTarget":2149345144,"context":"","framePointer":2155697888},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2155698360},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155698456},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155698552},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155698648}],"instructionPointer":2153605200,"stackBottom":2155665976,"stackPointer":2155697752,"stackTop":2155698743,"threadId":184614917,"threadName":"IpcPipelineBuil","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153635696,"calledTarget":2153625068,"context":"","framePointer":2155730264},{"callSite":2153635908,"calledTarget":2153635648,"context":"","framePointer":2155730360},{"callSite":2147699920,"calledTarget":2153635880,"context":"","framePointer":2155730496},{"callSite":2147701320,"calledTarget":2147699784,"context":"","framePointer":2155730624},{"callSite":2147701652,"calledTarget":2147701200,"context":"","framePointer":2155730744},{"callSite":2147701816,"calledTarget":2147701524,"context":"","framePointer":2155731184},{"callSite":2153349720,"calledTarget":0,"context":"Thread handler","framePointer":2155731280},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155731376},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155731472},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155731568}],"instructionPointer":2153635696,"stackBottom":2155698896,"stackPointer":2155730264,"stackTop":2155731663,"threadId":184614918,"threadName":"","threadStatus":"WAITING_FOR_CONDITION_VARIABLE"},{"callStack":[{"callSite":2153609224,"calledTarget":2153625068,"context":"","framePointer":2155767544},{"callSite":2153593028,"calledTarget":2153608968,"context":"","framePointer":2155767640},{"callSite":2150356572,"calledTarget":2153592876,"context":"","framePointer":2155767776},{"callSite":2150418012,"calledTarget":2150356556,"context":"","framePointer":2155767880},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155767992},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155768088},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155768184}],"instructionPointer":2153609224,"stackBottom":2155735512,"stackPointer":2155767544,"stackTop":2155768279,"threadId":184614919,"threadName":"SIPP","threadStatus":"WAITING_FOR_MESSAGE"},{"callStack":[{"callSite":2153598904,"calledTarget":2153623096,"context":"","framePointer":2155804936},{"callSite":2149210764,"calledTarget":2153598736,"context":"","framePointer":2155805072},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2155805328},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155805424},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155805520},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155805616}],"instructionPointer":2153598904,"stackBottom":2155772944,"stackPointer":2155804936,"stackTop":2155805711,"threadId":184614920,"threadName":"PlgNeuralNetwor","threadStatus":"UNKNOWN"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155846288},{"callSite":2148278036,"calledTarget":2153605048,"context":"","framePointer":2155846424},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155846544},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155846640},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155846736}],"instructionPointer":2153605200,"stackBottom":2155814064,"stackPointer":2155846288,"stackTop":2155846831,"threadId":184614921,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155879104},{"callSite":2148006620,"calledTarget":2153605048,"context":"","framePointer":2155879240},{"callSite":2148109224,"calledTarget":2148006536,"context":"","framePointer":2155879368},{"callSite":2148107784,"calledTarget":0,"context":"Thread handler","framePointer":2155879472},{"callSite":2148101476,"calledTarget":0,"context":"Thread handler","framePointer":2155879584},{"callSite":2148123728,"calledTarget":2148101444,"context":"","framePointer":2155879680},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2155879952},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155880048},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155880144},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155880240}],"instructionPointer":2153605200,"stackBottom":2155847568,"stackPointer":2155879104,"stackTop":2155880335,"threadId":184614922,"threadName":"PlgDetectionPar","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155912712},{"callSite":2148106704,"calledTarget":2153605048,"context":"","framePointer":2155912848},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155912968},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155913064},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155913160}],"instructionPointer":2153605200,"stackBottom":2155880488,"stackPointer":2155912712,"stackTop":2155913255,"threadId":184614923,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155944992},{"callSite":2148006220,"calledTarget":2153605048,"context":"","framePointer":2155945128},{"callSite":2148034028,"calledTarget":2148006136,"context":"","framePointer":2155945256},{"callSite":2148049104,"calledTarget":0,"context":"Thread handler","framePointer":2155945360},{"callSite":2148033232,"calledTarget":0,"context":"Thread handler","framePointer":2155945472},{"callSite":2150292152,"calledTarget":2148033200,"context":"","framePointer":2155945568},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2155945792},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155945888},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155945984},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155946080}],"instructionPointer":2153605200,"stackBottom":2155913408,"stackPointer":2155944992,"stackTop":2155946175,"threadId":184614924,"threadName":"PlgSrcMipi","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155978552},{"callSite":2148052928,"calledTarget":2153605048,"context":"","framePointer":2155978688},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155978808},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155978904},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155979000}],"instructionPointer":2153605200,"stackBottom":2155946328,"stackPointer":2155978552,"stackTop":2155979095,"threadId":184614925,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156010904},{"callSite":2148006120,"calledTarget":2153605048,"context":"","framePointer":2156011040},{"callSite":2148031864,"calledTarget":2148006036,"context":"","framePointer":2156011168},{"callSite":2148025504,"calledTarget":0,"context":"Thread handler","framePointer":2156011272},{"callSite":2148018312,"calledTarget":0,"context":"Thread handler","framePointer":2156011384},{"callSite":2150275040,"calledTarget":2148018280,"context":"","framePointer":2156011480},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156011632},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156011728},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156011824},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156011920}],"instructionPointer":2153605200,"stackBottom":2155979248,"stackPointer":2156010904,"stackTop":2156012015,"threadId":184614926,"threadName":"PlgIspCtrl","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156043648},{"callSite":2148006220,"calledTarget":2153605048,"context":"","framePointer":2156043784},{"callSite":2148071524,"calledTarget":2148006136,"context":"","framePointer":2156043912},{"callSite":2148048840,"calledTarget":0,"context":"Thread handler","framePointer":2156044024},{"callSite":2148032952,"calledTarget":0,"context":"Thread handler","framePointer":2156044136},{"callSite":2150271736,"calledTarget":2148032920,"context":"","framePointer":2156044232},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156044552},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156044648},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156044744},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156044840}],"instructionPointer":2153605200,"stackBottom":2156012168,"stackPointer":2156043648,"stackTop":2156044935,"threadId":184614927,"threadName":"PlgColorIsp1xPo","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156077312},{"callSite":2148052928,"calledTarget":2153605048,"context":"","framePointer":2156077448},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156077568},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156077664},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156077760}],"instructionPointer":2153605200,"stackBottom":2156045088,"stackPointer":2156077312,"stackTop":2156077855,"threadId":184614928,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156118368},{"callSite":2148072348,"calledTarget":2153605048,"context":"","framePointer":2156118504},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156118720},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156118816},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156118912},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156119008}],"instructionPointer":2153605200,"stackBottom":2156086336,"stackPointer":2156118368,"stackTop":2156119103,"threadId":184614929,"threadName":"RmtI","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156151304},{"callSite":2148006220,"calledTarget":2153605048,"context":"","framePointer":2156151440},{"callSite":2148034028,"calledTarget":2148006136,"context":"","framePointer":2156151568},{"callSite":2148049104,"calledTarget":0,"context":"Thread handler","framePointer":2156151672},{"callSite":2148033232,"calledTarget":0,"context":"Thread handler","framePointer":2156151784},{"callSite":2148039528,"calledTarget":2148033200,"context":"","framePointer":2156151880},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156152224},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156152320},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156152416},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156152512}],"instructionPointer":2153605200,"stackBottom":2156119840,"stackPointer":2156151304,"stackTop":2156152607,"threadId":184614930,"threadName":"RmtO","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156184568},{"callSite":2150250696,"calledTarget":2153605048,"context":"","framePointer":2156184704},{"callSite":2148039624,"calledTarget":2150250372,"context":"","framePointer":2156184800},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156185144},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156185240},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156185336},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156185432}],"instructionPointer":2153605200,"stackBottom":2156152760,"stackPointer":2156184568,"stackTop":2156185527,"threadId":184614931,"threadName":"CRmO","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156216960},{"callSite":2148006120,"calledTarget":2153605048,"context":"","framePointer":2156217096},{"callSite":2148031864,"calledTarget":2148006036,"context":"","framePointer":2156217224},{"callSite":2148053304,"calledTarget":0,"context":"Thread handler","framePointer":2156217328},{"callSite":2148034376,"calledTarget":0,"context":"Thread handler","framePointer":2156217424},{"callSite":2148033136,"calledTarget":0,"context":"Thread handler","framePointer":2156217536},{"callSite":2150349076,"calledTarget":2148033104,"context":"","framePointer":2156217632},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156218064},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156218160},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156218256},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156218352}],"instructionPointer":2153605200,"stackBottom":2156185680,"stackPointer":2156216960,"stackTop":2156218447,"threadId":184614932,"threadName":"PlgPpEnc","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156250824},{"callSite":2148052928,"calledTarget":2153605048,"context":"","framePointer":2156250960},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156251080},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156251176},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156251272}],"instructionPointer":2153605200,"stackBottom":2156218600,"stackPointer":2156250824,"stackTop":2156251367,"threadId":184614933,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156283744},{"callSite":2148052928,"calledTarget":2153605048,"context":"","framePointer":2156283880},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156284000},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156284096},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156284192}],"instructionPointer":2153605200,"stackBottom":2156251520,"stackPointer":2156283744,"stackTop":2156284287,"threadId":184614934,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153594224,"calledTarget":2153625068,"context":"","framePointer":2156316184},{"callSite":2153594584,"calledTarget":2153594176,"context":"","framePointer":2156316280},{"callSite":2150250476,"calledTarget":2153594152,"context":"","framePointer":2156316416},{"callSite":2150093240,"calledTarget":2150250372,"context":"","framePointer":2156316512},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156316824},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156316920},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156317016},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156317112}],"instructionPointer":2153594224,"stackBottom":2156284440,"stackPointer":2156316184,"stackTop":2156317207,"threadId":184614935,"threadName":"RmtO","threadStatus":"WAITING_FOR_MUTEX"},{"callStack":[{"callSite":2153594224,"calledTarget":2153625068,"context":"","framePointer":2156349104},{"callSite":2153594584,"calledTarget":2153594176,"context":"","framePointer":2156349200},{"callSite":2150250476,"calledTarget":2153594152,"context":"","framePointer":2156349336},{"callSite":2150090912,"calledTarget":2150250372,"context":"","framePointer":2156349432},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156349744},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156349840},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156349936},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156350032}],"instructionPointer":2153594224,"stackBottom":2156317360,"stackPointer":2156349104,"stackTop":2156350127,"threadId":184614936,"threadName":"RmtO","threadStatus":"WAITING_FOR_MUTEX"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156390536},{"callSite":2149214992,"calledTarget":2149043120,"context":"","framePointer":2156390672},{"callSite":2149218548,"calledTarget":2149213872,"context":"","framePointer":2156391024},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156391120},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156391216},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156391312}],"instructionPointer":2153605200,"stackBottom":2156358640,"stackPointer":2156390536,"stackTop":2156391407,"threadId":184614937,"threadName":"NeuralNetworkIn","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153636204,"calledTarget":2153625068,"context":"","framePointer":2156424040},{"callSite":2149214948,"calledTarget":2153636112,"context":"","framePointer":2156424176},{"callSite":2149218548,"calledTarget":2149213872,"context":"","framePointer":2156424528},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156424624},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156424720},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156424816}],"instructionPointer":2153636204,"stackBottom":2156392144,"stackPointer":2156424040,"stackTop":2156424911,"threadId":184614938,"threadName":"NeuralNetworkIn","threadStatus":"WAITING_FOR_MUTEX"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156458496},{"callSite":2148006120,"calledTarget":2153605048,"context":"","framePointer":2156458632},{"callSite":2148031864,"calledTarget":2148006036,"context":"","framePointer":2156458760},{"callSite":2148053304,"calledTarget":0,"context":"Thread handler","framePointer":2156458864},{"callSite":2150285508,"calledTarget":0,"context":"Thread handler","framePointer":2156458960},{"callSite":2150285748,"calledTarget":2150285132,"context":"","framePointer":2156459120},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156459216},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156459312},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156459408}],"instructionPointer":2153605200,"stackBottom":2156426736,"stackPointer":2156458496,"stackTop":2156459503,"threadId":184614939,"threadName":"PlgSrcMipi","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153609224,"calledTarget":2153625068,"context":"","framePointer":2156491584},{"callSite":2153593028,"calledTarget":2153608968,"context":"","framePointer":2156491680},{"callSite":2150286868,"calledTarget":2153592876,"context":"","framePointer":2156491816},{"callSite":2150288632,"calledTarget":2150286740,"context":"","framePointer":2156492040},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156492136},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156492232},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156492328}],"instructionPointer":2153609224,"stackBottom":2156459656,"stackPointer":2156491584,"stackTop":2156492423,"threadId":184614940,"threadName":"PlgSrcMipi","threadStatus":"WAITING_FOR_MESSAGE"}]}],"depthaiCommitHash":"24a3b465b979de3f69410cd225914d8bd029f3ba","deviceId":"18443010C129770E00"}

Does this help already?

Thanks for your support!
Thomas

ThomasH

Hi @jakaskerl

I just tested with a different computer (freshly installed Ubuntu, USB 3.1, cable that was included with the OAK-D) - same result: crashed with ObjectTracker/objecttracker.py for example, ColorCamera/rgb_preview.py worked fine.

Thanks!
Thomas

jakaskerl

Hi @ThomasH
Are you using the latest depthai version?
Could you run the scripts with DEPTHAI_DEBUG=1 python3 rgb_mobilenet_4k.py and paste the log? I think it might be power related (possible brownout when running more demanding tasks).
Could you try with a different USB as well? Also do example with VideoEncoder crash as well?

Thanks,
Jaka

ThomasH

Hi @jakaskerl

thanks for your reply! I guess I am running the current version (2.26.0).

The rgb_mobilenet_4k.py worked sometimes, somtimes it crashed. At first it seemed to depend on the lighting in the room, but I could not really reproduce this. Here the log:

[2024-06-03 07:47:54.608] [depthai] [info] DEPTHAI_DEBUG enabled, lowered DEPTHAI_LEVEL to 'debug'
[2024-06-03 07:47:54.608] [depthai] [debug] Python bindings - version: 2.26.0.0 from  build: 2024-05-25 16:53:23 +0000
[2024-06-03 07:47:54.608] [depthai] [debug] Library information - version: 2.26.0, commit: 90487456cb92d15bcf0129a2f54c332250f1df31 from 2024-05-25 08:30:10 +0200, build: 2024-05-25 16:34:38 +0000, libusb enabled: true
[2024-06-03 07:47:54.612] [depthai] [debug] Initialize - finished
[2024-06-03 07:47:54.692] [depthai] [debug] Resources - Archive 'depthai-bootloader-fwp-0.0.28.tar.xz' open: 2ms, archive read: 82ms
[2024-06-03 07:47:55.078] [depthai] [debug] Resources - Archive 'depthai-device-fwp-24a3b465b979de3f69410cd225914d8bd029f3ba.tar.xz' open: 2ms, archive read: 467ms
[2024-06-03 07:47:55.165] [host] [debug] Device - OpenVINO version: 2022.1
[18443010C129770E00] [1.1] [1717393675.165] [host] [debug] Device - BoardConfig: {"camera":[],"emmc":null,"gpio":[],"imu":null,"logDevicePrints":true,"logPath":null,"logSizeMax":null,"logVerbosity":null,"network":{"mtu":0,"xlinkTcpNoDelay":true},"nonExclusiveMode":false,"pcieInternalClock":null,"sysctl":[],"uart":[],"usb":{"flashBootedPid":63037,"flashBootedVid":999,"manufacturer":"","maxSpeed":4,"pid":63035,"productName":"","vid":999},"usb3PhyInternalClock":null,"uvc":null,"watchdogInitialDelayMs":null,"watchdogTimeoutMs":null} 
libnop:
0000: b9 12 b9 07 81 e7 03 81 3b f6 81 e7 03 81 3d f6 04 bd 00 bd 00 b9 02 00 01 ba 00 be be bb 00 bb
0020: 00 be be be be be be 01 00 bb 00 be be
[2024-06-03 07:47:56.165] [depthai] [debug] Searching for booted device: DeviceInfo(name=1.1, mxid=18443010C129770E00, X_LINK_BOOTED, X_LINK_USB_VSC, X_LINK_MYRIAD_X, X_LINK_SUCCESS), name used as hint only
[18443010C129770E00] [1.1] [0.884] [system] [warning] PRINT:LeonCss: [OK]: INIT_NOC: noc probes timer create
[OK]: INIT_NOC: noc probes timer start
[OK]: INIT_NOC: ddr bandwith profiling!
BootloaderConfig.options1 checksum doesn't match. Is: 0x10304418 should be: 0xFCCBD2D0
GPIO boot mode 0x16, interface USBD
Setting aons(0..4) back to boot from flash (offset = 0)
====ENABLE WATCHDOG====1
initial keepalive, countdown: 10
PLL0: 700000 AUX_IO0: 24000 AUX_IO1: 24000 MCFG: 24000 MECFG: 24000
Board init ret 3
DepthAI Firmware - version: 24a3b465b979de3f69410cd225914d8bd029f3ba
eeprom configuration version: 55AA0007
Reading VERSION 7 --- ->
eeprom configuration load from user area, status: 0
Reading VERSION 7 --- ->
Didn't find any boards matching the eeprom data
Board options: 00000000
--> brdInit ...
brdInitAuxDevices: Error: SC = 27: io_initialize expander_cam_gpios_1 [OK]

spi_N25Q_init: Flash JEDEC ID: ff ff ff
Invalid Flash JEDEC ID... No NOR available
Could not register the spi device
inited hal ---
def: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
val: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
Opening bus for IR driver: 1
Failed to probe IR driver LM3644
Opening bus for IR driver: 2
Failed to probe IR driver LM3644
Opening bus for IR driver: 3
Failed to probe IR driver LM3644
Closing EEPROm!
MyriaX board configuration
pll0 frequency: 700000, ref0 frequency: 24000
Is booted from flash by bootloader: 0
Networking not available...
=== Enumerating on socket: Cam_A / RGB / Center
        skipped OV7251
        skipped AR0234
        skipped S5K33D
  >> Registered camera A12N02A (imx378) as /dev/Camera_0
camera socket: 0, name: color
        config - w: 1920, h: 1080, type: COLOR
        config - w: 3840, h: 2160, type: COLOR
        config - w: 4056, h: 3040, type: COLOR
        config - w: 1352, h: 1012, type: COLOR
        config - w: 2024, h: 1520, type: COLOR
Adding socket 0: cam 2. Sen name: IMX378
=== Enumerating on socket: Cam_B / Left
  >> Registered camera TG161B (ov9282) as /dev/Camera_1
camera socket: 1, name: left
        config - w: 1280, h: 720, type: MONO
        config - w: 1280, h: 800, type: MONO
        config - w: 640, h: 400, type: MONO
Adding socket 1: cam 5. Sen name: OV9282
=== Enumerating on socket: Cam_C / Right
  >> Registered camera TG161B (ov9282) as /dev/Camera_2
camera socket: 2, name: right
        config - w: 1280, h: 720, type: MONO
        config - w: 1280, h: 800, type: MONO
        config - w: 640, h: 400, type: MONO
Adding socket 2: cam 5. Sen name: OV9282
Didn't find any boards matching the eeprom data
Initializing XLink...
UsbPumpVscAppI_Event: 5 VSC2_EVENT_ATTACH
UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
initial keepalive, countdown: 9
UsbPumpVscAppI_Event: 0 VSC2_EVENT_INTERFACE_UP
Done!
Usb connection speed: Super - USB 3.0
Temperature: Driver registered.
Temperature: Initialized driver.
Temperature: Sensor opened: CSS.
Temperature: Sensor opened: M
[18443010C129770E00] [1.1] [0.887] [system] [info] Memory Usage - DDR: 0.12 / 333.28 MiB, CMX: 2.04 / 2.50 MiB, LeonOS Heap: 7.51 / 82.20 MiB, LeonRT Heap: 2.89 / 40.35 MiB / NOC ddr: 26 MB/s
[18443010C129770E00] [1.1] [0.887] [system] [info] Temperatures - Average: 26.96C, CSS: 28.37C, MSS 25.92C, UPA: 26.41C, DSS: 27.15C
[18443010C129770E00] [1.1] [0.887] [system] [info] Cpu Usage - LeonOS 29.86%, LeonRT: 1.80%
[18443010C129770E00] [1.1] [0.895] [system] [warning] PRINT:LeonCss: SS.
Temperature: Sensor opened: UPA.
Temperature: Sensor opened: DSS.
I: [Timesync] [   1459621] [XLin] startSync:186     Timesync | Callback not set
[18443010C129770E00] [1.1] [1717393677.074] [host] [debug] Schema dump: {"connections":[{"node1Id":1,"node1Output":"out","node1OutputGroup":"","node2Id":4,"node2Input":"in","node2InputGroup":""},{"node1Id":0,"node1Output":"preview","node1OutputGroup":"","node2Id":1,"node2Input":"in","node2InputGroup":""},{"node1Id":0,"node1Output":"preview","node1OutputGroup":"","node2Id":3,"node2Input":"in","node2InputGroup":""},{"node1Id":0,"node1Output":"video","node1OutputGroup":"","node2Id":2,"node2Input":"in","node2InputGroup":""}],"globalProperties":{"calibData":null,"cameraTuningBlobSize":null,"cameraTuningBlobUri":"","leonCssFrequencyHz":700000000.0,"leonMssFrequencyHz":700000000.0,"pipelineName":null,"pipelineVersion":null,"sippBufferSize":18432,"sippDmaBufferSize":16384,"xlinkChunkSize":-1},"nodes":[[0,{"id":0,"ioInfo":[[["","video"],{"blocking":false,"group":"","id":14,"name":"video","queueSize":8,"type":0,"waitForMessage":false}],[["","still"],{"blocking":false,"group":"","id":12,"name":"still","queueSize":8,"type":0,"waitForMessage":false}],[["","isp"],{"blocking":false,"group":"","id":11,"name":"isp","queueSize":8,"type":0,"waitForMessage":false}],[["","preview"],{"blocking":false,"group":"","id":13,"name":"preview","queueSize":8,"type":0,"waitForMessage":false}],[["","raw"],{"blocking":false,"group":"","id":10,"name":"raw","queueSize":8,"type":0,"waitForMessage":false}],[["","frameEvent"],{"blocking":false,"group":"","id":9,"name":"frameEvent","queueSize":8,"type":0,"waitForMessage":false}],[["","inputConfig"],{"blocking":false,"group":"","id":8,"name":"inputConfig","queueSize":8,"type":3,"waitForMessage":false}],[["","inputControl"],{"blocking":true,"group":"","id":7,"name":"inputControl","queueSize":8,"type":3,"waitForMessage":false}]],"name":"ColorCamera","properties":[185,26,185,31,0,3,0,136,0,0,0,0,0,0,185,3,0,0,0,185,5,0,0,0,0,0,185,5,0,0,0,0,0,0,0,0,0,0,0,0,0,0,185,3,0,0,0,185,3,0,0,0,0,0,0,0,0,0,0,0,0,0,0,255,189,0,255,0,0,0,129,44,1,129,44,1,255,255,255,255,1,136,0,0,240,65,0,136,0,0,128,191,136,0,0,128,191,0,185,4,0,0,0,0,3,3,4,4,4,190]}],[1,{"id":1,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":6,"name":"out","queueSize":8,"type":0,"waitForMessage":false}],[["","passthrough"],{"blocking":false,"group":"","id":5,"name":"passthrough","queueSize":8,"type":0,"waitForMessage":false}],[["","in"],{"blocking":false,"group":"","id":4,"name":"in","queueSize":5,"type":3,"waitForMessage":true}]],"name":"DetectionNetwork","properties":[185,6,130,64,133,221,0,189,12,97,115,115,101,116,58,95,95,98,108,111,98,8,2,0,185,7,1,136,0,0,0,63,0,0,186,0,187,0,136,0,0,0,0]}],[2,{"id":2,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":3,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,5,118,105,100,101,111,0]}],[3,{"id":3,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":2,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,7,112,114,101,118,105,101,119,0]}],[4,{"id":4,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":1,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,2,110,110,0]}]]}
[18443010C129770E00] [1.1] [1717393677.074] [host] [debug] Asset map dump: {"map":{"/node/1/__blob":{"alignment":64,"offset":0,"size":14517568}}}
[18443010C129770E00] [1.1] [0.928] [system] [warning] PRINT:LeonCss: Calling IPC set assets
[18443010C129770E00] [1.1] [1.038] [system] [warning] PRINT:LeonCss: Asset: /node/1/__blob, pointer: 0x8b2d7c00, size: 14517568, alignment: 64
[18443010C129770E00] [1.1] [1.040] [system] [info] SIPP (Signal Image Processing Pipeline) internal buffer size '18432'B, DMA buffer size: '16384'B
[18443010C129770E00] [1.1] [1.082] [system] [warning] PRINT:LeonMss: sippPalThreadCreate: Thread /SIPP created
[18443010C129770E00] [1.1] [1.075] [system] [info] ImageManip internal buffer size '366080'B, shave buffer size '34816'B
[18443010C129770E00] [1.1] [1.075] [system] [info] NeuralNetwork allocated resources: shaves: [0-9] cmx slices: [0-9] 
ColorCamera allocated resources: no shaves; cmx slices: [10-15] 
ImageManip allocated resources: shaves: [15-15] no cmx slices. 

[18443010C129770E00] [1.1] [1.087] [DetectionNetwork(1)] [info] Needed resources: shaves: 5, ddr: 7106432 
[18443010C129770E00] [1.1] [1.093] [system] [warning] PRINT:LeonCss: [1970-01-01 00:00:01.092] [info] Time taken to build the pipeline: 54ms
[18443010C129770E00] [1.1] [1.093] [system] [warning] PRINT:LeonMss: NeuralNetwork | Available resources: shaveStart: 0, numShaves: 10, mask: 000003FF
Initing ImgPreproc system!

Pre-proc Enc mem used: 138240 bytes. Available: 366080 
LRT - build pipeline call
[18443010C129770E00] [1.1] [1.095] [DetectionNetwork(1)] [info] Inference thread count: 2, number of shaves allocated per thread: 5, number of Neural Compute Engines (NCE) allocated per thread: 1
[18443010C129770E00] [1.1] [1.104] [system] [warning] PRINT:LeonCss: == FSYNC enabled for cam mask 0x0
CAM ID: 0, width: 3840, height: 2160, orientation: 0
getDefaultDtp: camType:2, color:1, orientation:0
DTP: ext_dtp_database
Loaded DTP, handle 0x84253fe8
== SW-SYNC: 0, cam mask 0x1
!!! Master Slave config is: single_master_slave !!!
Starting camera 0, server 0x84253fe8
[E] app_guzzi_command_callback():173: command->id:1
[E] app_guzzi_command_callback():193: command "1 0" sent

[18443010C129770E00] [1.1] [1.116] [system] [warning] PRINT:LeonCss: [E] iq_debug_create():161: iq_debug address 0x8885f8c0
[18443010C129770E00] [1.1] [1.127] [system] [warning] PRINT:LeonCss: [E] hai_cm_driver_load_dtp():852: Features for camera A12N02A (imx378) are received
[E] set_dtp_ids():396: //VIV HAL: Undefined VCM DTP ID 0
[E] set_dtp_ids():405: //VIV HAL: Undefined NVM DTP ID 0
[E] set_dtp_ids():414: //VIV HAL: Undefined lights DTP ID 0
[18443010C129770E00] [1.1] [1.137] [system] [warning] PRINT:LeonCss: [E] camera_control_start():360: Camera_id = 0 started.

============================ Configuring IMX378 with mode 0
[18443010C129770E00] [1.1] [1.160] [system] [warning] PRINT:LeonCss: ========== IMX378 /dev/i2c.Camera_0_sen, FSIN enable 0, output 0
[E] vpipe_conv_config():1465: Exit Ok
[18443010C129770E00] [1.1] [1.170] [system] [warning] PRINT:LeonCss: [E] callback():133: Camera CB START_DONE event.
inc_camera_process set exposure and gain
[18443010C129770E00] [1.1] [1.182] [system] [warning] PRINT:LeonCss: AF_TRIGGER on camera 0
[E] app_guzzi_command_callback():173: command->id:5
[E] camera_control_focus_trigger():604: Focus trigger succeeded camera_id = 0.

[E] app_guzzi_command_callback():218: command "5 0" sent

Starting Guzzi command handling loop...
[18443010C129770E00] [1.1] [1.182] [system] [warning] PRINT:LeonMss: MIPI DPHY 4 error, stat 0x30
[18443010C129770E00] [1.1] [1.236] [system] [warning] PRINT:LeonMss: finished sippPrePrepareLinesFreeRT
Resize video window with mouse drag!
[18443010C129770E00] [1.1] [1.262] [XLinkOut(2)] [info] Increasing 'video' stream size from 5242880B to 12492800B
[2024-06-03 07:48:00.346] [depthai] [debug] DataOutputQueue (nn) closed
[18443010C129770E00] [1.1] [1717393680.346] [host] [debug] Timesync thread exception caught: Couldn't read data from stream: '__timesync' (X_LINK_ERROR)
[2024-06-03 07:48:00.346] [depthai] [debug] DataOutputQueue (preview) closed
[18443010C129770E00] [1.1] [1717393680.346] [host] [debug] Log thread exception caught: Couldn't read data from stream: '__log' (X_LINK_ERROR)
[2024-06-03 07:48:00.346] [depthai] [debug] DataOutputQueue (video) closed
[18443010C129770E00] [1.1] [1717393680.350] [host] [debug] Device about to be closed...
[18443010C129770E00] [1.1] [1717393680.350] [host] [debug] RPC error: Couldn't write data to stream: '__rpc_main' (X_LINK_ERROR)
[18443010C129770E00] [1.1] [1717393680.351] [host] [debug] shutdown call error: Device already closed or disconnected: Eingabe-/Ausgabefehler
[2024-06-03 07:48:00.351] [depthai] [debug] XLinkResetRemoteTimeout returned: X_LINK_ERROR
[2024-06-03 07:48:00.351] [depthai] [debug] XLinkResetRemote of linkId: (0)
[18443010C129770E00] [1.1] [1717393681.558] [host] [debug] Getting crash dump...
[2024-06-03 07:48:01.559] [host] [debug] Device - OpenVINO version: 2022.1
[18443010C129770E00] [1.1] [1717393681.559] [host] [debug] Device - BoardConfig: {"camera":[],"emmc":null,"gpio":[],"imu":null,"logDevicePrints":true,"logPath":null,"logSizeMax":null,"logVerbosity":null,"network":{"mtu":0,"xlinkTcpNoDelay":true},"nonExclusiveMode":false,"pcieInternalClock":null,"sysctl":[],"uart":[],"usb":{"flashBootedPid":63037,"flashBootedVid":999,"manufacturer":"","maxSpeed":4,"pid":63035,"productName":"","vid":999},"usb3PhyInternalClock":null,"uvc":null,"watchdogInitialDelayMs":null,"watchdogTimeoutMs":null} 
libnop:
0000: b9 12 b9 07 81 e7 03 81 3b f6 81 e7 03 81 3d f6 04 bd 00 bd 00 b9 02 00 01 ba 00 be be bb 00 bb
0020: 00 be be be be be be 01 00 bb 00 be be
[2024-06-03 07:48:02.565] [depthai] [debug] Searching for booted device: DeviceInfo(name=1.1, mxid=18443010C129770E00, X_LINK_BOOTED, X_LINK_USB_VSC, X_LINK_MYRIAD_X, X_LINK_SUCCESS), name used as hint only
[18443010C129770E00] [1.1] [1717393683.532] [host] [warning] Device crashed, but no crash dump could be extracted.
[18443010C129770E00] [1.1] [1717393684.281] [host] [debug] Watchdog thread exception caught: Couldn't write data to stream: '__watchdog' (X_LINK_ERROR)
[2024-06-03 07:48:04.390] [depthai] [debug] XLinkResetRemote of linkId: (1)
[18443010C129770E00] [1.1] [1717393685.030] [host] [debug] Device closed, 4679

The tiny-yolo example always crashed (sometimes it worked for about 5 seconds, but in most cases it crashed instantly):

[2024-06-03 07:55:04.940] [depthai] [info] DEPTHAI_DEBUG enabled, lowered DEPTHAI_LEVEL to 'debug'
[2024-06-03 07:55:04.940] [depthai] [debug] Python bindings - version: 2.26.0.0 from  build: 2024-05-25 16:53:23 +0000
[2024-06-03 07:55:04.940] [depthai] [debug] Library information - version: 2.26.0, commit: 90487456cb92d15bcf0129a2f54c332250f1df31 from 2024-05-25 08:30:10 +0200, build: 2024-05-25 16:34:38 +0000, libusb enabled: true
[2024-06-03 07:55:04.944] [depthai] [debug] Initialize - finished
Using Tiny YoloV4 model. If you wish to use Tiny YOLOv3, call 'tiny_yolo.py yolo3'
[2024-06-03 07:55:05.025] [depthai] [debug] Resources - Archive 'depthai-bootloader-fwp-0.0.28.tar.xz' open: 2ms, archive read: 82ms
[2024-06-03 07:55:05.407] [depthai] [debug] Resources - Archive 'depthai-device-fwp-24a3b465b979de3f69410cd225914d8bd029f3ba.tar.xz' open: 2ms, archive read: 465ms
[2024-06-03 07:55:05.485] [host] [debug] Device - OpenVINO version: 2022.1
[18443010C129770E00] [1.1] [1717394105.486] [host] [debug] Device - BoardConfig: {"camera":[],"emmc":null,"gpio":[],"imu":null,"logDevicePrints":true,"logPath":null,"logSizeMax":null,"logVerbosity":null,"network":{"mtu":0,"xlinkTcpNoDelay":true},"nonExclusiveMode":false,"pcieInternalClock":null,"sysctl":[],"uart":[],"usb":{"flashBootedPid":63037,"flashBootedVid":999,"manufacturer":"","maxSpeed":4,"pid":63035,"productName":"","vid":999},"usb3PhyInternalClock":null,"uvc":null,"watchdogInitialDelayMs":null,"watchdogTimeoutMs":null} 
libnop:
0000: b9 12 b9 07 81 e7 03 81 3b f6 81 e7 03 81 3d f6 04 bd 00 bd 00 b9 02 00 01 ba 00 be be bb 00 bb
0020: 00 be be be be be be 01 00 bb 00 be be
[2024-06-03 07:55:06.492] [depthai] [debug] Searching for booted device: DeviceInfo(name=1.1, mxid=18443010C129770E00, X_LINK_BOOTED, X_LINK_USB_VSC, X_LINK_MYRIAD_X, X_LINK_SUCCESS), name used as hint only
[18443010C129770E00] [1.1] [0.888] [system] [warning] PRINT:LeonCss: [OK]: INIT_NOC: noc probes timer create
[OK]: INIT_NOC: noc probes timer start
[OK]: INIT_NOC: ddr bandwith profiling!
BootloaderConfig.options1 checksum doesn't match. Is: 0x10304418 should be: 0xFCCBD2D0
GPIO boot mode 0x16, interface USBD
Setting aons(0..4) back to boot from flash (offset = 0)
====ENABLE WATCHDOG====1
initial keepalive, countdown: 10
PLL0: 700000 AUX_IO0: 24000 AUX_IO1: 24000 MCFG: 24000 MECFG: 24000
Board init ret 3
DepthAI Firmware - version: 24a3b465b979de3f69410cd225914d8bd029f3ba
eeprom configuration version: 55AA0007
Reading VERSION 7 --- ->
eeprom configuration load from user area, status: 0
Reading VERSION 7 --- ->
Didn't find any boards matching the eeprom data
Board options: 00000000
--> brdInit ...
brdInitAuxDevices: Error: SC = 27: io_initialize expander_cam_gpios_1 [OK]

spi_N25Q_init: Flash JEDEC ID: ff ff ff
Invalid Flash JEDEC ID... No NOR available
Could not register the spi device
inited hal ---
def: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
val: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
Opening bus for IR driver: 1
Failed to probe IR driver LM3644
Opening bus for IR driver: 2
Failed to probe IR driver LM3644
Opening bus for IR driver: 3
Failed to probe IR driver LM3644
Closing EEPROm!
MyriaX board configuration
pll0 frequency: 700000, ref0 frequency: 24000
Is booted from flash by bootloader: 0
Networking not available...
=== Enumerating on socket: Cam_A / RGB / Center
        skipped OV7251
        skipped AR0234
        skipped S5K33D
  >> Registered camera A12N02A (imx378) as /dev/Camera_0
camera socket: 0, name: color
        config - w: 1920, h: 1080, type: COLOR
        config - w: 3840, h: 2160, type: COLOR
        config - w: 4056, h: 3040, type: COLOR
        config - w: 1352, h: 1012, type: COLOR
        config - w: 2024, h: 1520, type: COLOR
Adding socket 0: cam 2. Sen name: IMX378
=== Enumerating on socket: Cam_B / Left
  >> Registered camera TG161B (ov9282) as /dev/Camera_1
camera socket: 1, name: left
        config - w: 1280, h: 720, type: MONO
        config - w: 1280, h: 800, type: MONO
        config - w: 640, h: 400, type: MONO
Adding socket 1: cam 5. Sen name: OV9282
=== Enumerating on socket: Cam_C / Right
  >> Registered camera TG161B (ov9282) as /dev/Camera_2
camera socket: 2, name: right
        config - w: 1280, h: 720, type: MONO
        config - w: 1280, h: 800, type: MONO
        config - w: 640, h: 400, type: MONO
Adding socket 2: cam 5. Sen name: OV9282
Didn't find any boards matching the eeprom data
Initializing XLink...
UsbPumpVscAppI_Event: 5 VSC2_EVENT_ATTACH
UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
initial keepalive, countdown: 9
UsbPumpVscAppI_Event: 0 VSC2_EVENT_INTERFACE_UP
Done!
Usb connection speed: Super - USB 3.0
Temperature: Driver registered.
Temperature: Initialized driver.
Temperature: Sensor opened: CSS.
Tempe
[18443010C129770E00] [1.1] [0.892] [system] [info] Memory Usage - DDR: 0.12 / 333.28 MiB, CMX: 2.04 / 2.50 MiB, LeonOS Heap: 7.51 / 82.20 MiB, LeonRT Heap: 2.89 / 40.35 MiB / NOC ddr: 26 MB/s
[18443010C129770E00] [1.1] [0.892] [system] [info] Temperatures - Average: 30.56C, CSS: 32.49C, MSS 29.10C, UPA: 30.08C, DSS: 30.56C
[18443010C129770E00] [1.1] [0.892] [system] [info] Cpu Usage - LeonOS 71.37%, LeonRT: 1.80%
[18443010C129770E00] [1.1] [0.899] [system] [warning] PRINT:LeonCss: rature: Sensor opened: MSS.
Temperature: Sensor opened: UPA.
Temperature: Sensor opened: DSS.
I: [Timesync] [   5036715] [XLin] startSync:186     Timesync | Callback not set
[18443010C129770E00] [1.1] [1717394107.405] [host] [debug] Schema dump: {"connections":[{"node1Id":1,"node1Output":"out","node1OutputGroup":"","node2Id":3,"node2Input":"in","node2InputGroup":""},{"node1Id":1,"node1Output":"passthrough","node1OutputGroup":"","node2Id":2,"node2Input":"in","node2InputGroup":""},{"node1Id":0,"node1Output":"preview","node1OutputGroup":"","node2Id":1,"node2Input":"in","node2InputGroup":""}],"globalProperties":{"calibData":null,"cameraTuningBlobSize":null,"cameraTuningBlobUri":"","leonCssFrequencyHz":700000000.0,"leonMssFrequencyHz":700000000.0,"pipelineName":null,"pipelineVersion":null,"sippBufferSize":18432,"sippDmaBufferSize":16384,"xlinkChunkSize":-1},"nodes":[[0,{"id":0,"ioInfo":[[["","video"],{"blocking":false,"group":"","id":13,"name":"video","queueSize":8,"type":0,"waitForMessage":false}],[["","still"],{"blocking":false,"group":"","id":11,"name":"still","queueSize":8,"type":0,"waitForMessage":false}],[["","isp"],{"blocking":false,"group":"","id":10,"name":"isp","queueSize":8,"type":0,"waitForMessage":false}],[["","preview"],{"blocking":false,"group":"","id":12,"name":"preview","queueSize":8,"type":0,"waitForMessage":false}],[["","raw"],{"blocking":false,"group":"","id":9,"name":"raw","queueSize":8,"type":0,"waitForMessage":false}],[["","frameEvent"],{"blocking":false,"group":"","id":8,"name":"frameEvent","queueSize":8,"type":0,"waitForMessage":false}],[["","inputConfig"],{"blocking":false,"group":"","id":7,"name":"inputConfig","queueSize":8,"type":3,"waitForMessage":false}],[["","inputControl"],{"blocking":true,"group":"","id":6,"name":"inputControl","queueSize":8,"type":3,"waitForMessage":false}]],"name":"ColorCamera","properties":[185,26,185,31,0,3,0,136,0,0,0,0,0,0,185,3,0,0,0,185,5,0,0,0,0,0,185,5,0,0,0,0,0,0,0,0,0,0,0,0,0,0,185,3,0,0,0,185,3,0,0,0,0,0,0,0,0,0,0,0,0,0,0,255,189,0,255,0,0,0,129,160,1,129,160,1,255,255,255,255,0,136,0,0,32,66,0,136,0,0,128,191,136,0,0,128,191,1,185,4,0,0,0,0,3,3,4,4,4,190]}],[1,{"id":1,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":5,"name":"out","queueSize":8,"type":0,"waitForMessage":false}],[["","passthrough"],{"blocking":false,"group":"","id":4,"name":"passthrough","queueSize":8,"type":0,"waitForMessage":false}],[["","in"],{"blocking":false,"group":"","id":3,"name":"in","queueSize":5,"type":3,"waitForMessage":true}]],"name":"DetectionNetwork","properties":[185,6,130,128,171,185,0,189,12,97,115,115,101,116,58,95,95,98,108,111,98,8,2,0,185,7,0,136,0,0,0,63,80,4,186,12,136,0,0,32,65,136,0,0,96,65,136,0,0,184,65,136,0,0,216,65,136,0,0,20,66,136,0,0,104,66,136,0,0,162,66,136,0,0,164,66,136,0,0,7,67,136,0,0,41,67,136,0,0,172,67,136,0,128,159,67,187,2,189,6,115,105,100,101,49,51,188,12,3,0,0,0,4,0,0,0,5,0,0,0,189,6,115,105,100,101,50,54,188,12,1,0,0,0,2,0,0,0,3,0,0,0,136,0,0,0,63]}],[2,{"id":2,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":2,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,3,114,103,98,0]}],[3,{"id":3,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":1,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,2,110,110,0]}]]}
[18443010C129770E00] [1.1] [1717394107.405] [host] [debug] Asset map dump: {"map":{"/node/1/__blob":{"alignment":64,"offset":0,"size":12168064}}}
[18443010C129770E00] [1.1] [0.932] [system] [warning] PRINT:LeonCss: Calling IPC set assets
[18443010C129770E00] [1.1] [1.031] [system] [warning] PRINT:LeonCss: Asset: /node/1/__blob, pointer: 0x8b2d7c00, size: 12168064, alignment: 64
[18443010C129770E00] [1.1] [1.064] [system] [warning] PRINT:LeonMss: sippPalThreadCreate: Thread /SIPP created
[18443010C129770E00] [1.1] [1.075] [system] [warning] PRINT:LeonMss: NeuralNetwork | Available resources: shaveStart: 0, numShaves: 13, mask: 00001FFF
[18443010C129770E00] [1.1] [1.025] [system] [info] SIPP (Signal Image Processing Pipeline) internal buffer size '18432'B, DMA buffer size: '16384'B
[18443010C129770E00] [1.1] [1.061] [system] [info] ImageManip internal buffer size '285440'B, shave buffer size '34816'B
[18443010C129770E00] [1.1] [1.061] [system] [info] NeuralNetwork allocated resources: shaves: [0-12] cmx slices: [0-12] 
ColorCamera allocated resources: no shaves; cmx slices: [13-15] 
ImageManip allocated resources: shaves: [15-15] no cmx slices. 

[18443010C129770E00] [1.1] [1.075] [DetectionNetwork(1)] [info] Needed resources: shaves: 6, ddr: 8110912 
[18443010C129770E00] [1.1] [1.083] [DetectionNetwork(1)] [info] Inference thread count: 2, number of shaves allocated per thread: 6, number of Neural Compute Engines (NCE) allocated per thread: 1
[18443010C129770E00] [1.1] [1.087] [system] [warning] PRINT:LeonCss: [1970-01-01 00:00:01.080] [info] Time taken to build the pipeline: 56ms
== FSYNC enabled for cam mask 0x0
CAM ID: 0, width: 1920, height: 1080, orientation: 0
getDefaultDtp: camType:2, color:1, orientation:0
DTP: ext_dtp_database
Loaded DTP, handle 0x84253fe8
== SW-SYNC: 0, cam mask 0x1
!!! Master Slave config is: single_master_slave !!!
Starting camera 0, server 0x84253fe8
[E] app_guzzi_command_callback():173: command->id:1
[E] app_guzzi_command_callback():193: command "1 0" sent

[18443010C129770E00] [1.1] [1.087] [system] [warning] PRINT:LeonMss: Initing ImgPreproc system!

Pre-proc Enc mem used: 69120 bytes. Available: 285440 
LRT - build pipeline call
[18443010C129770E00] [1.1] [1.108] [system] [warning] PRINT:LeonCss: [E] iq_debug_create():161: iq_debug address 0x88362780
[18443010C129770E00] [1.1] [1.120] [system] [warning] PRINT:LeonCss: [E] hai_cm_driver_load_dtp():852: Features for camera A12N02A (imx378) are received
[E] set_dtp_ids():396: //VIV HAL: Undefined VCM DTP ID 0
[E] set_dtp_ids():405: //VIV HAL: Undefined NVM DTP ID 0
[E] set_dtp_ids():414: //VIV HAL: Undefined lights DTP ID 0
[18443010C129770E00] [1.1] [1.130] [system] [warning] PRINT:LeonCss: [E] camera_control_start():360: Camera_id = 0 started.

[E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1920x1080 at 0x0 fps min 40.000000 max 40.000000
[E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1920x1080 at 0x0 fps min 40.000000 max 40.000000
============================ Configuring IMX378 with mode 0
[18443010C129770E00] [1.1] [1.152] [system] [warning] PRINT:LeonCss: ========== IMX378 /dev/i2c.Camera_0_sen, FSIN enable 0, output 0
[E] vpipe_conv_config():1465: Exit Ok
[18443010C129770E00] [1.1] [1.163] [system] [warning] PRINT:LeonCss: [E] callback():133: Camera CB START_DONE event.
inc_camera_process set exposure and gain
[18443010C129770E00] [1.1] [1.175] [system] [warning] PRINT:LeonCss: AF_TRIGGER on camera 0
[E] app_guzzi_command_callback():173: command->id:5
[E] camera_control_focus_trigger():604: Focus trigger succeeded camera_id = 0.

[E] app_guzzi_command_callback():218: command "5 0" sent

Starting Guzzi command handling loop...
[18443010C129770E00] [1.1] [1.175] [system] [warning] PRINT:LeonMss: MIPI DPHY 4 error, stat 0x30
[18443010C129770E00] [1.1] [1.218] [system] [warning] PRINT:LeonMss: finished sippPrePrepareLinesFreeRT
[18443010C129770E00] [1.1] [1.537] [system] [warning] PRINT:LeonCss: initial keepalive, countdown: 8
[18443010C129770E00] [1.1] [1717394110.802] [host] [debug] Log thread exception caught: Couldn't read data from stream: '__log' (X_LINK_ERROR)
[2024-06-03 07:55:10.802] [depthai] [debug] DataOutputQueue (nn) closed
[18443010C129770E00] [1.1] [1717394110.802] [host] [debug] Timesync thread exception caught: Couldn't read data from stream: '__timesync' (X_LINK_ERROR)
[2024-06-03 07:55:10.802] [depthai] [debug] DataOutputQueue (rgb) closed
[18443010C129770E00] [1.1] [1717394110.802] [host] [debug] Device about to be closed...
[18443010C129770E00] [1.1] [1717394110.802] [host] [debug] RPC error: Couldn't write data to stream: '__rpc_main' (X_LINK_ERROR)
[18443010C129770E00] [1.1] [1717394110.802] [host] [debug] shutdown call error: Device already closed or disconnected: Eingabe-/Ausgabefehler
[2024-06-03 07:55:10.802] [depthai] [debug] XLinkResetRemoteTimeout returned: X_LINK_ERROR
[2024-06-03 07:55:10.802] [depthai] [debug] XLinkResetRemote of linkId: (0)
[18443010C129770E00] [1.1] [1717394111.890] [host] [debug] Getting crash dump...
[2024-06-03 07:55:11.891] [host] [debug] Device - OpenVINO version: 2022.1
[18443010C129770E00] [1.1] [1717394111.891] [host] [debug] Device - BoardConfig: {"camera":[],"emmc":null,"gpio":[],"imu":null,"logDevicePrints":true,"logPath":null,"logSizeMax":null,"logVerbosity":null,"network":{"mtu":0,"xlinkTcpNoDelay":true},"nonExclusiveMode":false,"pcieInternalClock":null,"sysctl":[],"uart":[],"usb":{"flashBootedPid":63037,"flashBootedVid":999,"manufacturer":"","maxSpeed":4,"pid":63035,"productName":"","vid":999},"usb3PhyInternalClock":null,"uvc":null,"watchdogInitialDelayMs":null,"watchdogTimeoutMs":null} 
libnop:
0000: b9 12 b9 07 81 e7 03 81 3b f6 81 e7 03 81 3d f6 04 bd 00 bd 00 b9 02 00 01 ba 00 be be bb 00 bb
0020: 00 be be be be be be 01 00 bb 00 be be
[2024-06-03 07:55:12.888] [depthai] [debug] Searching for booted device: DeviceInfo(name=1.1, mxid=18443010C129770E00, X_LINK_BOOTED, X_LINK_USB_VSC, X_LINK_MYRIAD_X, X_LINK_SUCCESS), name used as hint only
[18443010C129770E00] [1.1] [1717394113.997] [host] [warning] Device crashed. Crash dump saved to /tmp/depthai_gCCfey/18443010C129770E00-depthai_crash_dump.json
[18443010C129770E00] [1.1] [1717394114.620] [host] [debug] Watchdog thread exception caught: Couldn't write data to stream: '__watchdog' (X_LINK_ERROR)
[2024-06-03 07:55:14.854] [depthai] [debug] XLinkResetRemote of linkId: (1)
[18443010C129770E00] [1.1] [1717394115.369] [host] [debug] Device closed, 4566

All VideoEncoder seemed to work fine.

I have ordered a new USB 3.1 Gen2 cable, I'll let you know the results tomorrow.

Thanks!

Thomas

ThomasH

Hi @jakaskerl

I tested the new USB cable. Same as before: rgb_mobilenet*4k.py works sometimes, sometimes it does not. object_*tracker.py and tiny_yolo.py crashed (the first time, yolo worked several seconds, but in most cases it crashed instantly):

[2024-06-04 18:13:18.008] [depthai] [info] DEPTHAI_DEBUG enabled, lowered DEPTHAI_LEVEL to 'debug'
[2024-06-04 18:13:18.008] [depthai] [debug] Python bindings - version: 2.26.0.0 from  build: 2024-05-25 16:53:23 +0000
[2024-06-04 18:13:18.008] [depthai] [debug] Library information - version: 2.26.0, commit: 90487456cb92d15bcf0129a2f54c332250f1df31 from 2024-05-25 08:30:10 +0200, build: 2024-05-25 16:34:38 +0000, libusb enabled: true
[2024-06-04 18:13:18.012] [depthai] [debug] Initialize - finished
Using Tiny YoloV4 model. If you wish to use Tiny YOLOv3, call 'tiny_yolo.py yolo3'
[2024-06-04 18:13:18.093] [depthai] [debug] Resources - Archive 'depthai-bootloader-fwp-0.0.28.tar.xz' open: 2ms, archive read: 82ms
[2024-06-04 18:13:18.481] [depthai] [debug] Resources - Archive 'depthai-device-fwp-24a3b465b979de3f69410cd225914d8bd029f3ba.tar.xz' open: 2ms, archive read: 470ms
[2024-06-04 18:13:18.557] [host] [debug] Device - OpenVINO version: 2022.1
[18443010C129770E00] [1.1] [1717517598.557] [host] [debug] Device - BoardConfig: {"camera":[],"emmc":null,"gpio":[],"imu":null,"logDevicePrints":true,"logPath":null,"logSizeMax":null,"logVerbosity":null,"network":{"mtu":0,"xlinkTcpNoDelay":true},"nonExclusiveMode":false,"pcieInternalClock":null,"sysctl":[],"uart":[],"usb":{"flashBootedPid":63037,"flashBootedVid":999,"manufacturer":"","maxSpeed":4,"pid":63035,"productName":"","vid":999},"usb3PhyInternalClock":null,"uvc":null,"watchdogInitialDelayMs":null,"watchdogTimeoutMs":null} 
libnop:
0000: b9 12 b9 07 81 e7 03 81 3b f6 81 e7 03 81 3d f6 04 bd 00 bd 00 b9 02 00 01 ba 00 be be bb 00 bb
0020: 00 be be be be be be 01 00 bb 00 be be
[2024-06-04 18:13:19.542] [depthai] [debug] Searching for booted device: DeviceInfo(name=1.1, mxid=18443010C129770E00, X_LINK_BOOTED, X_LINK_USB_VSC, X_LINK_MYRIAD_X, X_LINK_SUCCESS), name used as hint only
[18443010C129770E00] [1.1] [0.926] [system] [warning] PRINT:LeonCss: [OK]: INIT_NOC: noc probes timer create
[OK]: INIT_NOC: noc probes timer start
[OK]: INIT_NOC: ddr bandwith profiling!
BootloaderConfig.options1 checksum doesn't match. Is: 0x10304418 should be: 0xFCCBD2D0
GPIO boot mode 0x16, interface USBD
Setting aons(0..4) back to boot from flash (offset = 0)
====ENABLE WATCHDOG====1
initial keepalive, countdown: 10
PLL0: 700000 AUX_IO0: 24000 AUX_IO1: 24000 MCFG: 24000 MECFG: 24000
Board init ret 3
DepthAI Firmware - version: 24a3b465b979de3f69410cd225914d8bd029f3ba
eeprom configuration version: 55AA0007
Reading VERSION 7 --- ->
eeprom configuration load from user area, status: 0
Reading VERSION 7 --- ->
Didn't find any boards matching the eeprom data
Board options: 00000000
--> brdInit ...
brdInitAuxDevices: Error: SC = 27: io_initialize expander_cam_gpios_1 [OK]

spi_N25Q_init: Flash JEDEC ID: ff ff ff
Invalid Flash JEDEC ID... No NOR available
Could not register the spi device
inited hal ---
def: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
val: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
Opening bus for IR driver: 1
Failed to probe IR driver LM3644
Opening bus for IR driver: 2
Failed to probe IR driver LM3644
Opening bus for IR driver: 3
Failed to probe IR driver LM3644
Closing EEPROm!
MyriaX board configuration
pll0 frequency: 700000, ref0 frequency: 24000
Is booted from flash by bootloader: 0
Networking not available...
=== Enumerating on socket: Cam_A / RGB / Center
        skipped OV7251
        skipped AR0234
        skipped S5K33D
  >> Registered camera A12N02A (imx378) as /dev/Camera_0
camera socket: 0, name: color
        config - w: 1920, h: 1080, type: COLOR
        config - w: 3840, h: 2160, type: COLOR
        config - w: 4056, h: 3040, type: COLOR
        config - w: 1352, h: 1012, type: COLOR
        config - w: 2024, h: 1520, type: COLOR
Adding socket 0: cam 2. Sen name: IMX378
=== Enumerating on socket: Cam_B / Left
  >> Registered camera TG161B (ov9282) as /dev/Camera_1
camera socket: 1, name: left
        config - w: 1280, h: 720, type: MONO
        config - w: 1280, h: 800, type: MONO
        config - w: 640, h: 400, type: MONO
Adding socket 1: cam 5. Sen name: OV9282
=== Enumerating on socket: Cam_C / Right
  >> Registered camera TG161B (ov9282) as /dev/Camera_2
camera socket: 2, name: right
        config - w: 1280, h: 720, type: MONO
        config - w: 1280, h: 800, type: MONO
        config - w: 640, h: 400, type: MONO
Adding socket 2: cam 5. Sen name: OV9282
Didn't find any boards matching the eeprom data
Initializing XLink...
UsbPumpVscAppI_Event: 5 VSC2_EVENT_ATTACH
UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
initial keepalive, countdown: 9
UsbPumpVscAppI_Event: 0 VSC2_EVENT_INTERFACE_UP
Done!
Usb connection speed: Super - USB 3.0
Temperature: Driver registered.
[18443010C129770E00] [1.1] [0.929] [system] [info] Memory Usage - DDR: 0.12 / 333.28 MiB, CMX: 2.04 / 2.50 MiB, LeonOS Heap: 7.51 / 82.20 MiB, LeonRT Heap: 2.89 / 40.35 MiB / NOC ddr: 26 MB/s
[18443010C129770E00] [1.1] [0.929] [system] [info] Temperatures - Average: 30.50C, CSS: 32.25C, MSS 29.83C, UPA: 29.59C, DSS: 30.32C
[18443010C129770E00] [1.1] [0.929] [system] [info] Cpu Usage - LeonOS 59.48%, LeonRT: 1.76%
[18443010C129770E00] [1.1] [0.937] [system] [warning] PRINT:LeonCss: Temperature: Initialized driver.
Temperature: Sensor opened: CSS.
Temperature: Sensor opened: MSS.
Temperature: Sensor opened: UPA.
Temperature: Sensor opened: DSS.
I: [Timesync] [   3357822] [XLin] startSync:186     Timesync | Callback not set
[18443010C129770E00] [1.1] [1717517600.492] [host] [debug] Schema dump: {"connections":[{"node1Id":1,"node1Output":"out","node1OutputGroup":"","node2Id":3,"node2Input":"in","node2InputGroup":""},{"node1Id":1,"node1Output":"passthrough","node1OutputGroup":"","node2Id":2,"node2Input":"in","node2InputGroup":""},{"node1Id":0,"node1Output":"preview","node1OutputGroup":"","node2Id":1,"node2Input":"in","node2InputGroup":""}],"globalProperties":{"calibData":null,"cameraTuningBlobSize":null,"cameraTuningBlobUri":"","leonCssFrequencyHz":700000000.0,"leonMssFrequencyHz":700000000.0,"pipelineName":null,"pipelineVersion":null,"sippBufferSize":18432,"sippDmaBufferSize":16384,"xlinkChunkSize":-1},"nodes":[[0,{"id":0,"ioInfo":[[["","video"],{"blocking":false,"group":"","id":13,"name":"video","queueSize":8,"type":0,"waitForMessage":false}],[["","still"],{"blocking":false,"group":"","id":11,"name":"still","queueSize":8,"type":0,"waitForMessage":false}],[["","isp"],{"blocking":false,"group":"","id":10,"name":"isp","queueSize":8,"type":0,"waitForMessage":false}],[["","preview"],{"blocking":false,"group":"","id":12,"name":"preview","queueSize":8,"type":0,"waitForMessage":false}],[["","raw"],{"blocking":false,"group":"","id":9,"name":"raw","queueSize":8,"type":0,"waitForMessage":false}],[["","frameEvent"],{"blocking":false,"group":"","id":8,"name":"frameEvent","queueSize":8,"type":0,"waitForMessage":false}],[["","inputConfig"],{"blocking":false,"group":"","id":7,"name":"inputConfig","queueSize":8,"type":3,"waitForMessage":false}],[["","inputControl"],{"blocking":true,"group":"","id":6,"name":"inputControl","queueSize":8,"type":3,"waitForMessage":false}]],"name":"ColorCamera","properties":[185,26,185,31,0,3,0,136,0,0,0,0,0,0,185,3,0,0,0,185,5,0,0,0,0,0,185,5,0,0,0,0,0,0,0,0,0,0,0,0,0,0,185,3,0,0,0,185,3,0,0,0,0,0,0,0,0,0,0,0,0,0,0,255,189,0,255,0,0,0,129,160,1,129,160,1,255,255,255,255,0,136,0,0,32,66,0,136,0,0,128,191,136,0,0,128,191,1,185,4,0,0,0,0,3,3,4,4,4,190]}],[1,{"id":1,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":5,"name":"out","queueSize":8,"type":0,"waitForMessage":false}],[["","passthrough"],{"blocking":false,"group":"","id":4,"name":"passthrough","queueSize":8,"type":0,"waitForMessage":false}],[["","in"],{"blocking":false,"group":"","id":3,"name":"in","queueSize":5,"type":3,"waitForMessage":true}]],"name":"DetectionNetwork","properties":[185,6,130,128,171,185,0,189,12,97,115,115,101,116,58,95,95,98,108,111,98,8,2,0,185,7,0,136,0,0,0,63,80,4,186,12,136,0,0,32,65,136,0,0,96,65,136,0,0,184,65,136,0,0,216,65,136,0,0,20,66,136,0,0,104,66,136,0,0,162,66,136,0,0,164,66,136,0,0,7,67,136,0,0,41,67,136,0,0,172,67,136,0,128,159,67,187,2,189,6,115,105,100,101,49,51,188,12,3,0,0,0,4,0,0,0,5,0,0,0,189,6,115,105,100,101,50,54,188,12,1,0,0,0,2,0,0,0,3,0,0,0,136,0,0,0,63]}],[2,{"id":2,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":2,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,3,114,103,98,0]}],[3,{"id":3,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":1,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,2,110,110,0]}]]}
[18443010C129770E00] [1.1] [1717517600.492] [host] [debug] Asset map dump: {"map":{"/node/1/__blob":{"alignment":64,"offset":0,"size":12168064}}}
[18443010C129770E00] [1.1] [0.959] [system] [warning] PRINT:LeonCss: Calling IPC set assets
[18443010C129770E00] [1.1] [1.069] [system] [warning] PRINT:LeonCss: Asset: /node/1/__blob, pointer: 0x8b2d7c00, size: 12168064, alignment: 64
[18443010C129770E00] [1.1] [1.102] [system] [warning] PRINT:LeonMss: sippPalThreadCreate: Thread /SIPP created
[18443010C129770E00] [1.1] [1.113] [system] [warning] PRINT:LeonMss: NeuralNetwork | Available resources: shaveStart: 0, numShaves: 13, mask: 00001FFF
[18443010C129770E00] [1.1] [1.063] [system] [info] SIPP (Signal Image Processing Pipeline) internal buffer size '18432'B, DMA buffer size: '16384'B
[18443010C129770E00] [1.1] [1.098] [system] [info] ImageManip internal buffer size '285440'B, shave buffer size '34816'B
[18443010C129770E00] [1.1] [1.098] [system] [info] NeuralNetwork allocated resources: shaves: [0-12] cmx slices: [0-12] 
ColorCamera allocated resources: no shaves; cmx slices: [13-15] 
ImageManip allocated resources: shaves: [15-15] no cmx slices. 

[18443010C129770E00] [1.1] [1.112] [DetectionNetwork(1)] [info] Needed resources: shaves: 6, ddr: 8110912 
[18443010C129770E00] [1.1] [1.120] [DetectionNetwork(1)] [info] Inference thread count: 2, number of shaves allocated per thread: 6, number of Neural Compute Engines (NCE) allocated per thread: 1
[18443010C129770E00] [1.1] [1.124] [system] [warning] PRINT:LeonCss: [1970-01-01 00:00:01.117] [info] Time taken to build the pipeline: 56ms
== FSYNC enabled for cam mask 0x0
CAM ID: 0, width: 1920, height: 1080, orientation: 0
getDefaultDtp: camType:2, color:1, orientation:0
DTP: ext_dtp_database
Loaded DTP, handle 0x83f2f2e8
== SW-SYNC: 0, cam mask 0x1
!!! Master Slave config is: single_master_slave !!!
Starting camera 0, server 0x83f2f2e8
[E] app_guzzi_command_callback():173: command->id:1
[E] app_guzzi_command_callback():193: command "1 0" sent

[18443010C129770E00] [1.1] [1.124] [system] [warning] PRINT:LeonMss: Initing ImgPreproc system!

Pre-proc Enc mem used: 69120 bytes. Available: 285440 
LRT - build pipeline call
[18443010C129770E00] [1.1] [1.146] [system] [warning] PRINT:LeonCss: [E] iq_debug_create():161: iq_debug address 0x888625c0
[18443010C129770E00] [1.1] [1.157] [system] [warning] PRINT:LeonCss: [E] hai_cm_driver_load_dtp():852: Features for camera A12N02A (imx378) are received
[E] set_dtp_ids():396: //VIV HAL: Undefined VCM DTP ID 0
[E] set_dtp_ids():405: //VIV HAL: Undefined NVM DTP ID 0
[E] set_dtp_ids():414: //VIV HAL: Undefined lights DTP ID 0
[18443010C129770E00] [1.1] [1.168] [system] [warning] PRINT:LeonCss: [E] camera_control_start():360: Camera_id = 0 started.

[E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1920x1080 at 0x0 fps min 40.000000 max 40.000000
[E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1920x1080 at 0x0 fps min 40.000000 max 40.000000
============================ Configuring IMX378 with mode 0
[18443010C129770E00] [1.1] [1.190] [system] [warning] PRINT:LeonCss: ========== IMX378 /dev/i2c.Camera_0_sen, FSIN enable 0, output 0
[E] vpipe_conv_config():1465: Exit Ok
[18443010C129770E00] [1.1] [1.201] [system] [warning] PRINT:LeonCss: [E] callback():133: Camera CB START_DONE event.
inc_camera_process set exposure and gain
[18443010C129770E00] [1.1] [1.212] [system] [warning] PRINT:LeonCss: AF_TRIGGER on camera 0
[E] app_guzzi_command_callback():173: command->id:5
[E] camera_control_focus_trigger():604: Focus trigger succeeded camera_id = 0.

[E] app_guzzi_command_callback():218: command "5 0" sent

Starting Guzzi command handling loop...
[18443010C129770E00] [1.1] [1.212] [system] [warning] PRINT:LeonMss: MIPI DPHY 4 error, stat 0x30
[18443010C129770E00] [1.1] [1.256] [system] [warning] PRINT:LeonMss: finished sippPrePrepareLinesFreeRT
[18443010C129770E00] [1.1] [1.542] [system] [warning] PRINT:LeonCss: initial keepalive, countdown: 8
[18443010C129770E00] [1.1] [1.930] [system] [info] Memory Usage - DDR: 60.68 / 333.28 MiB, CMX: 2.39 / 2.50 MiB, LeonOS Heap: 22.24 / 82.20 MiB, LeonRT Heap: 4.34 / 40.35 MiB / NOC ddr: 970 MB/s
[18443010C129770E00] [1.1] [1.930] [system] [info] Temperatures - Average: 34.34C, CSS: 35.83C, MSS 33.93C, UPA: 33.93C, DSS: 33.69C
[18443010C129770E00] [1.1] [1.931] [system] [info] Cpu Usage - LeonOS 36.43%, LeonRT: 41.35%
[18443010C129770E00] [1.1] [2.932] [system] [info] Memory Usage - DDR: 60.68 / 333.28 MiB, CMX: 2.39 / 2.50 MiB, LeonOS Heap: 22.24 / 82.20 MiB, LeonRT Heap: 4.38 / 40.35 MiB / NOC ddr: 3274 MB/s
[18443010C129770E00] [1.1] [2.932] [system] [info] Temperatures - Average: 35.35C, CSS: 36.77C, MSS 35.35C, UPA: 34.64C, DSS: 34.64C
[18443010C129770E00] [1.1] [2.932] [system] [info] Cpu Usage - LeonOS 28.51%, LeonRT: 29.48%
/home/test/depthai-python/examples/Yolo/tiny_yolo.py:107: RuntimeWarning: invalid value encountered in cast
  return (np.clip(np.array(bbox), 0, 1) * normVals).astype(int)
[18443010C129770E00] [1.1] [1717517602.601] [host] [debug] Device about to be closed...
[18443010C129770E00] [1.1] [1717517602.607] [host] [debug] Shutdown OK
[2024-06-04 18:13:22.607] [depthai] [debug] DataOutputQueue (nn) closed
[18443010C129770E00] [1.1] [1717517602.607] [host] [debug] Log thread exception caught: Couldn't read data from stream: '__log' (X_LINK_ERROR)
[18443010C129770E00] [1.1] [1717517602.607] [host] [debug] Timesync thread exception caught: Couldn't read data from stream: '__timesync' (X_LINK_ERROR)
[2024-06-04 18:13:22.607] [depthai] [debug] DataOutputQueue (rgb) closed
[18443010C129770E00] [1.1] [1717517602.732] [host] [debug] Watchdog thread exception caught: Couldn't write data to stream: '__watchdog' (X_LINK_ERROR)
[2024-06-04 18:13:23.665] [depthai] [debug] XLinkResetRemote of linkId: (0)
[18443010C129770E00] [1.1] [1717517603.665] [host] [debug] Device closed, 1064
Traceback (most recent call last):
  File "/home/test/depthai-python/examples/Yolo/tiny_yolo.py", line 137, in <module>
    displayFrame("rgb", frame)
  File "/home/test/depthai-python/examples/Yolo/tiny_yolo.py", line 115, in displayFrame
    cv2.rectangle(frame, (bbox[0], bbox[1]), (bbox[2], bbox[3]), color, 2)
cv2.error: OpenCV(4.9.0) :-1: error: (-5:Bad argument) in function 'rectangle'
> Overload resolution failed:
>  - Can't parse 'pt2'. Sequence item with index 1 has a wrong type
>  - Can't parse 'pt2'. Sequence item with index 1 has a wrong type
>  - Can't parse 'rec'. Expected sequence length 4, got 2
>  - Can't parse 'rec'. Expected sequence length 4, got 2

I also tested the cable with another computer - same results.

Any ideas? We ordered two OAK-D, the second one is in another location and not yet tested. Do you think I should test with the other device (would have to let the colleagues send it to me) - or does this not make sense?

Thanks!

Thomas

jakaskerl

Hi ThomasH
The last log you have provided seems to indicate an OpenCV issue as well. Any chance it crashes because detections are made (objects are present on the screen), so the CV fails because it can't draw them?

Could you try pointing the camera into the table or obstructing it.

Also python3 -m pip list

Thanks,
Jaka

ThomasH

Hi @jakaskerl

Sorry for not replying earlier. I made a test: The Yolo example crashed also without detections / obtructed camera after a few secs:

Using Tiny YoloV4 model. If you wish to use Tiny YOLOv3, call 'tiny_yolo.py yolo3'
[18443010C129770E00] [1.4] [1719056393.149] [host] [warning] Device crashed. Crash dump saved to /tmp/depthai_HUaOvv/18443010C129770E00-depthai_crash_dump.json
Traceback (most recent call last):
  File "/home/kube/dai-test/depthai-python/examples/Yolo/tiny_yolo.py", line 121, in <module>
    inRgb = qRgb.get()
            ^^^^^^^^^^
RuntimeError: Communication exception - possible device error/misconfiguration. Original message 'Couldn't read data from stream: 'rgb' (X_LINK_ERROR)'

And here the installed modules:

Package            Version
------------------ ---------
certifi            2024.6.2
charset-normalizer 3.3.2
depthai            2.26.0.0
idna               3.7
numpy              1.26.4
opencv-python      4.10.0.84
pip                24.1
PyYAML             6.0.1
requests           2.32.3
urllib3            2.2.2

Thanks!

Thomas

jakaskerl

Hi @ThomasH
Please send over the script you are using and the crash dump that is created.

Thanks,
Jaka

ThomasH

Hi @jakaskerl

I am only using the examples from the repo without modification, e.g.:
luxonis/depthai-pythonblob/main/examples/Yolo/tiny_yolo.py

I'd say 60-70% of the examples fail.

Here the crash dump for the yolo example:

{"crashReports":[{"crashedThreadId":151060481,"errorSource":"INTERNAL_ERROR_CORE","errorSourceInfo":{"assertContext":{"fileName":"","functionName":"","line":0},"errorId":30,"trapContext":{"trapAddress":0,"trapName":"","trapNumber":0}},"processor":1,"threadCallstack":[{"callStack":[{"callSite":2153609224,"calledTarget":2153625068,"context":"","framePointer":2155532928},{"callSite":2153602520,"calledTarget":2153608968,"context":"","framePointer":2155533024},{"callSite":2150558164,"calledTarget":2153602432,"context":"","framePointer":2155533160},{"callSite":2153624196,"calledTarget":0,"context":"Thread handler","framePointer":2155533272},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155533368},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155533464}],"instructionPointer":2153609224,"stackBottom":2155517176,"stackPointer":2155532928,"stackTop":2155533559,"threadId":167837697,"threadName":"CBTH","threadStatus":"WAITING_FOR_MESSAGE"},{"callStack":[{"callSite":2153595520,"calledTarget":2153625068,"context":"","framePointer":2155565368},{"callSite":2153595940,"calledTarget":2153595432,"context":"","framePointer":2155565536},{"callSite":2152733560,"calledTarget":2153595924,"context":"","framePointer":2155565632},{"callSite":2147609432,"calledTarget":2152733540,"context":"","framePointer":2155565744},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155566192},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155566288},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155566384}],"instructionPointer":2153595520,"stackBottom":2155533712,"stackPointer":2155565368,"stackTop":2155566479,"threadId":184614913,"threadName":"main","threadStatus":"UNKNOWN"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155598856},{"callSite":2149184644,"calledTarget":2153605048,"context":"","framePointer":2155598992},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155599112},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155599208},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155599304}],"instructionPointer":2153605200,"stackBottom":2155566632,"stackPointer":2155598856,"stackTop":2155599399,"threadId":184614914,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155632384},{"callSite":2150250952,"calledTarget":2153605048,"context":"","framePointer":2155632520},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155632616},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155632712},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155632808}],"instructionPointer":2153605200,"stackBottom":2155600136,"stackPointer":2155632384,"stackTop":2155632903,"threadId":184614915,"threadName":"RmtBarrThrd","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155665120},{"callSite":2150936916,"calledTarget":2153605048,"context":"","framePointer":2155665256},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2155665440},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155665536},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155665632},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155665728}],"instructionPointer":2153605200,"stackBottom":2155633056,"stackPointer":2155665120,"stackTop":2155665823,"threadId":184614916,"threadName":"","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155697752},{"callSite":2149848568,"calledTarget":2149345144,"context":"","framePointer":2155697888},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2155698360},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155698456},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155698552},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155698648}],"instructionPointer":2153605200,"stackBottom":2155665976,"stackPointer":2155697752,"stackTop":2155698743,"threadId":184614917,"threadName":"IpcPipelineBuil","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153635696,"calledTarget":2153625068,"context":"","framePointer":2155730264},{"callSite":2153635908,"calledTarget":2153635648,"context":"","framePointer":2155730360},{"callSite":2147699920,"calledTarget":2153635880,"context":"","framePointer":2155730496},{"callSite":2147701320,"calledTarget":2147699784,"context":"","framePointer":2155730624},{"callSite":2147701652,"calledTarget":2147701200,"context":"","framePointer":2155730744},{"callSite":2147701816,"calledTarget":2147701524,"context":"","framePointer":2155731184},{"callSite":2153349720,"calledTarget":0,"context":"Thread handler","framePointer":2155731280},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155731376},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155731472},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155731568}],"instructionPointer":2153635696,"stackBottom":2155698896,"stackPointer":2155730264,"stackTop":2155731663,"threadId":184614918,"threadName":"","threadStatus":"WAITING_FOR_CONDITION_VARIABLE"},{"callStack":[{"callSite":2153609224,"calledTarget":2153625068,"context":"","framePointer":2155767544},{"callSite":2153593028,"calledTarget":2153608968,"context":"","framePointer":2155767640},{"callSite":2150356572,"calledTarget":2153592876,"context":"","framePointer":2155767776},{"callSite":2150418012,"calledTarget":2150356556,"context":"","framePointer":2155767880},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155767992},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155768088},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155768184}],"instructionPointer":2153609224,"stackBottom":2155735512,"stackPointer":2155767544,"stackTop":2155768279,"threadId":184614919,"threadName":"SIPP","threadStatus":"WAITING_FOR_MESSAGE"},{"callStack":[{"callSite":2153598904,"calledTarget":2153623096,"context":"","framePointer":2155804936},{"callSite":2149210764,"calledTarget":2153598736,"context":"","framePointer":2155805072},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2155805328},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155805424},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155805520},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155805616}],"instructionPointer":2153598904,"stackBottom":2155772944,"stackPointer":2155804936,"stackTop":2155805711,"threadId":184614920,"threadName":"PlgNeuralNetwor","threadStatus":"UNKNOWN"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155846288},{"callSite":2148278036,"calledTarget":2153605048,"context":"","framePointer":2155846424},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155846544},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155846640},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155846736}],"instructionPointer":2153605200,"stackBottom":2155814064,"stackPointer":2155846288,"stackTop":2155846831,"threadId":184614921,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155879104},{"callSite":2148006620,"calledTarget":2153605048,"context":"","framePointer":2155879240},{"callSite":2148109224,"calledTarget":2148006536,"context":"","framePointer":2155879368},{"callSite":2148107784,"calledTarget":0,"context":"Thread handler","framePointer":2155879472},{"callSite":2148101476,"calledTarget":0,"context":"Thread handler","framePointer":2155879584},{"callSite":2148123728,"calledTarget":2148101444,"context":"","framePointer":2155879680},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2155879952},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155880048},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155880144},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155880240}],"instructionPointer":2153605200,"stackBottom":2155847568,"stackPointer":2155879104,"stackTop":2155880335,"threadId":184614922,"threadName":"PlgDetectionPar","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155912712},{"callSite":2148106704,"calledTarget":2153605048,"context":"","framePointer":2155912848},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155912968},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155913064},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155913160}],"instructionPointer":2153605200,"stackBottom":2155880488,"stackPointer":2155912712,"stackTop":2155913255,"threadId":184614923,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155944992},{"callSite":2148006220,"calledTarget":2153605048,"context":"","framePointer":2155945128},{"callSite":2148034028,"calledTarget":2148006136,"context":"","framePointer":2155945256},{"callSite":2148049104,"calledTarget":0,"context":"Thread handler","framePointer":2155945360},{"callSite":2148033232,"calledTarget":0,"context":"Thread handler","framePointer":2155945472},{"callSite":2150292152,"calledTarget":2148033200,"context":"","framePointer":2155945568},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2155945792},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155945888},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155945984},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155946080}],"instructionPointer":2153605200,"stackBottom":2155913408,"stackPointer":2155944992,"stackTop":2155946175,"threadId":184614924,"threadName":"PlgSrcMipi","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2155978552},{"callSite":2148052928,"calledTarget":2153605048,"context":"","framePointer":2155978688},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2155978808},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2155978904},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2155979000}],"instructionPointer":2153605200,"stackBottom":2155946328,"stackPointer":2155978552,"stackTop":2155979095,"threadId":184614925,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156010904},{"callSite":2148006120,"calledTarget":2153605048,"context":"","framePointer":2156011040},{"callSite":2148031864,"calledTarget":2148006036,"context":"","framePointer":2156011168},{"callSite":2148025504,"calledTarget":0,"context":"Thread handler","framePointer":2156011272},{"callSite":2148018312,"calledTarget":0,"context":"Thread handler","framePointer":2156011384},{"callSite":2150275040,"calledTarget":2148018280,"context":"","framePointer":2156011480},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156011632},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156011728},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156011824},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156011920}],"instructionPointer":2153605200,"stackBottom":2155979248,"stackPointer":2156010904,"stackTop":2156012015,"threadId":184614926,"threadName":"PlgIspCtrl","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156043648},{"callSite":2148006220,"calledTarget":2153605048,"context":"","framePointer":2156043784},{"callSite":2148071524,"calledTarget":2148006136,"context":"","framePointer":2156043912},{"callSite":2148048840,"calledTarget":0,"context":"Thread handler","framePointer":2156044024},{"callSite":2148032952,"calledTarget":0,"context":"Thread handler","framePointer":2156044136},{"callSite":2150271736,"calledTarget":2148032920,"context":"","framePointer":2156044232},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156044552},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156044648},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156044744},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156044840}],"instructionPointer":2153605200,"stackBottom":2156012168,"stackPointer":2156043648,"stackTop":2156044935,"threadId":184614927,"threadName":"PlgColorIsp1xPo","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156077312},{"callSite":2148052928,"calledTarget":2153605048,"context":"","framePointer":2156077448},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156077568},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156077664},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156077760}],"instructionPointer":2153605200,"stackBottom":2156045088,"stackPointer":2156077312,"stackTop":2156077855,"threadId":184614928,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156118368},{"callSite":2148072348,"calledTarget":2153605048,"context":"","framePointer":2156118504},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156118720},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156118816},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156118912},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156119008}],"instructionPointer":2153605200,"stackBottom":2156086336,"stackPointer":2156118368,"stackTop":2156119103,"threadId":184614929,"threadName":"RmtI","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156151304},{"callSite":2148006220,"calledTarget":2153605048,"context":"","framePointer":2156151440},{"callSite":2148034028,"calledTarget":2148006136,"context":"","framePointer":2156151568},{"callSite":2148049104,"calledTarget":0,"context":"Thread handler","framePointer":2156151672},{"callSite":2148033232,"calledTarget":0,"context":"Thread handler","framePointer":2156151784},{"callSite":2148039528,"calledTarget":2148033200,"context":"","framePointer":2156151880},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156152224},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156152320},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156152416},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156152512}],"instructionPointer":2153605200,"stackBottom":2156119840,"stackPointer":2156151304,"stackTop":2156152607,"threadId":184614930,"threadName":"RmtO","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156184568},{"callSite":2150250696,"calledTarget":2153605048,"context":"","framePointer":2156184704},{"callSite":2148039624,"calledTarget":2150250372,"context":"","framePointer":2156184800},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156185144},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156185240},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156185336},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156185432}],"instructionPointer":2153605200,"stackBottom":2156152760,"stackPointer":2156184568,"stackTop":2156185527,"threadId":184614931,"threadName":"CRmO","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156216960},{"callSite":2148006120,"calledTarget":2153605048,"context":"","framePointer":2156217096},{"callSite":2148031864,"calledTarget":2148006036,"context":"","framePointer":2156217224},{"callSite":2148053304,"calledTarget":0,"context":"Thread handler","framePointer":2156217328},{"callSite":2148034376,"calledTarget":0,"context":"Thread handler","framePointer":2156217424},{"callSite":2148033136,"calledTarget":0,"context":"Thread handler","framePointer":2156217536},{"callSite":2150349076,"calledTarget":2148033104,"context":"","framePointer":2156217632},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156218064},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156218160},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156218256},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156218352}],"instructionPointer":2153605200,"stackBottom":2156185680,"stackPointer":2156216960,"stackTop":2156218447,"threadId":184614932,"threadName":"PlgPpEnc","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156250824},{"callSite":2148052928,"calledTarget":2153605048,"context":"","framePointer":2156250960},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156251080},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156251176},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156251272}],"instructionPointer":2153605200,"stackBottom":2156218600,"stackPointer":2156250824,"stackTop":2156251367,"threadId":184614933,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156283744},{"callSite":2148052928,"calledTarget":2153605048,"context":"","framePointer":2156283880},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156284000},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156284096},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156284192}],"instructionPointer":2153605200,"stackBottom":2156251520,"stackPointer":2156283744,"stackTop":2156284287,"threadId":184614934,"threadName":"rmtPool","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153594224,"calledTarget":2153625068,"context":"","framePointer":2156316184},{"callSite":2153594584,"calledTarget":2153594176,"context":"","framePointer":2156316280},{"callSite":2150250476,"calledTarget":2153594152,"context":"","framePointer":2156316416},{"callSite":2150093240,"calledTarget":2150250372,"context":"","framePointer":2156316512},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156316824},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156316920},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156317016},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156317112}],"instructionPointer":2153594224,"stackBottom":2156284440,"stackPointer":2156316184,"stackTop":2156317207,"threadId":184614935,"threadName":"RmtO","threadStatus":"WAITING_FOR_MUTEX"},{"callStack":[{"callSite":2153594224,"calledTarget":2153625068,"context":"","framePointer":2156349104},{"callSite":2153594584,"calledTarget":2153594176,"context":"","framePointer":2156349200},{"callSite":2150250476,"calledTarget":2153594152,"context":"","framePointer":2156349336},{"callSite":2150090912,"calledTarget":2150250372,"context":"","framePointer":2156349432},{"callSite":2150251772,"calledTarget":0,"context":"Thread handler","framePointer":2156349744},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156349840},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156349936},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156350032}],"instructionPointer":2153594224,"stackBottom":2156317360,"stackPointer":2156349104,"stackTop":2156350127,"threadId":184614936,"threadName":"RmtO","threadStatus":"WAITING_FOR_MUTEX"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156390536},{"callSite":2149214992,"calledTarget":2149043120,"context":"","framePointer":2156390672},{"callSite":2149218548,"calledTarget":2149213872,"context":"","framePointer":2156391024},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156391120},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156391216},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156391312}],"instructionPointer":2153605200,"stackBottom":2156358640,"stackPointer":2156390536,"stackTop":2156391407,"threadId":184614937,"threadName":"NeuralNetworkIn","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153636204,"calledTarget":2153625068,"context":"","framePointer":2156424040},{"callSite":2149214948,"calledTarget":2153636112,"context":"","framePointer":2156424176},{"callSite":2149218548,"calledTarget":2149213872,"context":"","framePointer":2156424528},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156424624},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156424720},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156424816}],"instructionPointer":2153636204,"stackBottom":2156392144,"stackPointer":2156424040,"stackTop":2156424911,"threadId":184614938,"threadName":"NeuralNetworkIn","threadStatus":"WAITING_FOR_MUTEX"},{"callStack":[{"callSite":2153605200,"calledTarget":2153625068,"context":"","framePointer":2156458496},{"callSite":2148006120,"calledTarget":2153605048,"context":"","framePointer":2156458632},{"callSite":2148031864,"calledTarget":2148006036,"context":"","framePointer":2156458760},{"callSite":2148053304,"calledTarget":0,"context":"Thread handler","framePointer":2156458864},{"callSite":2150285508,"calledTarget":0,"context":"Thread handler","framePointer":2156458960},{"callSite":2150285748,"calledTarget":2150285132,"context":"","framePointer":2156459120},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156459216},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156459312},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156459408}],"instructionPointer":2153605200,"stackBottom":2156426736,"stackPointer":2156458496,"stackTop":2156459503,"threadId":184614939,"threadName":"PlgSrcMipi","threadStatus":"WAITING_FOR_SEMAPHORE"},{"callStack":[{"callSite":2153609224,"calledTarget":2153625068,"context":"","framePointer":2156491584},{"callSite":2153593028,"calledTarget":2153608968,"context":"","framePointer":2156491680},{"callSite":2150286868,"calledTarget":2153592876,"context":"","framePointer":2156491816},{"callSite":2150288632,"calledTarget":2150286740,"context":"","framePointer":2156492040},{"callSite":2153624220,"calledTarget":0,"context":"Thread handler","framePointer":2156492136},{"callSite":1881162860,"calledTarget":0,"context":"Thread handler","framePointer":2156492232},{"callSite":1881162764,"calledTarget":0,"context":"Thread exit","framePointer":2156492328}],"instructionPointer":2153609224,"stackBottom":2156459656,"stackPointer":2156491584,"stackTop":2156492423,"threadId":184614940,"threadName":"PlgSrcMipi","threadStatus":"WAITING_FOR_MESSAGE"}]}],"depthaiCommitHash":"24a3b465b979de3f69410cd225914d8bd029f3ba","deviceId":"18443010C129770E00"}

Thanks!

Thomas

jakaskerl

Hi @ThomasH
I've forwarded the crash dump to our FW devs, so they can take a look at it.

I'll notify you once we have a resolution.

Thanks,
Jaka