OakD Pro W (USB) - RGB camera access causes Fatal Failure

Jen

Hi,

I am having issues with the RGB camera. No matter what I try, I always get:

[18443010F1DEA90F00] [1.8] [2.454] [system] [critical] Fatal error. Please report to developers. 
Log: 'Fatal error on MSS CPU: trap: 00, address: 00000000' '0

I am using the USB3 cable that comes with the camera. I have tried

different machines (all on Ubuntu 20.04) and USB ports, all USB3 (I also tried an USB2 cable and forcing HIGH speed only)
the demo app as described in the "First steps" guide
the ROS examples on noetic
python code installed with pip3 install depthai (dependencies were installed with instructions as in the depthai repo
built depthai-python (from the repo) from source (also tried the develop branch) and ran the tests as described on the repo. All tests that seem to be related to the RGB camera failed (summary of tests below), I did see the Mono camera and depth images flash up in between, so it's not like the camera is dead or has connection issues.
with the library built from source in depthai-python I also ran this code, which fails with the same message below:

#/usr/bin/env python3

import cv2  # opencv - display the video stream
import depthai  # depthai - access the camera and its data packets

pipeline = depthai.Pipeline()
cam_rgb = pipeline.create(depthai.node.ColorCamera)

xout_rgb = pipeline.create(depthai.node.XLinkOut)
xout_rgb.setStreamName("rgb")
cam_rgb.preview.link(xout_rgb.input)

with depthai.Device(pipeline) as device:
  q_rgb = device.getOutputQueue("rgb")
  frame = None
  detections = []

  while True:
    in_rgb = q_rgb.tryGet()
    if in_rgb is not None:
      frame = in_rgb.getCvFrame()

    if frame is not None:
      cv2.imshow("preview", frame)

    if cv2.waitKey(1) == ord('q'):
        break

This fails with the same error:

[18443010F1DEA90F00] [1.8] [2.443] [system] [critical] Fatal error. Please report to developers. Log: 'Fatal error on MSS CPU: trap: 00, address: 00000000' '0'
Traceback (most recent call last):
  File "test.py", line 19, in <module>
    in_rgb = q_rgb.tryGet()
RuntimeError: Communication exception - possible device error/misconfiguration. Original message 'Couldn't read data from stream: 'rgb' (X_LINK_ERROR)'

If I replace ColorCamera by Camera, instead I get

    with depthai.Device(pipeline) as device:
RuntimeError: Camera(0) - 'video' width or height (-1, -1) must be bigger than (32, 32)

which is what I also get if I run examples/Camera/camera_preview.py from the repo.

I hope someone here can help me to resolve what's going on. Let me know if you want me to test anything specific. I figured it probably won't make a difference to test with depthai-core building from source and run C++ test code but I'm happy to do it if it helps the matter.

Appendix

Attaching the output of python3 examples/Camera/camera_isp.py

Device name: OAK-D-PRO-W
Usb speed: SUPER
Connected cameras: [{socket: CAM_A, sensorName: IMX378, width: 4056, height: 3040, orientation: AUTO, supportedTypes: [COLOR], hasAutofocus: 1, name: color}, {socket: CAM_B, sensorName: OV9282, width: 1280, height: 800, orientation: AUTO, supportedTypes: [MONO], hasAutofocus: 0, name: left}, {socket: CAM_C, sensorName: OV9282, width: 1280, height: 800, orientation: AUTO, supportedTypes: [MONO], hasAutofocus: 0, name: right}]
{socket: CAM_A, sensorName: IMX378, width: 4056, height: 3040, orientation: AUTO, supportedTypes: [COLOR], hasAutofocus: 1, name: color} CameraBoardSocket.CAM_A CameraBoardSocket.CAM_A
{socket: CAM_B, sensorName: OV9282, width: 1280, height: 800, orientation: AUTO, supportedTypes: [MONO], hasAutofocus: 0, name: left} CameraBoardSocket.CAM_B CameraBoardSocket.CAM_B
{socket: CAM_C, sensorName: OV9282, width: 1280, height: 800, orientation: AUTO, supportedTypes: [MONO], hasAutofocus: 0, name: right} CameraBoardSocket.CAM_C CameraBoardSocket.CAM_C
[18443010F1DEA90F00] [1.8] [2.397] [system] [critical] Fatal error. Please report to developers. Log: 'Fatal error on MSS CPU: trap: 00, address: 00000000' '0'

Failed python tests

	  4 - py_calibration_reader (Failed)
	  5 - py_autoexposure_roi (Failed)
	  6 - py_rgb_camera_control (Failed)
	  7 - py_rgb_preview (Failed)
	  8 - py_rgb_scene (Failed)
	  9 - py_rgb_video (Failed)
	 10 - py_rgb_isp_scale (Failed)
	 11 - py_edge_detector (Failed)
	 13 - py_feature_tracker_color (Failed)
	 15 - py_device_queue_event (Failed)
	 16 - py_opencv_support (Failed)
	 17 - py_queue_add_callback (Failed)
	 18 - py_image_manip_rotate (Failed)
	 19 - py_image_manip_tiling (Failed)
	 20 - py_rgb_rotate_warp (Failed)
	 21 - py_image_manip_warp_mesh (Failed)
	 22 - py_crop_input_chunck_oom (Failed)
	 24 - py_imu_rotation_vector (Failed)
	 26 - py_rgb_encoding_mobilenet (Failed)
	 27 - py_rgb_encoding_mono_mobilenet (Failed)
	 28 - py_rgb_encoding_mono_mobilenet_depth (Failed)
	 30 - py_rgb_mobilenet_4k (Failed)
	 31 - py_rgb_mobilenet (Failed)
	 33 - py_mono_preview (Failed)
	 35 - py_mono_camera_control (Failed)
	 37 - py_object_tracker (Failed)
	 38 - py_spatial_object_tracker (Failed)
	 39 - py_script_camera_control (Failed)
	 42 - py_spatial_tiny_yolo_v3 (Failed)
	 43 - py_spatial_tiny_yolo_v4 (Failed)
	 44 - py_spatial_mobilenet (Failed)
	 45 - py_spatial_mobilenet_mono (Failed)
	 46 - py_spatial_location_calculator (Failed)
	 48 - py_depth_preview (Failed)
	 50 - py_rgb_depth_aligned (Failed)
	 51 - py_rgb_depth_confidence_aligned (Failed)
	 52 - py_stereo_depth_from_host (Failed)
	 54 - py_system_information (Failed)
	 55 - py_encoding_max_limit (Failed)
	 56 - py_rgb_encoding (Failed)
	 57 - py_rgb_full_resolution_saver (Failed)
	 58 - py_rgb_mono_encoding (Failed)
	 59 - py_tiny_yolo_v3_device_side_decoding (Failed)
	 60 - py_tiny_yolo_v4_device_side_decoding (Failed)
	 62 - py_apriltag_rgb (Failed)

Jen

In case it helps, here the output from the test, it can only be seen that the beginning of the "critical" message is messing with the tests, so i highly suspect the very same issue.

Test project /home/jenny/code/depthai-python/build
      Start  1: install_requirements
 1/62 Test  #1: install_requirements ...................   Passed    2.02 sec
      Start  2: py_bootloader_version
 2/62 Test  #2: py_bootloader_version ..................   Passed    2.63 sec
      Start  3: py_calibration_load
 3/62 Test  #3: py_calibration_load ....................   Passed   10.06 sec
      Start  4: py_calibration_reader
 4/62 Test  #4: py_calibration_reader ..................***Failed    4.22 sec
      Start  5: py_autoexposure_roi
 5/62 Test  #5: py_autoexposure_roi ....................***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.66 sec
      Start  6: py_rgb_camera_control
 6/62 Test  #6: py_rgb_camera_control ..................***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.06 sec
      Start  7: py_rgb_preview
 7/62 Test  #7: py_rgb_preview .........................***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.05 sec
      Start  8: py_rgb_scene
 8/62 Test  #8: py_rgb_scene ...........................***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.06 sec
      Start  9: py_rgb_video
 9/62 Test  #9: py_rgb_video ...........................***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.06 sec
      Start 10: py_rgb_isp_scale
10/62 Test #10: py_rgb_isp_scale .......................***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.05 sec
      Start 11: py_edge_detector
11/62 Test #11: py_edge_detector .......................***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.06 sec
      Start 12: py_feature_tracker
12/62 Test #12: py_feature_tracker .....................   Passed   10.03 sec
      Start 13: py_feature_tracker_color
13/62 Test #13: py_feature_tracker_color ...............***Failed    4.19 sec
      Start 14: py_feature_detector
14/62 Test #14: py_feature_detector ....................   Passed   10.03 sec
      Start 15: py_device_queue_event
15/62 Test #15: py_device_queue_event ..................***Failed    4.19 sec
      Start 16: py_opencv_support
16/62 Test #16: py_opencv_support ......................***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.05 sec
      Start 17: py_queue_add_callback
17/62 Test #17: py_queue_add_callback ..................***Failed  Error regular expression found in output. Regex=[\[critical\]] 10.04 sec
      Start 18: py_image_manip_rotate
18/62 Test #18: py_image_manip_rotate ..................***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.06 sec
      Start 19: py_image_manip_tiling
19/62 Test #19: py_image_manip_tiling ..................***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.05 sec
      Start 20: py_rgb_rotate_warp
20/62 Test #20: py_rgb_rotate_warp .....................***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.07 sec
      Start 21: py_image_manip_warp_mesh
21/62 Test #21: py_image_manip_warp_mesh ...............***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.06 sec
      Start 22: py_crop_input_chunck_oom
22/62 Test #22: py_crop_input_chunck_oom ...............***Failed    0.03 sec
      Start 23: py_imu_gyroscope_accelerometer
23/62 Test #23: py_imu_gyroscope_accelerometer .........   Passed   10.02 sec
      Start 24: py_imu_rotation_vector
24/62 Test #24: py_imu_rotation_vector .................***Failed    4.26 sec
      Start 25: py_mono_depth_mobilenetssd
25/62 Test #25: py_mono_depth_mobilenetssd .............   Passed   10.03 sec
      Start 26: py_rgb_encoding_mobilenet
26/62 Test #26: py_rgb_encoding_mobilenet ..............***Failed    4.81 sec
      Start 27: py_rgb_encoding_mono_mobilenet
27/62 Test #27: py_rgb_encoding_mono_mobilenet .........***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.69 sec
      Start 28: py_rgb_encoding_mono_mobilenet_depth
28/62 Test #28: py_rgb_encoding_mono_mobilenet_depth ...***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.63 sec
      Start 29: py_mono_mobilenet
29/62 Test #29: py_mono_mobilenet ......................   Passed   10.03 sec
      Start 30: py_rgb_mobilenet_4k
30/62 Test #30: py_rgb_mobilenet_4k ....................***Failed    4.82 sec
      Start 31: py_rgb_mobilenet
31/62 Test #31: py_rgb_mobilenet .......................***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.67 sec
      Start 32: py_video_mobilenet
32/62 Test #32: py_video_mobilenet .....................   Passed   10.03 sec
      Start 33: py_mono_preview
33/62 Test #33: py_mono_preview ........................***Failed  Error regular expression found in output. Regex=[\[warning\]]  3.70 sec
      Start 34: py_mono_full_resolution_saver
34/62 Test #34: py_mono_full_resolution_saver ..........   Passed   10.04 sec
      Start 35: py_mono_camera_control
35/62 Test #35: py_mono_camera_control .................***Failed    4.24 sec
      Start 36: py_object_tracker_video
36/62 Test #36: py_object_tracker_video ................   Passed   10.03 sec
      Start 37: py_object_tracker
37/62 Test #37: py_object_tracker ......................***Failed  Error regular expression found in output. Regex=[\[critical\]] 10.04 sec
      Start 38: py_spatial_object_tracker
38/62 Test #38: py_spatial_object_tracker ..............***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.69 sec
      Start 39: py_script_camera_control
39/62 Test #39: py_script_camera_control ...............***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.05 sec
      Start 40: py_script_json_communication
40/62 Test #40: py_script_json_communication ...........   Passed    4.30 sec
      Start 41: py_script_get_device_info
41/62 Test #41: py_script_get_device_info ..............   Passed    4.05 sec
      Start 42: py_spatial_tiny_yolo_v3
42/62 Test #42: py_spatial_tiny_yolo_v3 ................***Failed  Error regular expression found in output. Regex=[\[warning\]]  7.79 sec
      Start 43: py_spatial_tiny_yolo_v4
43/62 Test #43: py_spatial_tiny_yolo_v4 ................***Failed  Error regular expression found in output. Regex=[\[warning\]]  7.53 sec
      Start 44: py_spatial_mobilenet
44/62 Test #44: py_spatial_mobilenet ...................***Failed  Error regular expression found in output. Regex=[\[warning\]]  7.65 sec
      Start 45: py_spatial_mobilenet_mono
45/62 Test #45: py_spatial_mobilenet_mono ..............***Failed  Error regular expression found in output. Regex=[\[warning\]] 10.04 sec
      Start 46: py_spatial_location_calculator
46/62 Test #46: py_spatial_location_calculator .........***Failed  Error regular expression found in output. Regex=[\[warning\]]  3.70 sec
      Start 47: py_depth_crop_control
47/62 Test #47: py_depth_crop_control ..................   Passed   10.06 sec
      Start 48: py_depth_preview
48/62 Test #48: py_depth_preview .......................***Failed    4.19 sec
      Start 49: py_depth_post_processing
49/62 Test #49: py_depth_post_processing ...............   Passed   10.04 sec
      Start 50: py_rgb_depth_aligned
50/62 Test #50: py_rgb_depth_aligned ...................***Failed    4.26 sec
      Start 51: py_rgb_depth_confidence_aligned
51/62 Test #51: py_rgb_depth_confidence_aligned ........***Failed  Error regular expression found in output. Regex=[\[critical\]] 10.04 sec
      Start 52: py_stereo_depth_from_host
52/62 Test #52: py_stereo_depth_from_host ..............***Failed    4.11 sec
      Start 53: py_stereo_depth_video
53/62 Test #53: py_stereo_depth_video ..................   Passed   10.06 sec
      Start 54: py_system_information
54/62 Test #54: py_system_information ..................***Failed    4.20 sec
      Start 55: py_encoding_max_limit
55/62 Test #55: py_encoding_max_limit ..................***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.01 sec
      Start 56: py_rgb_encoding
56/62 Test #56: py_rgb_encoding ........................***Failed  Error regular expression found in output. Regex=[\[critical\]]  6.96 sec
      Start 57: py_rgb_full_resolution_saver
57/62 Test #57: py_rgb_full_resolution_saver ...........***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.06 sec
      Start 58: py_rgb_mono_encoding
58/62 Test #58: py_rgb_mono_encoding ...................***Failed  Error regular expression found in output. Regex=[\[critical\]]  6.95 sec
      Start 59: py_tiny_yolo_v3_device_side_decoding
59/62 Test #59: py_tiny_yolo_v3_device_side_decoding ...***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.76 sec
      Start 60: py_tiny_yolo_v4_device_side_decoding
60/62 Test #60: py_tiny_yolo_v4_device_side_decoding ...***Failed  Error regular expression found in output. Regex=[\[critical\]]  7.52 sec
      Start 61: py_apriltag
61/62 Test #61: py_apriltag ............................   Passed   10.05 sec
      Start 62: py_apriltag_rgb
62/62 Test #62: py_apriltag_rgb ........................***Failed    4.20 sec

erik

Hi Jen ,
Could you try running this script with python cam_test.py -rs and pasting the terminal output, please?

Jen

Hi Erik,

thanks for the quick response. Here is what I get (same error message within):

python3 utilities/cam_test.py -rs
Enabled cameras:
    rgb : color
   left : mono
  right : mono
   camd : color
DepthAI version: 2.22.0.0.dev+4ca265ede16f8ce53ce05e98999e7cbd624c8df1
DepthAI path: /home/jenny/code/depthai-python/build/lib.linux-x86_64-cpython-38/depthai.cpython-38-x86_64-linux-gnu.so
utilities/cam_test.py:296: DeprecationWarning: Use constructor taking 'UsbSpeed' instead
  with dai.Device(*dai_device_args) as device:
[18443010F1DEA90F00] [1.8] [1.009] [ColorCamera(9)] [error] Camera not detected on socket: 3
Connected cameras:
 -socket CAM_A : IMX378 4056 x 3040 focus:auto  - COLOR
 -socket CAM_B : OV9282 1280 x  800 focus:fixed - MONO
 -socket CAM_C : OV9282 1280 x  800 focus:fixed - MONO
USB speed: SUPER
IR drivers: [('LM3644', 2, 99)]
Cam:      rgb           left          right         camd     [host | capture timestamp]
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 [18443010F1DEA90F00] [1.8] [2.462] [system] [critical] Fatal error. Please report to developers. Log: 'Fatal error on MSS CPU: trap: 00, address: 00000000' '0'
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 Communication exception - possible device error/misconfiguration. Original message 'Couldn't read data from stream: 'rgb' (X_LINK_ERROR)'
Exiting cleanly

Jen

In case it helps, here again with DEPTHAI_DEBUG=1

[2023-07-31 15:22:04.972] [depthai] [info] DEPTHAI_DEBUG enabled, lowered DEPTHAI_LEVEL to 'debug'
[2023-07-31 15:22:04.972] [depthai] [debug] Python bindings - version: 2.22.0.0.dev+4ca265ede16f8ce53ce05e98999e7cbd624c8df1 from 2023-07-26 12:21:56 +0200 build: 2023-07-31 09:36:31 +0000
[2023-07-31 15:22:04.972] [depthai] [debug] Library information - version: 2.22.0, commit: c7f3076abb1ebdbb1abf0ca34c14361635c703cf from 2023-07-06 15:35:26 +0300, build: 2023-07-31 09:36:29 +0000
[2023-07-31 15:22:04.973] [depthai] [debug] Initialize - finished
[2023-07-31 15:22:05.031] [depthai] [debug] Resources - Archive 'depthai-bootloader-fwp-0.0.26.tar.xz' open: 1ms, archive read: 52ms
[2023-07-31 15:22:05.268] [depthai] [debug] Resources - Archive 'depthai-device-fwp-f8866caab491a1c327762c1b2969098453abd90f.tar.xz' open: 1ms, archive read: 288ms
[2023-07-31 15:22:06.253] [depthai] [debug] Searching for booted device: DeviceInfo(name=1.8, mxid=18443010F1DEA90F00, X_LINK_BOOTED, X_LINK_USB_VSC, X_LINK_MYRIAD_X, X_LINK_SUCCESS), name used as hint only
[18443010F1DEA90F00] [1.8] [0.927] [system] [warning] [32mPRINT:LeonCss:[0m BootloaderConfig.options1 checksum doesn't match. Is: 0x10304418 should be: 0x5E7D3A77
BootloaderConfig.options2 checksum doesn't match. Is: 0x00000000 should be: 0x2380F205
GPIO boot mode 0x3, interface SPI_MASTER_EFF
Setting aons(0..4) back to boot from flash (offset = 0)
====ENABLE WATCHDOG====1
initial keepalive, countdown: 10
PLL0: 700000 AUX_IO0: 24000 AUX_IO1: 24000 MCFG: 24000 MECFG: 24000
Board init ret 3
DepthAI Firmware - version: f8866caab491a1c327762c1b2969098453abd90f
eeprom configuration version: 55AA0007
Reading VERSION 7 --- ->
eeprom configuration load from user area, status: 0
Reading VERSION 7 --- ->
PMIC read  reg 0x19, val 0xb8
PMIC read  reg 0x23, val 0x10
PMIC read  reg 0x31, val 0x08
PMIC read  reg 0x33, val 0x28
Found a device/board entry matching the eeprom data - Board: OAK-D S2/Pro (R6 - generic) Device: 
Board options: 00000004
--> brdInit ...
brdInitAuxDevices: Error: SC = 27: io_initialize expander_cam_gpios_1 [OK]

spi_N25Q_init: Flash JEDEC ID: c2 25 3a
SR CR: 40 07
QUAD mode already enabled. Dummy cfg: 0x00
Initialized pin: 56, mode: 7, level: 1, pad: 0x00000010
inited hal ---
def: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
val: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
Opening bus for IR driver: 1
Failed to probe IR driver LM3644
Opening bus for IR driver: 2
LM3644 detected, ID = 0x02
===== IR write bus 2: 0x07 = 0x89
===== IR write bus 2: 0x02 = 0x01
===== IR write bus 2: 0x03 = 0x00
===== IR write bus 2: 0x04 = 0x00
===== IR write bus 2: 0x05 = 0x00
===== IR write bus 2: 0x06 = 0x00
===== IR write bus 2: 0x07 = 0x09
===== IR write bus 2: 0x08 = 0x1a
===== IR write bus 2: 0x09 = 0x08
===== IR write bus 2: 0x01 = 0x24
Opening bus for IR driver: 3
Failed to probe IR driver LM3644
Closing EEPROm!
MyriaX board configuration
pll0 frequency: 700000, ref0 frequency: 24000
Is booted from flash by bootloader: 0
Networking not available...
=== Enumerating on socket: Cam_A / RGB / Center
        skipped OV7251
        skipped AR0234
        skipped S5K33D
  >> Registered camera A12N02A (imx378) as /dev/Camera_0
camera socket: 0, name: color
        config - w: 1920, h: 1080, type: COLOR
        config - w: 3840, h: 2160, type: COLOR
        config - w: 4056, h: 3040, type: COLOR
Adding socket 0: cam 2. Sen name: IMX378
=== Enumerating on socket: Cam_B / Left
  >> Registered camera TG161B (ov9282) as /dev/Camera_1
camera socket: 1, name: left
        config - w: 1280, h: 720, type: MONO
        config - w: 1280, h: 720, type: COLOR
        config - w: 1280, h: 800, type: MONO
        config - w: 1280, h: 800, type: COLOR
Adding socket 1: cam 5. Sen name: OV9282
=== Enumerating on socket: Cam_C / Right
  >> Registered camera TG161B (ov9282) as /dev/Camera_2
camera socket: 2, name: right
        config - w: 1280, h: 720, type: MONO
        config - w: 1280, h: 720, type: COLOR
        config - w: 1280, h: 800, type: MONO
        config - w: 1280, h: 800, type: COLOR
Adding socket 2: cam 5. Sen name: OV9282
Found a device/board entry matching the eeprom data - Board: OAK-D S2/Pro (R6 - generic) Device: 
Initializing XLink...
UsbPumpVscAppI_Event: 5 VSC2_EVENT_ATTACH
UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
initial keepalive, countdown: 9
UsbPumpVscAppI_Event: 0 VSC2_EVENT_INTERFACE_UP
Done!
Usb connection speed: Super - USB 3.0
[18443010F1DEA90F00] [1.8] [1690809727.201] [host] [debug] Schema dump: {"connections":[{"node1Id":0,"node1Output":"out","node1OutputGroup":"","node2Id":9,"node2Input":"inputControl","node2InputGroup":""},{"node1Id":9,"node1Output":"isp","node1OutputGroup":"","node2Id":8,"node2Input":"in","node2InputGroup":""},{"node1Id":0,"node1Output":"out","node1OutputGroup":"","node2Id":7,"node2Input":"inputControl","node2InputGroup":""},{"node1Id":7,"node1Output":"out","node1OutputGroup":"","node2Id":6,"node2Input":"in","node2InputGroup":""},{"node1Id":0,"node1Output":"out","node1OutputGroup":"","node2Id":5,"node2Input":"inputControl","node2InputGroup":""},{"node1Id":5,"node1Output":"out","node1OutputGroup":"","node2Id":4,"node2Input":"in","node2InputGroup":""},{"node1Id":0,"node1Output":"out","node1OutputGroup":"","node2Id":3,"node2Input":"inputControl","node2InputGroup":""},{"node1Id":3,"node1Output":"isp","node1OutputGroup":"","node2Id":2,"node2Input":"in","node2InputGroup":""}],"globalProperties":{"calibData":null,"cameraTuningBlobSize":null,"cameraTuningBlobUri":"","leonCssFrequencyHz":700000000.0,"leonMssFrequencyHz":700000000.0,"pipelineName":null,"pipelineVersion":null,"sippBufferSize":18432,"sippDmaBufferSize":16384,"xlinkChunkSize":-1},"nodes":[[0,{"id":0,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":30,"name":"out","queueSize":8,"type":0,"waitForMessage":false}]],"name":"XLinkIn","properties":[185,3,189,7,99,111,110,116,114,111,108,130,0,0,80,0,8]}],[1,{"id":1,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":29,"name":"out","queueSize":8,"type":0,"waitForMessage":false}]],"name":"XLinkIn","properties":[185,3,189,9,116,111,102,67,111,110,102,105,103,130,0,0,80,0,8]}],[2,{"id":2,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":28,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,3,114,103,98,0]}],[3,{"id":3,"ioInfo":[[["","video"],{"blocking":false,"group":"","id":27,"name":"video","queueSize":8,"type":0,"waitForMessage":false}],[["","still"],{"blocking":false,"group":"","id":25,"name":"still","queueSize":8,"type":0,"waitForMessage":false}],[["","isp"],{"blocking":false,"group":"","id":24,"name":"isp","queueSize":8,"type":0,"waitForMessage":false}],[["","preview"],{"blocking":false,"group":"","id":26,"name":"preview","queueSize":8,"type":0,"waitForMessage":false}],[["","raw"],{"blocking":false,"group":"","id":23,"name":"raw","queueSize":8,"type":0,"waitForMessage":false}],[["","frameEvent"],{"blocking":false,"group":"","id":22,"name":"frameEvent","queueSize":8,"type":0,"waitForMessage":false}],[["","inputConfig"],{"blocking":false,"group":"","id":21,"name":"inputConfig","queueSize":8,"type":3,"waitForMessage":false}],[["","inputControl"],{"blocking":true,"group":"","id":20,"name":"inputControl","queueSize":8,"type":3,"waitForMessage":false}]],"name":"ColorCamera","properties":[185,26,185,27,0,3,0,0,0,185,3,0,0,0,185,5,0,0,0,0,0,185,5,0,0,0,0,0,0,0,0,0,0,0,0,185,3,0,0,0,185,3,0,0,0,0,0,0,0,0,0,0,0,0,0,0,189,0,255,0,1,0,129,44,1,129,44,1,255,255,255,255,0,136,0,0,240,65,0,136,0,0,128,191,136,0,0,128,191,1,185,4,1,1,1,1,3,3,4,4,4,190]}],[4,{"id":4,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":19,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,4,108,101,102,116,0]}],[5,{"id":5,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":18,"name":"out","queueSize":8,"type":0,"waitForMessage":false}],[["","raw"],{"blocking":false,"group":"","id":17,"name":"raw","queueSize":8,"type":0,"waitForMessage":false}],[["","frameEvent"],{"blocking":false,"group":"","id":16,"name":"frameEvent","queueSize":8,"type":0,"waitForMessage":false}],[["","inputControl"],{"blocking":true,"group":"","id":15,"name":"inputControl","queueSize":8,"type":3,"waitForMessage":false}]],"name":"MonoCamera","properties":[185,10,185,27,0,3,0,0,0,185,3,0,0,0,185,5,0,0,0,0,0,185,5,0,0,0,0,0,0,0,0,0,0,0,0,185,3,0,0,0,185,3,0,0,0,0,0,0,0,0,0,0,0,0,0,1,189,0,255,1,136,0,0,240,65,0,3,3,190]}],[6,{"id":6,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":14,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,5,114,105,103,104,116,0]}],[7,{"id":7,"ioInfo":[[["","out"],{"blocking":false,"group":"","id":13,"name":"out","queueSize":8,"type":0,"waitForMessage":false}],[["","raw"],{"blocking":false,"group":"","id":12,"name":"raw","queueSize":8,"type":0,"waitForMessage":false}],[["","frameEvent"],{"blocking":false,"group":"","id":11,"name":"frameEvent","queueSize":8,"type":0,"waitForMessage":false}],[["","inputControl"],{"blocking":true,"group":"","id":10,"name":"inputControl","queueSize":8,"type":3,"waitForMessage":false}]],"name":"MonoCamera","properties":[185,10,185,27,0,3,0,0,0,185,3,0,0,0,185,5,0,0,0,0,0,185,5,0,0,0,0,0,0,0,0,0,0,0,0,185,3,0,0,0,185,3,0,0,0,0,0,0,0,0,0,0,0,0,0,2,189,0,255,1,136,0,0,240,65,0,3,3,190]}],[8,{"id":8,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":9,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,4,99,97,109,100,0]}],[9,{"id":9,"ioInfo":[[["","video"],{"blocking":false,"group":"","id":8,"name":"video","queueSize":8,"type":0,"waitForMessage":false}],[["","still"],{"blocking":false,"group":"","id":6,"name":"still","queueSize":8,"type":0,"waitForMessage":false}],[["","isp"],{"blocking":false,"group":"","id":5,"name":"isp","queueSize":8,"type":0,"waitForMessage":false}],[["","preview"],{"blocking":false,"group":"","id":7,"name":"preview","queueSize":8,"type":0,"waitForMessage":false}],[["","raw"],{"blocking":false,"group":"","id":4,"name":"raw","queueSize":8,"type":0,"waitForMessage":false}],[["","frameEvent"],{"blocking":false,"group":"","id":3,"name":"frameEvent","queueSize":8,"type":0,"waitForMessage":false}],[["","inputConfig"],{"blocking":false,"group":"","id":2,"name":"inputConfig","queueSize":8,"type":3,"waitForMessage":false}],[["","inputControl"],{"blocking":true,"group":"","id":1,"name":"inputControl","queueSize":8,"type":3,"waitForMessage":false}]],"name":"ColorCamera","properties":[185,26,185,27,0,3,0,0,0,185,3,0,0,0,185,5,0,0,0,0,0,185,5,0,0,0,0,0,0,0,0,0,0,0,0,185,3,0,0,0,185,3,0,0,0,0,0,0,0,0,0,0,0,0,0,3,189,0,255,0,1,0,129,44,1,129,44,1,255,255,255,255,0,136,0,0,240,65,0,136,0,0,128,191,136,0,0,128,191,1,185,4,1,1,1,1,3,3,4,4,4,190]}]]}
[18443010F1DEA90F00] [1.8] [1690809727.201] [host] [debug] Asset map dump: {"map":{}}
[18443010F1DEA90F00] [1.8] [0.930] [system] [info] Memory Usage - DDR: 0.12 / 337.18 MiB, CMX: 2.04 / 2.50 MiB, LeonOS Heap: 7.51 / 79.89 MiB, LeonRT Heap: 2.89 / 40.95 MiB
[18443010F1DEA90F00] [1.8] [0.930] [system] [info] Temperatures - Average: 34.82C, CSS: 35.83C, MSS 34.88C, UPA: 34.64C, DSS: 33.93C
[18443010F1DEA90F00] [1.8] [0.930] [system] [info] Cpu Usage - LeonOS 68.12%, LeonRT: 1.74%
[18443010F1DEA90F00] [1.8] [0.937] [system] [warning] [32mPRINT:LeonCss:[0m Temperature: Driver registered.
Temperature: Initialized driver.
Temperature: Sensor opened: CSS.
Temperature: Sensor opened: MSS.
Temperature: Sensor opened: UPA.
Temperature: Sensor opened: DSS.
[36mI: [Timesync] [   4541660] [XLin] startSync:130     Timesync | Callback not set[0m
[18443010F1DEA90F00] [1.8] [0.977] [ColorCamera(9)] [error] Camera not detected on socket: 3
[18443010F1DEA90F00] [1.8] [0.978] [MonoCamera(7)] [info] Using board socket: 2, id: 2
[18443010F1DEA90F00] [1.8] [0.978] [MonoCamera(5)] [info] Using board socket: 1, id: 1
[18443010F1DEA90F00] [1.8] [0.981] [system] [info] SIPP (Signal Image Processing Pipeline) internal buffer size '18432'B, DMA buffer size: '16384'B
[18443010F1DEA90F00] [1.8] [1.015] [system] [info] ColorCamera allocated resources: no shaves; cmx slices: [13-15] 
MonoCamera allocated resources: no shaves; cmx slices: [13-15] 

[18443010F1DEA90F00] [1.8] [1.025] [system] [warning] [32mPRINT:LeonCss:[0m XLinkIn | Created plgPool as shared: 1
XLinkIn | Created plgPool as shared: 1
[1970-01-01 00:00:01.024] [info] Time taken to build the pipeline: 48ms
[18443010F1DEA90F00] [1.8] [1.025] [system] [warning] [34mPRINT:LeonMss:[0m sippPalThreadCreate: Thread /SIPP created
LRT - build pipeline call
[18443010F1DEA90F00] [1.8] [1.036] [system] [warning] [32mPRINT:LeonCss:[0m == FSYNC enabled for cam mask 0x0
CAM ID: 0, width: 1920, height: 1080, orientation: 0
CAM ID: 1, width: 1280, height: 800, orientation: 0
CAM ID: 3, width: 1920, height: 1080, orientation: 0
CAM ID: 2, width: 1280, height: 800, orientation: 0
Broadcast9282: Successfully registered camera TG161B (ov9282) as /dev/Camera_bcast0
== SW-SYNC: 1, cam mask 0x7
!!! Master Slave config is: single_master_slave !!!
Starting camera 0
[91m[E] app_guzzi_command_callback():173: command->id:1[0m
[91m[E] app_guzzi_command_callback():193: command "1 0" sent
[0m
[91m[E] iq_debug_create():161: iq_debug address 0x88523f80[0m
[18443010F1DEA90F00] [1.8] [1.048] [system] [warning] [32mPRINT:LeonCss:[0m [91m[E] hai_cm_driver_load_dtp():852: Features for camera A12N02A (imx378) are received[0m
[91m[E] set_dtp_ids():396: //VIV HAL: Undefined VCM DTP ID 0[0m
[91m[E] set_dtp_ids():405: //VIV HAL: Undefined NVM DTP ID 0[0m
[91m[E] set_dtp_ids():414: //VIV HAL: Undefined lights DTP ID 0[0m
[91m[E] camera_control_start():347: Camera_id = 0 started.
[0m
[91m[E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1920x1080 at 0x0 fps min 0.000000 max 30.000000[0m
[91m[E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1920x1080 at 0x0 fps min 0.000000 max 30.000000[0m
============================ Configuring IMX378 with mode 0
[18443010F1DEA90F00] [1.8] [1.070] [system] [warning] [32mPRINT:LeonCss:[0m ========== IMX378 /dev/i2c.Camera_0_sen, FSIN enable 0, output 0
[91m[E] vpipe_conv_config():1465: Exit Ok[0m
[91m[E] callback():123: Camera CB START_DONE event.[0m
Starting camera 1
[91m[E] app_guzzi_command_callback():173: command->id:1[0m
[91m[E] app_guzzi_command_callback():193: command "1 1" sent
[0m
[18443010F1DEA90F00] [1.8] [1.080] [system] [warning] [32mPRINT:LeonCss:[0m [91m[E] iq_debug_create():161: iq_debug address 0x8806f880[0m
[91m[E] hai_cm_driver_load_dtp():852: Features for camera TG161B (ov9282) are received[0m
[91m[E] set_dtp_ids():396: //VIV HAL: Undefined VCM DTP ID 0[0m
[91m[E] set_dtp_ids():405: //VIV HAL: Undefined NVM DTP ID 0[0m
[91m[E] set_dtp_ids():414: //VIV HAL: Undefined lights DTP ID 0[0m
[18443010F1DEA90F00] [1.8] [1.091] [system] [warning] [32mPRINT:LeonCss:[0m [91m[E] camera_control_start():347: Camera_id = 1 started.
[0m
[91m[E] lens_move_to_def_pos_do():251: Error executing af_move_to_pos()![0m
[91m[E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1280x800 at 0x0 fps min 0.000000 max 30.000000[0m
[91m[E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1280x800 at 0x0 fps min 0.000000 max 30.000000[0m
=== osDrvOV9282Control: set mode for Camera_1_sen
inc_camera_process set exposure and gain
Enabled cameras:
    rgb : color
   left : mono
  right : mono
   camd : color
DepthAI version: 2.22.0.0.dev+4ca265ede16f8ce53ce05e98999e7cbd624c8df1
DepthAI path: /home/jenny/code/depthai-python/build/lib.linux-x86_64-cpython-38/depthai.cpython-38-x86_64-linux-gnu.so
Connected cameras:
 -socket CAM_A : IMX378 4056 x 3040 focus:auto  - COLOR
 -socket CAM_B : OV9282 1280 x  800 focus:fixed - MONO
 -socket CAM_C : OV9282 1280 x  800 focus:fixed - MONO
USB speed: SUPER
IR drivers: [('LM3644', 2, 99)]
Cam:      rgb           left          right         camd     [host | capture timestamp]

FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 [18443010F1DEA90F00] [1.8] [1.102] [system] [warning] [32mPRINT:LeonCss:[0m [91m[E] vpipe_conv_config():1465: Exit Ok[0m
[91m[E] callback():123: Camera CB START_DONE event.[0m
Starting camera 2
[91m[E] app_guzzi_command_callback():173: command->id:1[0m
[91m[E] app_guzzi_command_callback():193: command "1 2" sent
[0m
[18443010F1DEA90F00] [1.8] [1.113] [system] [warning] [32mPRINT:LeonCss:[0m [91m[E] iq_debug_create():161: iq_debug address 0x87beb880[0m
[91m[E] hai_cm_driver_load_dtp():852: Features for camera TG161B (ov9282) are received[0m
[91m[E] set_dtp_ids():396: //VIV HAL: Undefined VCM DTP ID 0[0m
[91m[E] set_dtp_ids():405: //VIV HAL: Undefined NVM DTP ID 0[0m
[91m[E] set_dtp_ids():414: //VIV HAL: Undefined lights DTP ID 0[0m
[18443010F1DEA90F00] [1.8] [1.124] [system] [warning] [32mPRINT:LeonCss:[0m [91m[E] camera_control_start():347: Camera_id = 2 started.
[0m
[91m[E] lens_move_to_def_pos_do():251: Error executing af_move_to_pos()![0m
[91m[E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1280x800 at 0x0 fps min 0.000000 max 30.000000[0m
[91m[E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1280x800 at 0x0 fps min 0.000000 max 30.000000[0m
=== osDrvOV9282Control: set mode for Camera_2_sen
inc_camera_process set exposure and gain

FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 [18443010F1DEA90F00] [1.8] [1.135] [system] [warning] [32mPRINT:LeonCss:[0m [91m[E] vpipe_conv_config():1465: Exit Ok[0m
[91m[E] guzzi_event_send():324: Send: Event ID=20003 no registered recipient[0m
[91m[E] guzzi_event_send():324: Send: Event ID=20004 no registered recipient[0m
[91m[E] callback():123: Camera CB START_DONE event.[0m
[18443010F1DEA90F00] [1.8] [1.147] [system] [warning] [32mPRINT:LeonCss:[0m inc_camera_process set exposure and gain
AF_TRIGGER on camera 0
[91m[E] app_guzzi_command_callback():173: command->id:5[0m
[91m[E] camera_control_focus_trigger():591: Focus trigger succeeded camera_id = 0.
[0m
[91m[E] app_guzzi_command_callback():218: command "5 0" sent
[0m
Starting Guzzi command handling loop...

FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 [18443010F1DEA90F00] [1.8] [1.179] [system] [warning] [32mPRINT:LeonCss:[0m W: 4 - 0 - 0x8858cdc0
[18443010F1DEA90F00] [1.8] [1.179] [system] [warning] [34mPRINT:LeonMss:[0m MIPI HS error on ctrl 4, err 0x840000

Fatal error INTERNAL_ERROR_CORE
Error 30 

FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
[.... a lot of these lines]
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 [18443010F1DEA90F00] [1.8] [1.542] [system] [warning] [32mPRINT:LeonCss:[0m initial keepalive, countdown: 8

FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
[.... a looooooooooooooooooooot of these lines]
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 
FPS:   0.00|  0.00   0.00|  0.00   0.00|  0.00   0.00|  0.00 [2023-07-31 15:22:10.945] [depthai] [debug] DataOutputQueue (camd) closed
[18443010F1DEA90F00] [1.8] [1690809730.945] [host] [debug] Timesync thread exception caught: Couldn't read data from stream: '__timesync' (X_LINK_ERROR)
[2023-07-31 15:22:10.946] [depthai] [debug] DataOutputQueue (rgb) closed
[18443010F1DEA90F00] [1.8] [1690809730.945] [host] [debug] Log thread exception caught: Couldn't read data from stream: '__log' (X_LINK_ERROR)
[2023-07-31 15:22:10.946] [depthai] [debug] DataOutputQueue (right) closed
[2023-07-31 15:22:10.946] [depthai] [debug] DataOutputQueue (left) closed
[18443010F1DEA90F00] [1.8] [1690809730.953] [host] [debug] Device about to be closed...
[2023-07-31 15:22:10.953] [depthai] [debug] XLinkResetRemoteTimeout returned: X_LINK_ERROR
[2023-07-31 15:22:11.478] [depthai] [debug] XLinkResetRemote of linkId: (0)
[18443010F1DEA90F00] [1.8] [1690809731.695] [host] [debug] Device closed, 741
[2023-07-31 15:22:11.695] [depthai] [debug] DataInputQueue (control) closed
[2023-07-31 15:22:11.696] [depthai] [debug] DataInputQueue (tofConfig) closed
Communication exception - possible device error/misconfiguration. Original message 'Couldn't read data from stream: 'rgb' (X_LINK_ERROR)'
Exiting cleanly

Jen

Did end up trying depthai-core and as expected get the same failures on the tests. Output of ctest -L usb --output-on-failure (only posting output of first test, which fails):

est project /home/jenny/code/depthai-core/build
      Start   1: color_camera_node_test
 1/87 Test   #1: color_camera_node_test ..............Child aborted***Exception:   9.10 sec
[2023-07-31 15:33:49.048] [depthai] [info] DEPTHAI_DEBUG enabled, lowered DEPTHAI_LEVEL to 'debug'
[2023-07-31 15:33:49.048] [depthai] [debug] Library information - version: 2.22.0, commit: 1289c3adcfd49f4a3fd8a107d173da7f54b509af from 2023-07-28 12:55:20 +0300, build: 2023-07-31 13:28:55 +0000
[2023-07-31 15:33:49.050] [depthai] [debug] Initialize - finished
[2023-07-31 15:33:49.050] [depthai] [debug] Environment 'DEPTHAI_PROTOCOL' set to 'usb'
[2023-07-31 15:33:49.106] [depthai] [debug] Resources - Archive 'depthai-bootloader-fwp-0.0.26.tar.xz' open: 2ms, archive read: 54ms
[2023-07-31 15:33:49.150] [depthai] [warning] skipping X_LINK_UNBOOTED device having name "1.8"
[2023-07-31 15:33:49.345] [depthai] [debug] Resources - Archive 'depthai-device-fwp-8d6106c43be8cf95d22ee85300a40dbd1b5617c6.tar.xz' open: 2ms, archive read: 294ms
[2023-07-31 15:33:50.251] [depthai] [warning] skipping X_LINK_UNBOOTED device having name "1.8"
[2023-07-31 15:33:51.353] [depthai] [warning] skipping X_LINK_UNBOOTED device having name "1.8"
[2023-07-31 15:33:53.343] [depthai] [debug] Searching for booted device: DeviceInfo(name=1.8, mxid=18443010F1DEA90F00, X_LINK_BOOTED, X_LINK_USB_VSC, X_LINK_MYRIAD_X, X_LINK_SUCCESS), name used as hint only
[18443010F1DEA90F00] [1.8] [0.950] [system] [warning] PRINT:LeonCss: BootloaderConfig.options1 checksum doesn't match. Is: 0x10304418 should be: 0x5E7D3A77
GPIO boot mode 0x3, interface SPI_MASTER_EFF
Setting aons(0..4) back to boot from flash (offset = 0)
====ENABLE WATCHDOG====1
initial keepalive, countdown: 10
PLL0: 700000 AUX_IO0: 24000 AUX_IO1: 24000 MCFG: 24000 MECFG: 24000
Board init ret 3
DepthAI Firmware - version: 8d6106c43be8cf95d22ee85300a40dbd1b5617c6
eeprom configuration version: 55AA0007
Reading VERSION 7 --- ->
eeprom configuration load from user area, status: 0
Reading VERSION 7 --- ->
PMIC read  reg 0x19, val 0xb8
PMIC read  reg 0x23, val 0x10
PMIC read  reg 0x31, val 0x08
PMIC read  reg 0x33, val 0x28
Found a device/board entry matching the eeprom data - Board: OAK-D S2/Pro (R6 - generic) Device: 
Board options: 00000004
--> brdInit ...
brdInitAuxDevices: Error: SC = 27: io_initialize expander_cam_gpios_1 [OK]

spi_N25Q_init: Flash JEDEC ID: c2 25 3a
SR CR: 40 07
QUAD mode already enabled. Dummy cfg: 0x00
Initialized pin: 56, mode: 7, level: 1, pad: 0x00000010
inited hal ---
def: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
val: 53 46 45 34 10 06 08 34 10 53 14 45 46 08 06
Opening bus for IR driver: 1
Failed to probe IR driver LM3644
Opening bus for IR driver: 2
LM3644 detected, ID = 0x02
===== IR write bus 2: 0x07 = 0x89
===== IR write bus 2: 0x02 = 0x01
===== IR write bus 2: 0x03 = 0x00
===== IR write bus 2: 0x04 = 0x00
===== IR write bus 2: 0x05 = 0x00
===== IR write bus 2: 0x06 = 0x00
===== IR write bus 2: 0x07 = 0x09
===== IR write bus 2: 0x08 = 0x1a
===== IR write bus 2: 0x09 = 0x08
===== IR write bus 2: 0x01 = 0x24
Opening bus for IR driver: 3
Failed to probe IR driver LM3644
Closing EEPROm!
MyriaX board configuration
pll0 frequency: 700000, ref0 frequency: 24000
Is booted from flash by bootloader: 0
Networking not available...
=== Enumerating on socket: Cam_A / RGB / Center
        skipped OV7251
        skipped AR0234
        skipped S5K33D
  >> Registered camera A12N02A (imx378) as /dev/Camera_0
camera socket: 0, name: color
        config - w: 1920, h: 1080, type: COLOR
        config - w: 3840, h: 2160, type: COLOR
        config - w: 4056, h: 3040, type: COLOR
Adding socket 0: cam 2. Sen name: IMX378
=== Enumerating on socket: Cam_B / Left
  >> Registered camera TG161B (ov9282) as /dev/Camera_1
camera socket: 1, name: left
        config - w: 1280, h: 720, type: MONO
        config - w: 1280, h: 720, type: COLOR
        config - w: 1280, h: 800, type: MONO
        config - w: 1280, h: 800, type: COLOR
Adding socket 1: cam 5. Sen name: OV9282
=== Enumerating on socket: Cam_C / Right
  >> Registered camera TG161B (ov9282) as /dev/Camera_2
camera socket: 2, name: right
        config - w: 1280, h: 720, type: MONO
        config - w: 1280, h: 720, type: COLOR
        config - w: 1280, h: 800, type: MONO
        config - w: 1280, h: 800, type: COLOR
Adding socket 2: cam 5. Sen name: OV9282
Found a device/board entry matching the eeprom data - Board: OAK-D S2/Pro (R6 - generic) Device: 
Initializing XLink...
UsbPumpVscAppI_Event: 5 VSC2_EVENT_ATTACH
UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
UsbPumpVscAppI_Event: 4 VSC2_EVENT_RESET
initial keepalive, countdown: 9
UsbPumpVscAppI_Event: 0 VSC2_EVENT_INTERFACE_UP
Done!
Usb connection speed: Super - USB 3.0
Temperature: Driver registered.
Temperature: Initialized driver.
Temperature: Sensor opened: CSS.
Temperature: Sensor opened: MSS.
Temperature: Sensor opened: UPA.
Temperature: Sensor opened: DSS.
[18443010F1DEA90F00] [1.8] [1690810434.311] [host] [debug] Schema dump: {"connections":[{"node1Id":0,"node1Output":"preview","node1OutputGroup":"","node2Id":1,"node2Input":"in","node2InputGroup":""}],"globalProperties":{"calibData":null,"cameraTuningBlobSize":null,"cameraTuningBlobUri":"","leonCssFrequencyHz":700000000.0,"leonMssFrequencyHz":700000000.0,"pipelineName":null,"pipelineVersion":null,"sippBufferSize":18432,"sippDmaBufferSize":16384,"xlinkChunkSize":-1},"nodes":[[0,{"id":0,"ioInfo":[[["","video"],{"blocking":false,"group":"","id":9,"name":"video","queueSize":8,"type":0,"waitForMessage":false}],[["","still"],{"blocking":false,"group":"","id":7,"name":"still","queueSize":8,"type":0,"waitForMessage":false}],[["","isp"],{"blocking":false,"group":"","id":6,"name":"isp","queueSize":8,"type":0,"waitForMessage":false}],[["","preview"],{"blocking":false,"group":"","id":8,"name":"preview","queueSize":8,"type":0,"waitForMessage":false}],[["","raw"],{"blocking":false,"group":"","id":5,"name":"raw","queueSize":8,"type":0,"waitForMessage":false}],[["","frameEvent"],{"blocking":false,"group":"","id":4,"name":"frameEvent","queueSize":8,"type":0,"waitForMessage":false}],[["","inputConfig"],{"blocking":false,"group":"","id":3,"name":"inputConfig","queueSize":8,"type":3,"waitForMessage":false}],[["","inputControl"],{"blocking":true,"group":"","id":2,"name":"inputControl","queueSize":8,"type":3,"waitForMessage":false}]],"name":"ColorCamera","properties":[185,26,185,27,0,3,0,0,0,185,3,0,0,0,185,5,0,0,0,0,0,185,5,0,0,0,0,0,0,0,0,0,0,0,0,185,3,0,0,0,185,3,0,0,0,0,0,0,0,0,0,0,0,0,0,255,189,0,255,0,1,0,129,128,2,129,128,2,255,255,255,255,0,136,0,0,240,65,0,136,0,0,128,191,136,0,0,128,191,1,185,4,0,0,0,0,3,3,4,4,4,190]}],[1,{"id":1,"ioInfo":[[["","in"],{"blocking":true,"group":"","id":1,"name":"in","queueSize":8,"type":3,"waitForMessage":true}]],"name":"XLinkOut","properties":[185,3,136,0,0,128,191,189,7,112,114,101,118,105,101,119,0]}]]}
[18443010F1DEA90F00] [1.8] [1690810434.311] [host] [debug] Asset map dump: {"map":{}}
[18443010F1DEA90F00] [1.8] [0.953] [system] [info] Memory Usage - DDR: 0.12 / 337.18 MiB, CMX: 2.04 / 2.50 MiB, LeonOS Heap: 7.51 / 79.89 MiB, LeonRT Heap: 2.89 / 40.95 MiB
[18443010F1DEA90F00] [1.8] [0.953] [system] [info] Temperatures - Average: 36.30C, CSS: 37.48C, MSS 35.83C, UPA: 36.06C, DSS: 35.83C
[18443010F1DEA90F00] [1.8] [0.953] [system] [info] Cpu Usage - LeonOS 72.44%, LeonRT: 1.72%
[18443010F1DEA90F00] [1.8] [0.960] [system] [warning] PRINT:LeonCss: I: [Timesync] [   5489514] [XLin] startSync:130     Timesync | Callback not set
[18443010F1DEA90F00] [1.8] [0.975] [system] [info] SIPP (Signal Image Processing Pipeline) internal buffer size '18432'B, DMA buffer size: '16384'B
[18443010F1DEA90F00] [1.8] [1.010] [system] [info] ImageManip internal buffer size '285440'B, shave buffer size '34816'B
[18443010F1DEA90F00] [1.8] [1.011] [system] [info] ColorCamera allocated resources: no shaves; cmx slices: [13-15] 
ImageManip allocated resources: shaves: [15-15] no cmx slices. 

[18443010F1DEA90F00] [1.8] [1.015] [system] [warning] PRINT:LeonCss: [1970-01-01 00:00:01.013] [info] Time taken to build the pipeline: 39ms
[18443010F1DEA90F00] [1.8] [1.015] [system] [warning] PRINT:LeonMss: sippPalThreadCreate: Thread /SIPP created
Initing ImgPreproc system!

Pre-proc Enc mem used: 69120 bytes. Available: 285440 
LRT - build pipeline call
[18443010F1DEA90F00] [1.8] [1.026] [system] [warning] PRINT:LeonCss: == FSYNC enabled for cam mask 0x0
CAM ID: 0, width: 1920, height: 1080, orientation: 0
== SW-SYNC: 0, cam mask 0x1
!!! Master Slave config is: single_master_slave !!!
Starting camera 0
[E] app_guzzi_command_callback():173: command->id:1
[E] app_guzzi_command_callback():193: command "1 0" sent

[E] iq_debug_create():161: iq_debug address 0x8857a400
[18443010F1DEA90F00] [1.8] [1.037] [system] [warning] PRINT:LeonCss: [E] hai_cm_driver_load_dtp():852: Features for camera A12N02A (imx378) are received
[E] set_dtp_ids():396: //VIV HAL: Undefined VCM DTP ID 0
[E] set_dtp_ids():405: //VIV HAL: Undefined NVM DTP ID 0
[E] set_dtp_ids():414: //VIV HAL: Undefined lights DTP ID 0
[E] camera_control_start():347: Camera_id = 0 started.

[E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1920x1080 at 0x0 fps min 0.000000 max 30.000000
[E] hai_cm_sensor_select_mode():164: No suitable sensor mode. Selecting default one - 0 for start 1920x1080 at 0x0 fps min 0.000000 max 30.000000
============================ Configuring IMX378 with mode 0
[18443010F1DEA90F00] [1.8] [1.059] [system] [warning] PRINT:LeonCss: ========== IMX378 /dev/i2c.Camera_0_sen, FSIN enable 0, output 0
[E] vpipe_conv_config():1465: Exit Ok
[E] callback():123: Camera CB START_DONE event.
inc_camera_process set exposure and gain
[18443010F1DEA90F00] [1.8] [1.070] [system] [warning] PRINT:LeonCss: AF_TRIGGER on camera 0
[E] app_guzzi_command_callback():173: command->id:5
[E] camera_control_focus_trigger():591: Focus trigger succeeded camera_id = 0.

[E] app_guzzi_command_callback():218: command "5 0" sent

Starting Guzzi command handling loop...
[18443010F1DEA90F00] [1.8] [1.092] [system] [warning] PRINT:LeonCss: W: 4 - 0 - 0x885e3240
W: Isp cfg mising: 0 
W: Mipi internal error, frame skipped: 0 
W: Isp cfg mising: 0 
W: Isp cfg mising: 0 
[18443010F1DEA90F00] [1.8] [1.092] [system] [warning] PRINT:LeonMss: MIPI HS error on ctrl 4, err 0x840000
[18443010F1DEA90F00] [1.8] [1.103] [system] [warning] PRINT:LeonCss: W: Isp cfg mising: 0 
W: Isp cfg mising: 0 
W: Isp cfg mising: 0 
[18443010F1DEA90F00] [1.8] [1.103] [system] [warning] PRINT:LeonMss: 
Fatal error INTERNAL_ERROR_CORE
Error 30 
[18443010F1DEA90F00] [1.8] [1.543] [system] [warning] PRINT:LeonCss: initial keepalive, countdown: 8
[18443010F1DEA90F00] [1.8] [2.452] [system] [critical] Fatal error. Please report to developers. Log: 'Fatal error on MSS CPU: trap: 00, address: 00000000' '0'
[2023-07-31 15:33:58.056] [depthai] [debug] DataOutputQueue (preview) closed
[18443010F1DEA90F00] [1.8] [1690810438.056] [host] [debug] Timesync thread exception caught: Couldn't read data from stream: '__timesync' (X_LINK_ERROR)
terminate called after throwing an instance of 'std::runtime_error'
  what():  Communication exception - possible device error/misconfiguration. Original message 'Couldn't read data from stream: 'preview' (X_LINK_ERROR)'

erik

Hi Jen ,
This unfortunately looks like a hardware issue, and it would be great if we could inspect it locally. Could you contact support@Luxonis.com, and we will replace the device asap?

Jen

Ok, thanks for the quick responses. I already sent out an E-Mail to support.

Jennifer