M
mw46d

  • 24 days ago
  • Joined Sep 28, 2024
  • 0 best answers
  • It might be a thermal issue!

    The following is my last reply to a mailing list thread on that issue (from late September 2024)


    With the help of the DepthAI debug output, I found that regularly shortly after the reported chip temperatures got up to 77C, the pipeline would 'shut down' and the host would not see any data any longer.

    So, I strapped a 50mm fan to the Oak-D and it was running fine for an hour;-) The reported  chip temps stayed around 62C.

    Next step was to replace the mount and integrate two 30mm fans. Now the temps stay around 55C and the pipeline is still going strong after 1.5h 😉

    Attache are two pictures of the mount, one with the rigged up 50mm fan and the current version with the two 30mm fans;-)

    [coneslayer_node-2] [19443010E13A7A2700] [1.1] [4915.611] [system] [info] Temperatures - Average: 54.48C, CSS: 55.51C, MSS 54.42C, UPA: 55.07C, DSS: 52.90C
    [coneslayer_node-2] [19443010E13A7A2700] [1.1] [4915.611] [system] [info] Cpu Usage - LeonOS 60.79%, LeonRT: 50.47%
    [coneslayer_node-2] [19443010E13A7A2700] [1.1] [4916.613] [system] [info] Memory Usage - DDR: 66.99 / 333.28 MiB, CMX: 2.47 / 2.50 MiB, LeonOS Heap: 47.34 / 81.76 MiB, LeonRT Heap: 5.70 / 39.90 MiB / NOC ddr: 3297 MB/s

    Maybe that's helpful to some;-

  • What does the id command tell you about your normal user? Is that user a member of the docker group?

    marcow@feather7:~$ id
    uid=80288(marcow) gid=10(uucp) groups=10(uucp),4(adm),20(dialout),24(cdrom),27(sudo),30(dip),46(plugdev),122(lpadmin),133(lxd),134(sambashare),136(vboxusers),999(docker)

  • can you just do an 'lsusb' inside the container? Does the device show up there?

    marcow@feather7:~$ xhost +; docker pull luxonis/depthai-library && docker run --rm     --privileged     -v /dev/bus/usb:/dev/bus/usb     --device-cgroup-rule='c 189:* rmw'     -e DISPLAY=$DISPLAY     -v /tmp/.X11-unix:/tmp/.X11-unix  luxonis/depthai-library:latest  bash -c "apt-get install usbutils && lsusb"    
    access control disabled, clients can connect from any host
    Using default tag: latest
    latest: Pulling from luxonis/depthai-library
    Digest: sha256:12d0ddd4abacc82dd0239415bd25e6ef0c37193672f86aca6db7b9ea870b1149
    Status: Image is up to date for luxonis/depthai-library:latest
    docker.io/luxonis/depthai-library:latest
    Reading package lists...
    Building dependency tree...
    Reading state information...
    The following NEW packages will be installed:
     usbutils
    0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
    Need to get 79.3 kB of archives.
    After this operation, 333 kB of additional disk space will be used.
    Get:1 http://deb.debian.org/debian bullseye/main amd64 usbutils amd64 1:013-3 [79.3 kB]
    debconf: delaying package configuration, since apt-utils is not installed
    Fetched 79.3 kB in 0s (543 kB/s)
    Selecting previously unselected package usbutils.
    (Reading database ... 45067 files and directories currently installed.)
    Preparing to unpack .../usbutils_1%3a013-3_amd64.deb ...
    Unpacking usbutils (1:013-3) ...
    Setting up usbutils (1:013-3) ...
    Processing triggers for man-db (2.9.4-2) ...
    Bus 004 Device 001: ID 1d6b:0003 Linux 6.8.0-45-generic xhci-hcd xHCI Host Controller
    Bus 003 Device 001: ID 1d6b:0002 Linux 6.8.0-45-generic xhci-hcd xHCI Host Controller
    Bus 002 Device 001: ID 1d6b:0003 Linux 6.8.0-45-generic xhci-hcd xHCI Host Controller
    Bus 001 Device 041: ID 03e7:2485 Movidius Ltd. Movidius MyriadX
    Bus 001 Device 003: ID 174f:1812   Integrated Camera
    Bus 001 Device 002: ID 06cb:0126   
    Bus 001 Device 005: ID 8087:0033   
    Bus 001 Device 001: ID 1d6b:0002 Linux 6.8.0-45-generic xhci-hcd xHCI Host Controller
    marcow@feather7:~$

  • Works just fine;-) Sorry for the boring view;-)

  • MRE? Sorry;-) I'm using coneslayer_openvino_2022.1_6shave.blob & coneslayer.json from mkrupczak3/Coneslayer inside a ROS2/Humble node on a RasPi5 with Ubuntu 22.04;-)

    OK, I pushed my sources to mw46d/ros_coneslayer , I hope, that helps a bit.

    Today it lasted for almost 13 minutes;-) on a stationary rover, so the cables don't move or anything;-) I'll probably have to create a 'node restarter' for now.

    Thanks for looking into it;-)

    -- Marco

  • On what kind of host system are you? It seems to work fine with your 'docker …' line for me on Ubuntu 22.04;-)

    Backend started successfully.
    [2024-09-28T19:20:45Z INFO  ewebsock::native_tungstenite] WebSocket handshake has been successfully completed
    [2024-09-28T19:20:45Z INFO  re_viewer::depthai::ws] Websocket opened
    Selecting device:  19443010E13A7A2700
    Connecting to viewer at 127.0.0.1:9876
    Oak cam:  <depthai_sdk.oak_camera.OakCamera object at 0x778b50b0fb20>
    Default stereo pair:  (<CameraBoardSocket.CAM_B: 1>, <CameraBoardSocket.CAM_C: 2>)
    Selecting device:  19443010E13A7A2700
    Resetting...
    Closing device...
    Done
    Connecting to viewer at 127.0.0.1:9876
    Oak cam:  <depthai_sdk.oak_camera.OakCamera object at 0x778b4e1de980>
    Default stereo pair:  (<CameraBoardSocket.CAM_B: 1>, <CameraBoardSocket.CAM_C: 2>)
    Pipeline config:  auto=True cameras=[CameraConfiguration(fps=30, resolution=<CameraSensorResolution.THE_1080_P: 'THE_1080_P'>, kind=<CameraS
    ensorType.COLOR: 0>, board_socket=<CameraBoardSocket.CAM_A: 0>, stream_enabled=True, name='Color', tof_align=None), CameraConfiguration(fps=
    30, resolution=<CameraSensorResolution.THE_400_P: 'THE_400_P'>, kind=<CameraSensorType.MONO: 1>, board_socket=<CameraBoardSocket.CAM_B: 1>,
    stream_enabled=False, name='Left', tof_align=None), CameraConfiguration(fps=30, resolution=<CameraSensorResolution.THE_400_P: 'THE_400_P'>,
    kind=<CameraSensorType.MONO: 1>, board_socket=<CameraBoardSocket.CAM_C: 2>, stream_enabled=False, name='Right', tof_align=None)] stereo=Ster
    eoDepthConfiguration(median=<MedianFilter.KERNEL_7x7: 7>, lr_check=True, lrc_threshold=5, extended_disparity=False, subpixel_disparity=True,
    align=<CameraBoardSocket.CAM_A: 0>, sigma=0, confidence=230, stereo_pair=(<CameraBoardSocket.CAM_B: 1>, <CameraBoardSocket.CAM_C: 2>)) ai_m
    odel=AiModelConfiguration(display_name='Yolo V6', path='yolov6nr3_coco_640x352', camera=<CameraBoardSocket.CAM_A: 0>) imu=ImuConfiguration(r
    eport_rate=100, batch_report_threshold=5)
    Updating pipeline...
    Usb speed:  UsbSpeed.SUPER
    Creating camera:  fps=15 resolution=<CameraSensorResolution.THE_1080_P: 'THE_1080_P'> kind=<CameraSensorType.COLOR: 0> board_socket=<CameraB
    oardSocket.CAM_A: 0> stream_enabled=True name='Color' tof_align=None
    Creating camera:  fps=15 resolution=<CameraSensorResolution.THE_480_P: 'THE_480_P'> kind=<CameraSensorType.COLOR: 0> board_socket=<CameraBoa
    rdSocket.CAM_B: 1> stream_enabled=True name='Left' tof_align=None
    Creating camera:  fps=15 resolution=<CameraSensorResolution.THE_480_P: 'THE_480_P'> kind=<CameraSensorType.COLOR: 0> board_socket=<CameraBoa
    rdSocket.CAM_C: 2> stream_enabled=True name='Right' tof_align=None
    Creating depth
    Getting cam by socket:  CameraBoardSocket.CAM_A  Cameras:  [CameraConfiguration(fps=15, resolution=<CameraSensorResolution.THE_1080_P: 'THE_
    1080_P'>, kind=<CameraSensorType.COLOR: 0>, board_socket=<CameraBoardSocket.CAM_A: 0>, stream_enabled=True, name='Color', tof_align=None), C
    ameraConfiguration(fps=15, resolution=<CameraSensorResolution.THE_480_P: 'THE_480_P'>, kind=<CameraSensorType.COLOR: 0>, board_socket=<Camer
    aBoardSocket.CAM_B: 1>, stream_enabled=True, name='Left', tof_align=None), CameraConfiguration(fps=15, resolution=<CameraSensorResolution.TH
    E_480_P: 'THE_480_P'>, kind=<CameraSensorType.COLOR: 0>, board_socket=<CameraBoardSocket.CAM_C: 2>, stream_enabled=True, name='Right', tof_a
    lign=None)]
    Creating IMU, connected IMU:  BMI270
    Starting pipeline
    [19443010E13A7A2700] [1.7] [3.089] [DetectionNetwork(9)] [warning] Network compiled for 6 shaves, maximum available 10, compiling for 5 shav
    es likely will yield in better performance
    ----------------------------------------

  • I have seen that today as well (with a rather recent firmware blob)

    [coneslayer_node-2] [2024-09-28 05:05:55.299] [depthai] [debug] Initialize - finished
    [coneslayer_node-2] [2024-09-28 05:05:55.462] [depthai] [debug] Resources - Archive 'depthai-bootloader-fwp-0.0.28.tar.xz' open: 5ms, archive read: 157ms
    [coneslayer_node-2] [2024-09-28 05:05:56.029] [depthai] [debug] Resources - Archive 'depthai-device-fwp-9ed7c9ae4c232ff93a3500a585a6b1c00650e22c.tar.xz' open: 2ms, archive read: 736ms
    [component_container-3] [INFO] [1727499957.062681135] [oak_container]: Load Library: /homeubuntu/ros2/ws_livox/install/ros_coneslayer/lib/libros_coneslayer.so
    [coneslayer_node-2] [2024-09-28 05:05:57.080] [host] [debug] Device - OpenVINO version: 2022.1

    …

    [coneslayer_node-2] [19443010E13A7A2700] [1.1] [287.268] [system] [info] Cpu Usage - LeonOS 51.97%, LeonRT: 45.45%

    average rate: 24.962
           min: 0.020s max: 0.065s std dev: 0.00919s window: 4217
    [coneslayer_node-2] F: [global] [    246033] [Scheduler00Thr] dispatcherResponseServe:928       no request for this response: XLINK_READ_REL_RESP 1

    So, this time around, it was only running for 5 minutes:-( But that's one of the shorter runs:-( After that, my ROS node does not produce any topic messages any longer:-(