I am working with rerun currently trying to stream data using my OAK-D camera. After going to the link below and following the directions I am unable to get the point cloud to begin to generate, I am also not able to record at all while using the application. Is there a way to save and store the data through this application? This would greatly help me. Below I gave a link to the github that I have been using.

luxonis/depthai-experimentstree/master/gen2-rerun

  • michaelsalerno replied to this.

  • @jakaskerl

    Thank you for the help, I was able to resolve the issue by changing the requirements installation code. Thank you for your assistance.

    @jakaskerl

    I had tried that, but I am now going to start a new directory with the information and required files to see if starting from a fresh directory will help the problem. I will let you know if this works. Thank you for sending along the recording information, I will look at this more in-depth today to attempt to resolve the issues.

    @jakaskerl

    I tried to rerun the code in a new directory and was able to make the proper installation. After, when I went to run the code python3 pointcloud.py I am received with the following information. I am really confused on why it is not executing the code since it should be the same one from github. Below I also posted the link to where I am finding the information.

    luxonis/depthai-experimentstree/master/gen2-rerun

    C:\Users\sale4088\AppData\Local\Programs\DepthAI\venv\Thesis\gen2-rerun>python3 pointcloud.py

    Traceback (most recent call last):

    File "C:\Users\sale4088\AppData\Local\Programs\DepthAI\venv\Thesis\gen2-rerun\pointcloud.py", line 8, in <module>

    subprocess.Popen(["rerun", "--memory-limit", "200MB"])

    File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.10_3.10.3056.0_x64__qbz5n2kfra8p0\lib\subprocess.py", line 971, in init

    self._execute_child(args, executable, preexec_fn, close_fds,

    File "C:\Program Files\WindowsApps\PythonSoftwareFoundation.Python.3.10_3.10.3056.0_x64__qbz5n2kfra8p0\lib\subprocess.py", line 1456, in _execute_child

    hp, ht, pid, tid = _winapi.CreateProcess(executable, args,

    FileNotFoundError: [WinError 2] The system cannot find the file specified

    @jakaskerl

    I am unable to get around this line,

    C:\Users\sale4088\AppData\Local\Programs\DepthAI\venv\Thesis\gen2-rerun>python owninfo.py

    Traceback (most recent call last):

    File "C:\Users\sale4088\AppData\Local\Programs\DepthAI\venv\Thesis\gen2-rerun\owninfo.py", line 4, in <module>

    rr.init()

    AttributeError: module 'rerun' has no attribute 'init'

    Hi @michaelsalerno
    Which rerun version are you using? Try a different one, there have been many changes on their side.

    Thanks,
    Jaka

    @jakaskerl

    I was able to get rerun to record a video using the pointcloud.py code. After I located the recording I tried to upload it to rerun to watch back the file, but when I uploaded it I received this message. Do you know why it is appearing? Also, thank you for all of your assistance I really appreciate all the work and time you take to assist with me.

      michaelsalerno @jakaskerl

      2024-03-22T20:02:43.566980Z WARN re_sdk_comms::buffered_client: Failed to send message: Failed to send to Rerun server at [127.0.0.1:9876]: An existing connection was forcibly closed by the remote host. (os error 10054)

      This line of code has also been appearing while running the pointcloud.py

          michaelsalerno

          @jakaskerl

          Error code from python, same as the one that pops up in rerun.

          [2024-03-22T20:14:20Z ERROR re_data_source::load_file] Failed to load data from file path="C:\\Users\\sale4088\\AppData\\Local\\Programs\\DepthAI\\venv\\Thesis\\rerun-work\\rerun_pointcloud\\Recordings\\Recording2.rrd" loader="rerun.data_loaders.Rrd" err=Failed to decode the options: Reserved bytes not zero

              michaelsalerno

              I tried to upgrade my rerun using a pip upgrade --rerun, but It upgraded me to 1.0.3 and now I am unable to even execute the code to access the application. What is the original version of rerun so I can reset it back?

                Hi @michaelsalerno
                The version used by the experiment is 0.1.3, but the latest rerun is 0.14.1.

                Best to create an issue over at rerun-io/rerun and ask the devs there. I'm not too familiar with how rerun works/doesn't.

                Thanks,
                Jaka

                5 months later

                michaelsalerno
                What did you specifically change within the requirements.txt file? I am running the same pointcloud.py file with the exact requirements.py The error I getting is this 2024-08-13T15:06:06.710903Z WARN re_analytics::pipeline_native: failed to send analytics down the sink, will try again later err=http://tel.rerun.io/: Dns Failed: resolve dns name 'tel.rerun.io:80': No such host is known. (os error 11001)

                2024-08-13T15:06:08.693929Z WARN re_analytics::pipeline_native: failed to send analytics down the sink, will try again later err=http://tel.rerun.io/: Dns Failed: resolve dns name 'tel.rerun.io:80': No such host is known. (os error 11001)

                2024-08-13T15:06:08.694824Z WARN re_analytics::pipeline_native: couldn't flush analytics data file err=http://tel.rerun.io/: Dns Failed: resolve dns name 'tel.rerun.io:80': No such host is known. (os error 11001) analytics_id=286caf96-cfe1-4cad-9c94-5bf3098c64d0 session_id=5852f14d-5db8-4695-b3ca-a1d7bc177702

                [14442C10A1063AD100] [169.254.1.222] [5.025] [ColorCamera(5)] [error] Camera not detected on socket: 0

                [14442C10A1063AD100] [169.254.1.222] [5.026] [MonoCamera(1)] [error] Camera not detected on socket: 2

                [14442C10A1063AD100] [169.254.1.222] [5.086] [StereoDepth(2)] [error] Maximum disparity value '3040' exceeds the maximum supported '1024' by median filter. Disabling median filter!

                Opening device SensorResolution.THE_400_P

                2024-08-13T15:06:10.704041Z WARN re_analytics::pipeline_native: failed to send analytics down the sink, will try again later err=http://tel.rerun.io/: Dns Failed: resolve dns name 'tel.rerun.io:80': No such host is known. (os error 11001)

                    14 days later

                    jakaskerl
                    UPDATE
                    I was able to get my camera to run while using the pointcloud.py from the rerun repo, however I ran into the same issue as before. Giving me the error of
                    PS S:\DEPT\SVM4\Shared\Crossfunctional_Work\Projects\DepthCameras\LuxonisDepthAI\test_run\depthai-experiments\gen2-rerun> python pointcloud.py

                    StereoDepth config options:

                    Left-Right check:   True

Extended disparity: False

Subpixel:           True

Median filtering:   MedianFilter.KERNEL_7x7

                    S:\DEPT\SVM4\Shared\Crossfunctional_Work\Projects\DepthCameras\LuxonisDepthAI\test_run\depthai-experiments\gen2-rerun\pointcloud.py:30: DeprecationWarning: LEFT is deprecated, use CAM_B or address camera by name instead.

                    monoLeft.setBoardSocket(dai.CameraBoardSocket.LEFT)

                    S:\DEPT\SVM4\Shared\Crossfunctional_Work\Projects\DepthCameras\LuxonisDepthAI\test_run\depthai-experiments\gen2-rerun\pointcloud.py:34: DeprecationWarning: RIGHT is deprecated, use CAM_C or address camera by name instead.

                    monoRight.setBoardSocket(dai.CameraBoardSocket.RIGHT)

                    S:\DEPT\SVM4\Shared\Crossfunctional_Work\Projects\DepthCameras\LuxonisDepthAI\test_run\depthai-experiments\gen2-rerun\pointcloud.py:72: DeprecationWarning: RGB is deprecated, use CAM_A or address camera by name instead.

                    stereo.setDepthAlign(dai.CameraBoardSocket.RGB)

                    [2024-08-27T13:43:05Z INFO re_sdk_comms::server] Hosting a SDK server over TCP at 0.0.0.0:9876. Connect with the Rerun logging SDK.

                    [2024-08-27T13:43:05Z INFO re_sdk_comms::server] New SDK client connected from: 127.0.0.1:51334

                    [2024-08-27T13:43:08Z INFO egui_wgpu] There were 4 available wgpu adapters: {backend: Vulkan, device_type: IntegratedGpu, name: "Intel(R) UHD Graphics", driver: "Intel Corporation", driver_info: "Intel driver", vendor: 0x8086, device: 0x9A60}, {backend: Vulkan, device_type: DiscreteGpu, name: "NVIDIA RTX A3000 Laptop GPU", driver: "NVIDIA", driver_info: "538.18", vendor: 0x10DE, device: 0x24B8}, {backend: Vulkan, device_type: IntegratedGpu, name: "Intel(R) UHD Graphics", driver: "Intel Corporation", driver_info: "Intel driver", vendor: 0x8086, device: 0x9A60}, {backend: Gl, device_type: IntegratedGpu, name: "Intel(R) UHD Graphics", driver: "OpenGL", driver_info: "4.6.0 - Build 31.0.101.4032", vendor: 0x8086}

                    Opening device SensorResolution.THE_400_P

                    [14442C10A1063AD100] [169.254.1.222] [6.915] [StereoDepth(2)] [error] Disparity/depth width must be multiple of 16, but RGB camera width is 427. Set output size explicitly using 'setOutputSize(width, height)'.

                    [14442C10A1063AD100] [169.254.1.222] [1724766209.568] [host] [warning] Monitor thread (device: 14442C10A1063AD100 [169.254.1.222]) - ping was missed, closing the device connection

                    [14442C10A1063AD100] [169.254.1.222] [1724766218.882] [host] [warning] Device crashed, but no crash dump could be extracted.

                    Traceback (most recent call last):

                    File "S:\DEPT\SVM4\Shared\Crossfunctional_Work\Projects\DepthCameras\LuxonisDepthAI\test_run\depthai-experiments\gen2-rerun\pointcloud.py", line 133, in <module>

                    **asyncio.run(main())**

                    File "C:\Users\deg6fni\AppData\Local\anaconda3\envs\depth_ai\Lib\asyncio\runners.py", line 190, in run

                    **return runner.run(main)**

       **^^^^^^^^^^^^^^^^**

                    File "C:\Users\deg6fni\AppData\Local\anaconda3\envs\depth_ai\Lib\asyncio\runners.py", line 118, in run

                    **return self._loop.run_until_complete(task)**

       **^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^**

                    Opening device SensorResolution.THE_400_P

                    [14442C10A1063AD100] [169.254.1.222] [6.915] [StereoDepth(2)] [error] Disparity/depth width must be multiple of 16, but RGB camera width is 427. Set output size explicitly using 'setOutputSize(width, height)'.

                    [14442C10A1063AD100] [169.254.1.222] [1724766209.568] [host] [warning] Monitor thread (device: 14442C10A1063AD100 [169.254.1.222]) - ping was missed, closing the device connection

                    [14442C10A1063AD100] [169.254.1.222] [1724766218.882] [host] [warning] Device crashed, but no crash dump could be extracted.
                    He mentioned about changing the requirements code. I did the same, since I already had these modules/libraires already in my conda environment. I just sat assigned the variables to the current modules versions I already have. Because now that I have the depthai-viewer working, I was afraid that maybe downgrading would cause the viewer application to not work anymore.

                        Hi gdeanrexroth
                        The rerun and depthai-viewer are not the same thing. The script you are trying to run uses rerun and is not meant to run code for SR variant as it uses invalid configuration:

                        monoLeft = pipeline.create(dai.node.MonoCamera)
monoLeft.setResolution(resolution)
monoLeft.setBoardSocket(dai.CameraBoardSocket.LEFT)

monoRight = pipeline.create(dai.node.MonoCamera)
monoRight.setResolution(resolution)
monoRight.setBoardSocket(dai.CameraBoardSocket.RIGHT)

                        If you want to run the pointcloud inside rerun, you need to change the script like in the other post pertaining to pointclouds you have made.

                        The viewer should have that fixed.

                        Thanks,
                        Jaka