FFC 4P PoE no camera detected

BenjaminKiefer

Hey,
I have this board with a IMX477 attached.

But I get this error, could you help me out? (it's the most recent DepthAI GUI)

Available devices:

[0] 18443010F1CFBD0F00 [X_LINK_BOOTLOADER]

Enabling low-bandwidth mode due to connection mode... (protocol: XLinkProtocol.X_LINK_TCP_IP)

Setting PoE video quality to 50 to reduce latency...

Creating MJPEG link for MonoCamera node and left xlink stream...

Creating MJPEG link for MonoCamera node and right xlink stream...

Creating MJPEG link for ColorCamera node and color xlink stream...

[18443010F1CFBD0F00] [169.254.1.222] [5.907] [MonoCamera(4)] [error] Camera 2 connected on socket 2 is not monochrome

[18443010F1CFBD0F00] [169.254.1.222] [5.908] [MonoCamera(0)] [error] Camera 2 connected on socket 1 is not monochrome

[18443010F1CFBD0F00] [169.254.1.222] [5.909] [ColorCamera(8)] [error] Camera not detected on socket: 0

[18443010F1CFBD0F00] [169.254.1.222] [5.971] [StereoDepth(12)] [error] RGB camera calibration missing, aligning to RGB won't work

[2023-10-22 19:29:20.236] [warning] Monitor thread (device: 18443010F1CFBD0F00 [169.254.1.222]) - ping was missed, closing the device connection

File "C:\Users\Lookout\AppData\Local\Programs\DepthAI\depthai\depthai_demo.py", line 656, in run

self.instance.run_all(self.conf)

File "C:\Users\Lookout\AppData\Local\Programs\DepthAI\depthai\depthai_demo.py", line 133, in run_all

self.run()

File "C:\Users\Lookout\AppData\Local\Programs\DepthAI\depthai\depthai_demo.py", line 272, in run

self._device.startPipeline(self._pm.pipeline)

XLinkReadError: Couldn't read data from stream: '__rpc_main' (X_LINK_ERROR)

jakaskerl

Hi BenjaminKiefer
The demo doesn't work with color stereo. You will need to use the depthai-viewer, which aims to replace the demo.

Thanks,
Jaka

BenjaminKiefer

Hi, thanks for your reply!

I tested depthai-viewer with the cams I have

IMX477
IMX582

Plugging only one cam into either A or D slot works. However, attaching two cams (A+D) yields:

I also tried out this script, but it does not even work with a single camera. I got this without any stream showing:

Lastly, I got no IMU data (one cam attached in the viewer yields this: ):

Thanks!

jakaskerl

Hi BenjaminKiefer
Could you try with cam_test.py to see if the cameras are functioning properly when they are all connected at once?

Thanks,
Jaka

BenjaminKiefer

Hi!
I tried connecting both and running the script but same error.

On another note (sry if this is confusing and I should switch to another thread):

I have the USB board with 2 2-lane MIPI and 1 4-lane MIPI also with the same cameras.

I could run cam_test.py, e.g. see this output:

[14442C107107CBD600] [2.2] [1.729] [ColorCamera(3)] [warning] LCM48 supported resolutions: 4_K / 4000X3000 / 5312X6000. Defaulting to 4_K

Connected cameras:

-socket CAM_A : LCM48 5312 x 6000 focus:auto - COLOR

-socket CAM_B : IMX477 4056 x 3040 focus:fixed - MONO

-socket CAM_C : IMX477 4056 x 3040 focus:fixed - MONO

USB speed: SUPER

IR drivers: []

Cam: rgb left right [host | capture timestamp]

FPS: 0.00| 0.00 30.00| 30.00 0.00| 0.00

However, two issues:

- I could not switch between the cameras and only ever saw one stream. Is there a way to switch?
- One camera was really oversaturated, but all the parameters (ISO, whitebalance,…) seemed to have no effect. Is there a setting in cam_test.py I'm missing?

Thanks!

BenjaminKiefer

Just one more note:

If I run cam_tests.py without any arguments and choose rgb -> color, then I get a single stream.

If I run cam_tests.py without any arguments and choose left -> color, then I get a single stream.

However, when activating both, only left -> color is shown. I get empty packages for the other. Is there any setting I missed or why is there only ever one stream?

Just potentially fyi: depthai_viewer does not run in this configuration with error:

File "C:\Users\Lookout\anaconda3\envs\DepthAITests\lib\site-packages\depthai_viewer\_backend\device.py", line 191, in get_device_properties
biggest_width, biggest_height = [
IndexError: list index out of range

Thanks!

BenjaminKiefer

Here's a simple example, which shows one stream, but not the other. Not sure what I should do. I'm on the newest depthai version. I also tried out different branches (develop, IMX477-stereo, …). I tried out different combinations of sockets and camera names.

from pathlib import Path

import blobconverter

import cv2

import depthai

import numpy as np

pipeline = depthai.Pipeline()

# Uncomment to get better throughput

pipeline.setXLinkChunkSize(0)

control = pipeline.createXLinkIn()

control.setStreamName('control')

xinTofConfig = pipeline.createXLinkIn()

xinTofConfig.setStreamName('tofConfig')

xout_rgb = pipeline.createXLinkOut()

xout_rgb2 = pipeline.createXLinkOut()

cam_rgb = pipeline.createColorCamera()

cam_rgb2 = pipeline.createColorCamera()

cam_rgb.setPreviewSize(1920, 1080)

cam_rgb2.setPreviewSize(1920, 1080)

cam_rgb.setInterleaved(False)

cam_rgb2.setInterleaved(False)

cam_rgb.setBoardSocket(depthai.CameraBoardSocket.CAM_B)

cam_rgb2.setBoardSocket(depthai.CameraBoardSocket.CAM_A)

# For the rgb camera output, we want the XLink stream to be named "rgb"

xout_rgb.setStreamName("camb")

xout_rgb2.setStreamName("cama")

# Linking camera preview to XLink input, so that the frames will be sent to host

cam_rgb.preview.link(xout_rgb.input)

cam_rgb2.preview.link(xout_rgb2.input)

device = depthai.Device.getDeviceByMxId("")

dai_device_args = [pipeline]

if device[0]:
dai_device_args.append(device[1])
with depthai.Device(*dai_device_args) as device:
q_rgb = device.getOutputQueue("camb")

q_rgb2 = device.getOutputQueue("cama")

frame = None

while True:

    print("hji")

    in_rgb = q_rgb.tryGet()

    in_rgb2 = q_rgb2.tryGet()

    if in_rgb is not None:

        frame = in_rgb.getCvFrame()

        cv2.imshow("preview", frame)

    if cv2.waitKey(1) == ord('q'):

        break

erik

Hi @BenjaminKiefer ,
I believe there are several separate issues here;

Camera oversaturated: by default, cams on CAM_B and CAM_C port will share the exposure time/iso, as that's needed for stereo camera pair. Perhaps you could switch on cam to CAM_D instead, so that wouldn't happen?
One stream - your computer only gets 1 stream, looking at FPS: 0.00| 0.00 30.00| 30.00 0.00| 0.00 (so from left cam).

Regarding depthai_viewer error, could you please copy the full error? And which version of the FFC-4P-POE do you have (like R0M0E0)?

erik

Could you also check whether the IMU has been populated? It should be here:

BenjaminKiefer

Thanks for your reply! I have the device:

"Selecting device: 18443010F1CFBD0F00" Is that what you were wondering?

Yes, that's correct regarding oversaturation, thanks! (switched it to CAMD and CAMB).
I switched to a new version of depthai-viewer and it works to have it run with two cams connected. I can also switch between them, but I can't stream them simultaneously (it just waits forever without error message). Is that expected behaviour?
I do have that IMU chip onboard.

I feel I'm overwhelming this thread with too many different questions, which is why I'm going to put the USB-board-related questions from above to a different thread. Hope that's fine.