T
telaydi

Ttelaydi · Jan 5, 2022

Hi Alex!
Can you update us on whether you were able to add YUV444 (or RGB without subsampling) output streams.

Much appreciated!
Tarek

Ttelaydi · Nov 30, 2021

Thank you Alex! I have my setup working so I'm happy to wait. From an efficiency point of view though, having the spi do the heavy lifting makes more since. Looking forward to the new output type

T

Ttelaydi · Nov 29, 2021

Hello!
I'm currently receiving a RAW10 video stream from my OAK-D color camera, and by using the provided example code, unpacking the stream to 16bits per channel. I then use cv2.cvtColor to demosiac the image to linear RGB. Normally these two steps are done on-device when receiving an isp stream. Is there a way to receive unpacked demosaiced images from the isp stream but without the YUV420 sub-sampling? I'm hoping to get a linear RGBF16F16F16p image directly from the OAK-D without subsampling or jpeg compression. I don't mind if the stream goes through the 3A algorithm or is de-noised. Any help is greatly appreciated!
(If it's a bandwidth limitation can the same be done with still images?)

Warmest regards,
Tarek

Ttelaydi · Nov 5, 2021

I found the problem! It turns out my device output queue was not in the same scope as my queue.get(). I had:

with dai.Device(pipeline) as device:
  print("USB Connection speed: {}".format(device.getUsbSpeed()))
  camera_queue = device.getOutputQueue("color", maxSize=4, blocking=False)
  frame = None
while True:
  get_frame = camera_queue.tryGet() # receive color frame as 1D array 
  
  if get_frame is not None:
      frame = get_frame.getCvFrame()

Notice the lack of indentation for the while loop. Putting the loop in scope fixed my problem.

Ttelaydi · Nov 4, 2021

Hello!
I'm attempting to get a video stream from my oak-d but I'm currently getting an X_LINK_ERROR. I tried setting the device to usb2Mode=True but got the same error. Here is the debug output:
[2021-11-04 15:06:37.326] [debug] Python bindings - version: 2.11.1.1 from 2021-11-03 21:26:03 +0200 build: 2021-11-03 21:10:57 +0000 [2021-11-04 15:06:37.327] [debug] Library information - version: 2.11.1, commit: c1b697afa432c8d620b097ba57e20a0ffd2ec52d from 2021-10-25 22:42:02 +0200, build: 2021-11-03 21:10:42 +0000 [2021-11-04 15:06:37.328] [debug] Initialize - finished [2021-11-04 15:06:37.386] [debug] Resources - Archive 'depthai-bootloader-fwp-0.0.15.tar.xz' open: 1ms, archive read: 56ms numpy 1.21.3 cv2 4.5.4-dev depthai 2.11.1.1 [2021-11-04 15:06:37.619] [debug] Resources - Archive 'depthai-device-fwp-2021725697c9b570383b0597951a9d7b162e6182.tar.xz' open: 1ms, archive read: 290ms [2021-11-04 15:06:38.163] [debug] Device - OpenVINO version: 2021.4 [14442C1001238FD000] [150.491] [system] [info] Memory Usage - DDR: 0.12 / 359.07 MiB, CMX: 2.05 / 2.50 MiB, LeonOS Heap: 6.78 / 78.63 MiB, LeonRT Heap: 2.88 / 23.84 MiB [14442C1001238FD000] [150.491] [system] [info] Temperatures - Average: 32.61 ┬░C, CSS: 32.97 ┬░C, MSS 32.73 ┬░C, UPA: 32.01 ┬░C, DSS: 32.73 ┬░C [14442C1001238FD000] [150.491] [system] [info] Cpu Usage - LeonOS 9.96%, LeonRT: 2.42% [2021-11-04 15:06:39.964] [debug] Schema dump: {"connections":[{"node1Id":0,"node1Output":"preview","node2Id":1,"node2Input":"in"}],"globalProperties":{"calibData":null,"cameraTuningBlobSize":null,"cameraTuningBlobUri":"","leonCssFrequencyHz":700000000.0,"leonMssFrequencyHz":700000000.0,"pipelineName":null,"pipelineVersion":null,"xlinkChunkSize":-1},"nodes":[[0,{"id":0,"ioInfo":{"inputConfig":{"blocking":false,"name":"inputConfig","queueSize":8,"type":3},"inputControl":{"blocking":true,"name":"inputControl","queueSize":8,"type":3},"isp":{"blocking":false,"name":"isp","queueSize":8,"type":0},"preview":{"blocking":false,"name":"preview","queueSize":8,"type":0},"raw":{"blocking":false,"name":"raw","queueSize":8,"type":0},"still":{"blocking":false,"name":"still","queueSize":8,"type":0},"video":{"blocking":false,"name":"video","queueSize":8,"type":0}},"name":"ColorCamera","properties":{"boardSocket":-1,"colorOrder":1,"fp16":false,"fps":30.0,"imageOrientation":-1,"initialControl":{"aeLockMode":false,"aeRegion":{"height":0,"priority":0,"width":0,"x":0,"y":0},"afRegion":{"height":0,"priority":0,"width":0,"x":0,"y":0},"antiBandingMode":0,"autoFocusMode":3,"awbLockMode":false,"awbMode":0,"brightness":0,"chromaDenoise":0,"cmdMask":0,"contrast":0,"effectMode":0,"expCompensation":0,"expManual":{"exposureTimeUs":0,"frameDurationUs":0,"sensitivityIso":0},"lensPosition":0,"lumaDenoise":0,"saturation":0,"sceneMode":0,"sharpness":0},"inputConfigSync":false,"interleaved":false,"ispScale":{"horizDenominator":0,"horizNumerator":0,"vertDenominator":0,"vertNumerator":0},"previewHeight":300,"previewKeepAspectRatio":true,"previewWidth":300,"resolution":0,"sensorCropX":-1.0,"sensorCropY":-1.0,"stillHeight":-1,"stillWidth":-1,"videoHeight":-1,"videoWidth":-1}}],[1,{"id":1,"ioInfo":{"in":{"blocking":true,"name":"in","queueSize":8,"type":3}},"name":"XLinkOut","properties":{"maxFpsLimit":-1.0,"metadataOnly":false,"streamName":"color"}}]]} [2021-11-04 15:06:39.964] [debug] Asset map dump: {"map":{}} [14442C1001238FD000] [150.507] [system] [info] ImageManip internal buffer size '80640'B, shave buffer size '19456'B [14442C1001238FD000] [150.507] [system] [info] SIPP (Signal Image Processing Pipeline) internal buffer size '122880'B [14442C1001238FD000] [150.543] [system] [info] ColorCamera allocated resources: no shaves; cmx slices: [13-15] [14442C1001238FD000] [150.543] [system] [info] ImageManip allocated resources: shaves: [15-15] no cmx slices. USB Connection speed: UsbSpeed.SUPER [2021-11-04 15:06:40.042] [debug] Device about to be closed... [2021-11-04 15:06:40.043] [debug] Log thread exception caught: Couldn't read data from stream: '__log' (X_LINK_ERROR) [2021-11-04 15:06:40.043] [debug] Timesync thread exception caught: Couldn't read data from stream: '__timesync' (X_LINK_ERROR) [2021-11-04 15:06:40.719] [debug] Watchdog thread exception caught: Couldn't write data to stream: '__watchdog' (X_LINK_ERROR) [2021-11-04 15:06:41.943] [debug] XLinkResetRemote of linkId: (0) [2021-11-04 15:06:41.945] [debug] Device closed, 1903 Traceback (most recent call last): File "\\wsl$\Ubuntu-20.04\home\telaydi\github\CS7675\camera\camera.py", line 51, in <module> get_frame = camera_queue.tryGet() # receive color frame as 1D array RuntimeError: Communication exception - possible device error/misconfiguration. Original message 'Couldn't read data from stream: 'color' (X_LINK_ERROR)'

I'm running my python code on windows 10. Any help is be appreciated!

Note: I can get the camera to work when running the depthai_demo.py example

Ttelaydi

T
telaydi