Too slow to take ISP when set max resolution on oak-1-poe

HYERINYOO

Hello everyone.
Setting the maximum resolution takes too much time to acquire an isp image. I'd like to ask if I can reduce this time. Also, I would like to know if there is a way to quickly resize the image of the maximum angle of view.
Below is the isp acquisition time when it is not the maximum resolution in oak-1-poe and isp acquisition time when it is the maximum resolution.

1) 1080p
[184430108176DD0F00] [192.168.0.100] [5.491] [ColorCamera(1)] [trace]Color ISP took '3.7224' ms.

[184430108176DD0F00] [192.168.0.100] [5.495] [ColorCamera(1)] [trace] ColorCamera post processing took '3.39668' ms.

[184430108176DD0F00] [192.168.0.100] [5.495] [system] [trace] EV:0,S:0,IDS:6,IDD:12,TSS:5,TSN:495163171

[184430108176DD0F00] [192.168.0.100] [5.495] [system] [trace] EV:0,S:1,IDS:6,IDD:12,TSS:5,TSN:495206187

[184430108176DD0F00] [192.168.0.100] [5.495] [system] [trace] EV:1,S:1,IDS:12,IDD:0,TSS:5,TSN:495713442

[184430108176DD0F00] [192.168.0.100] [5.497] [ImageManip(3)] [trace] ImageManip took '1.326887' ms.

2) Max resolution(THE_12_MP)
[184430108176DD0F00] [192.168.0.100] [5.546] [ColorCamera(1)] [trace]Color ISP took '19.3893' ms.

[184430108176DD0F00] [192.168.0.100] [5.550] [ColorCamera(1)] [trace] ColorCamera post processing took '3.117423' ms.

[184430108176DD0F00] [192.168.0.100] [5.550] [system] [trace] EV:0,S:0,IDS:6,IDD:12,TSS:5,TSN:550122338

[184430108176DD0F00] [192.168.0.100] [5.550] [system] [trace] EV:0,S:1,IDS:6,IDD:12,TSS:5,TSN:550164511

[184430108176DD0F00] [192.168.0.100] [5.550] [system] [trace] EV:1,S:1,IDS:12,IDD:0,TSS:5,TSN:550718747

[184430108176DD0F00] [192.168.0.100] [5.552] [ImageManip(3)] [trace] ImageManip took '1.341327' ms.

<code>

cam_rgb.setPreviewSize(192, 192)

cam_rgb.setBoardSocket(dai.CameraBoardSocket.RGB)

cam_rgb.setResolution(dai.ColorCameraProperties.SensorResolution.THE_12_MP)

cam_rgb.setIspScale(1, 3)

cam_rgb.setPreviewKeepAspectRatio(keep=False)

jakaskerl

Hi HYERINYOO
Would you mind sharing a MRE so we can look into it?

Thanks,
Jaka

HYERINYOO

#!/usr/bin/env python3

import cv2
import depthai as dai

# Create pipeline
pipeline = dai.Pipeline()

# Define source and output
camRgb = pipeline.create(dai.node.ColorCamera)
xoutRgb = pipeline.create(dai.node.XLinkOut)

xoutRgb.setStreamName("rgb")

# Properties
camRgb.setPreviewSize(192, 192)
camRgb.setInterleaved(False)
camRgb.setColorOrder(dai.ColorCameraProperties.ColorOrder.RGB)
## maximum resolution for full fov which i need
camRgb.setResolution(dai.ColorCameraProperties.SensorResolution.THE_12_MP)
## low resolution
camRgb.setResolution(dai.ColorCameraProperties.SensorResolution.THE_1080_P)
camRgb.setIspScale(1, 2)
camRgb.setPreviewKeepAspectRatio(False)


# Linking
camRgb.preview.link(xoutRgb.input)

device_info = dai.DeviceInfo("ip address for oak-1-poe")
# Connect to device and start pipeline
with dai.Device(pipeline, device_info) as device:
    device.setLogLevel(dai.LogLevel.TRACE)
    device.setLogOutputLevel(dai.LogLevel.TRACE)
    device.startPipeline()
    print("Connected cameras:", device.getConnectedCameraFeatures())
    print("Usb speed:", device.getUsbSpeed().name)
    if device.getBootloaderVersion() is not None:
        print("Bootloader version:", device.getBootloaderVersion())
    print("Device name:", device.getDeviceName())

    # Output queue will be used to get the rgb frames from the output defined above
    qRgb = device.getOutputQueue(name="rgb", maxSize=4, blocking=False)

    while True:
        inRgb = qRgb.get()  # blocking call, will wait until a new data has arrived
        cv2.imwrite("preview_test.jpg", inRgb.getCvFrame())

HYERINYOO

use this command for checking time on oak-1-poe camera
DEPTHAI_LEVEL=trace python3.9 script.py

jakaskerl

Hi HYERINYOO
I played around with the settings a bit. Seems like there is no way to change the acquisition time. Since the IMX378 has a rolling shutter, it just takes some time to acquire an image at that resolution. You might benefit from lowering the exposure time, but that is pretty much it afaik.

Thanks,
Jaka

erik

You can reduce the exposure time via setting the camera control, example here: https://docs.luxonis.com/projects/api/en/latest/samples/ColorCamera/rgb_camera_control/#rgb-camera-control
Using i and o keys will increase/decrease exposure time. ISP time will take longer though, as the ISP needs to read the raw img from the sensor and do the "ISP stuff" (debayering, 3A algos, isp scaling, conversion to different formats..).