How to calibrate IMX462?

AndrzejFijalo

Hi,
I want to calibrate IMX462 with OAK-FFC-3P, but depthai repo doesn't support it yet and I get this error message:

[14442C1031B42BD700] [3.3] [4.047] [system] [warning] Calibration Data on device is empty
Cam: middle and focus: False
Saving dataset to: dataset
Sensor name for middle is IMX296
Traceback (most recent call last):
  File "calib.py", line 1170, in <module>
    Main().run()
  File "calib.py", line 1159, in run
    self.startPipeline()
  File "calib.py", line 459, in startPipeline
    pipeline = self.create_pipeline()
  File "calib.py", line 550, in create_pipeline
    cam_node.setResolution(camToRgbRes[cam_info['sensorName'].upper()])
KeyError: 'IMX296'

Thanks, Andrzej

jakaskerl

Hi AndrzejFijalo

make sure you are running the latest depthai
run a git pull --recurse-submodules to make sure your repo is up to date
(optional) switch to develop branch

Thanks,
Jaka

AndrzejFijalo

jakaskerl

Sorry for late response, but i checked your solution and still depthai repo gives me error with sensor detection IMX462 as IMX286 🙁

Screenshot for confirmation:

also in main:

My json config is this:
{ "board_config": { "name": "Custom FFC", "revision": "R1M0E1", "cameras":{ "CAM_A": { "name": "rgb", "hfov": 80, "type": "color" } } } }

What can i do to resolve this issue??

Thanks, Andrzej

jakaskerl

Hi AndrzejFijalo
Looks like the resolution support was not added for 462. Since it is still recognized as IMX296, try adding this:

camToRgbRes = {
                'IMX378' : dai.ColorCameraProperties.SensorResolution.THE_4_K,
                'IMX214' : dai.ColorCameraProperties.SensorResolution.THE_4_K,
                'OV9782' : dai.ColorCameraProperties.SensorResolution.THE_800_P,
                'IMX582' : dai.ColorCameraProperties.SensorResolution.THE_12_MP,
                'AR0234' : dai.ColorCameraProperties.SensorResolution.THE_1200_P,
                'IMX296' : dai.ColorCameraProperties.SensorResolution.THE_1080_P,
                }

Let me know if it works.

Thanks,
Jaka

AndrzejFijalo

Hi, jakaskerl
Unfortunately it doesn't work 🙁

after i press spacebar calibration.py just hangs up and preview image doesn't show up, so IMX462 is not supported.

What can I do now?
Thanks;
Andrzej

jakaskerl

Hi @AndrzejFijalo
You are still not using the latest version of depthai repo.

That's how the new calibration looks.

Thanks,
Jaka

AndrzejFijalo

HI jakaskerl
My apologies, but it was wrong screenshot, here is the correct one:

After pressing spacebar calibration.py just hangs up.

I've done exactly this steps:

make virtual environment

install depthai

git clone https://github.com/luxonis/depthai.git
cd depthai
git submodule update --init --recursive
python3 install_requirements.py

add json file

{
    "board_config": {
        "name": "Custom FFC",
        "revision": "R1M0E1",
        "cameras": {
            "CAM_A": {
                "name": "rgb",
                "hfov": 80,
                "type": "color"
            }
        }
    }
}

add line of code

camToRgbRes = {
                'IMX378' : dai.ColorCameraProperties.SensorResolution.THE_4_K,
                'IMX214' : dai.ColorCameraProperties.SensorResolution.THE_4_K,
                'OV9782' : dai.ColorCameraProperties.SensorResolution.THE_800_P,
                'IMX582' : dai.ColorCameraProperties.SensorResolution.THE_12_MP,
                'AR0234' : dai.ColorCameraProperties.SensorResolution.THE_1200_P,
                'IMX296' : dai.ColorCameraProperties.SensorResolution.THE_1080_P,
                }

I've check also an develop branch and this same result.

What can I do now with calibration?
Thanks,
Andrzej

jakaskerl

Hi AndrzejFijalo
I just checked with 462, it works as expected on the develop branch:

git clone https://github.com/luxonis/depthai.git
cd depthai
git checkout develop
git submodule update --init --recursive
python3 install_requirements.py

Running cam_test.py, correctly shows IMX462.

This means the calibration should work as well, provided you set the resolution for IMX462 (instead of 296).

Thanks,
Jaka

AndrzejFijalo

jakaskerl

yes, in depthai-python repo IMX462 is supported in develop branch, so IMX462 is detected. I was looking in Luxonis commit history and this sensor support was merged in this PR luxonis/depthai-python922#issue-2002173555

But commit history for depthai repo looks like last commit on develop branch is from 2nd of November

But you are sure that this sensor is also supported in depthai repo? I just do exactly what you write on two separate machines and it doesn't work at all. For double check i was trying to run depthai_demo.py and it also don't recognize IMX462.

sorry for inconvenience, but i really need this calibration xD

Thanks, Andrzej

jakaskerl

AndrzejFijalo yes, in depthai-python repo IMX462 is supported in develop branch, so IMX462 is detected.

It's the same depthai version so it should work whether you are using it on depthai-python or depthai repo.

AndrzejFijalo For double check i was trying to run depthai_demo.py and it also don't recognize IMX462.

Depthai_demo will force you to run an earlier version of depthai - unless you pass the --skipVersionCheck flag. Did you do that?

EDIT: Tested, won't work on 2-LANE mipi, but works fine on 4-lane.

Thanks,
Jaka

vidullan

@AndrzejFijalo could you please let me know where you purchased an IMX462 compatible with the FFC module? I can't see any in the Luxonis store.

jakaskerl

vidullan
The IMX462 is currently out of stock on the Luxonis store.

Thanks,
Jaka