Hardware sync Arducam IMX477 M12 cameras with OAK-4P

Nearpoint

I have 2 IMX477 color cameras connected to the CAM_A and CAM_D on an OAK-4P. These are the arducam INX477 M12 sensors that I purchased from the luxonis store.

I read that you need to connect the FSIN pins to each other but I have gone through this thread
https://discuss.luxonis.com/d/934-ffc-4p-hardware-synchronization/6

And the sensor I have the IMX477 M12 purchased from Luxonis does not seem to have a FSIN or FSYNC exposed anymore. The only thing I see is 4 letters which are explained in the image

The F is for FSTROBE. So please help me figure out what is going on, how can I hardware sync these cameras?

Nearpoint

On OAK-FFC-4P, we have 4 camera ports; A (rgb), B (left), C (right), and D (cam_d). A & D are 4-lane MIPI, and B & C are 2-lane MIPI. Each pair (A&D and B&C) share an I2C bus, and the B&C bus is configured for HW syncing left+right cameras by default.

For A&D ports, you need to explicitly enable hardware syncing:

$$
cam_A.initialControl.setFrameSyncMode(dai.CameraControl.FrameSyncMode.OUTPUT)
cam_D.initialControl.setFrameSyncMode(dai.CameraControl.FrameSyncMode.INPUT)
$$

But I am using the IMX477 on CAM_A and CAM*D and it also says

At the moment, only OV9282/OV9782 can output FSYNC signal, while IMX378/477/577/etc should also have the capability, but isn’t yet supported (so these can not drive FSYNC signal, only be driven by it). AR0234 has input-only FSYNC trigger.

So what do I do? I do not think the code will work like that?

jakaskerl

Hi Nearpoint

Nearpoint At the moment, only OV9282/OV9782 can output FSYNC signal, while IMX378/477/577/etc should also have the capability, but isn’t yet supported (so these can not drive FSYNC signal, only be driven by it). AR0234 has input-only FSYNC trigger.

477 can only be driven by an external fsync signal, it is currently unable to drive it itself.

Which revision of FFC-4P and OAK-CBA do you have? AFAIK the FSYNC pins should still be exposed.

Thanks,
Jaka

l4es

Hi @Nearpoint,

The F is for FSTROBE. So please help me figure out what is going on, how can I hardware sync these cameras?

No, the X (XVS) signal should be used (wired to the FSIN pad on the FFC cable side).

At the moment, only OV9282/OV9782 can output FSYNC signal, while IMX378/477/577/etc should also have the capability, but isn’t yet supported (so these can not drive FSYNC signal, only be driven by it). AR0234 has input-only FSYNC trigger.

From here it says :

IMX378, IMX477, IMX577, IMX380 Rolling FSYNC input, only continuous mode supported for rolling shutter sensors. Hardware also supports FSYNC output, but not implemented in FW yet

It means that you can use FSYNC in input mode for the above sensors. By input mode, it means that you should configure a GPIO (COM_AUX_IO2/FSIN_2LANE) of the OAK-FFC-4P to trigger all the IMX477 in your setup (you might also need to drive the FSIN_MODE_SELECT to 1 in order to tie FSIN_2LANE and FSIN_4LANE together but it isn't necessary as it is pulled up by default in hardware R7), just similar to the AR0234 in the following comment : https://discuss.luxonis.com/d/2303-please-share-the-status-of-hw-sync-for-oak-ffc-4p-ar0234-based-stereo-pair/17

Hope that help!