Jello effect when using OAK-1 on drone

Brandon I am wondering if this is enough reason to consider giving more thought towards support for the option of using a color camera module with a fixed focus lens (on non-FFC modules). Something with a similar depth of field to the b&w depth cameras. If the upcoming OpenCV AI kit Lite is being made smaller with the suggestion it may be able to be mounted on drones and other moving vehicles etc, this issue with vibration on the non-fixed lens cameras modules may become more apparent. Is there any fixed focus, pin / driver compatible modules out there for the color camera port?

JohnSymonds Yes, I think this is an excellent point.

This won't be on OAK-D-Lite because we architected that and then had to order parts/cameras/etc. for it 9 months ago (in volume - so that we'd have them in time).

But we are working with ArduCam to make fixed-focus versions of the IMX378 now. We should have samples in about 2 weeks.

And we're doing this with the FOV we have now and also wide-ish FOV for some applicability to OAK-D-Pro-W (formerly OAK-WD-Pro).

Also we are working on OV9782 global shutter as the color camera as well.

Thoughts?

Thanks,
Brandon

Brandon
Happy to hear you are considering a fixed focus IMX 378 - i know I would be keen on that myself as I would like to use the OAK-D-POE versions in industrial applications and the current variable focus for me is not ideal due to possible vibration / and pixel size calibration complications. Variable focus may be an advantage for some uses, but it is a disadvantage for others.

A FOV the same as current color FOV is fine. However, you could also consider that if the IMX378 had exactly the same FOV as the depth cameras then it may be easier in software for overlaying depth data and positions onto the RGB image more easily. I am not sure if that is an option available to you. When arducam end up stocking these fixed focus cameras modules it will be great. I would be prepared to uncemented the current camera module and replace it to gain fixed focus.

Hello JohnSymonds,
depth alignment to color camera is already available, see code snippet here. With this alignment we have created this demo (code here) - inference running on color stream, then inference results were applied to depth frames which were cropped accordingly.
Thanks, Erik

Thanks JohnSymonds .

Yes, that's a good point. Likely a lot of applications could benefit from fixed focus. We'll think on this and discuss what would be best here.

Question - do you need the 12MP of IMX378 for color or would say global shutter OV9782 1MP be sufficient?

Brandon I actually need the higher pixel resolution of the IMX378 since I need to perform a digital zoom (via ImageManip crop) to effectively reduce the FOV. (with the camera running in 4K mode to expose the native resolution of the sensor).

I have considered the OV9782 as something I will try sometime - but I haven't got around to ordering any of those modules yet since the drivers are not fully integrated yet.

Off topic, do you have any plans in the future to make enclosures for the OAK-D-CM4 modules - similar in design to the OAK-D-POE enclosure?. I feel like these would improve the usability somewhat for this model which has a lot of potential (as the CM4 can run OpenCV code on the CM4 device, and hence can be used to create standalone networkable smart cameras with in device OpenCV support). You will remember the type of feedback received during the original kickstarter campaign (for the wifi version) which somewhat reinforces the value given to a design with an enclosure.

Hello JohnSymonds ,

I agree that enclosures are extremely valuable and we are working on having enclosures for all our modules. We are currently testing it (WRT wireless connectivity) for our IOT line. I believe that the upcoming OAK-D-POE-CM4 device will also be sold with an enclosure, so as you said it will allow for a standalone networkable smart camera with OpenCV support.

About the rgb-depth alignment - from my testing, it seems to be fairly accurate even at some distance (not perfect, depends on the calibration though). If you would like to know more about this feature I can ask Sachin to elaborate on any concerns you may have. We currently only have the correct modeling for rgb-depth alignment at lens position of 130, since the lens position will affect zoom. We plan on adding support for non-fixed focus as well in the future.

Thanks, Erik

Thanks JohnSymonds this is clutch feedback.

And yes, we learned the hard way that enclosures are super important in this market.

For OAK-D-IoT (which I dumbly named OAK-D-WiFi initially) we recently finished prototyping it and opened tooling for the enclosure design we did based on that feedback. It will be ready likely December-ish and then folks will be able to buy the enclosure for their units:

We did WiFi testing and it seems to be the same with and without enclosure, which was the main reason we didn't do this the first time. (It did take several iterations to make that performance OK; so the concern was valid.)

In regards to a CM4 version with enclosure, yes, agreed. We're working to make such a version. See bellow for the prototype:

More details here:
https://github.com/luxonis/depthai-hardware/issues/53#issuecomment-909527674

Thoughts on this?

We're thinking of doing follow-on of this with M12 connector instead and active illumination (laser and LED) like OAK-D-Pro, here.

Thanks,
Brandon