night-depth vision w/ body|skeleton tracking

moscardo

Hi everybody,
I'm new to this forum, same for OAK products | Depth AI world even if I have a little experience with OpenCV.

I would like to start making some test myself with some OAK camera but I would like to ask some question before in order to find the better product (and documentation) for my needs before.

I would like to use the camera in a low-light environment and detect the profiles (or perhaps better skeletons) of the individuals present within the environment (more than one).

I know this is a very general question and probably needs further specification, but:

what would be a suitable sensor for my needs?
And what code examples/documentation already exist that come close to the working mechanism I am imagining?

Afterwards, the collected data should then be forwarded to other software components to do further analysis and use this information to render real-time graphics and sound in accordance with the patrons' movements.

Thank you so much for your support
moscardo

erik

Hello moscardo ,
For low-light environment, I would suggest using the Pro series, as it has flood IR LED, so "night vision" functionality. This would mean that the images would be grayscale, so NN models might not perform the best, and retraining would be needed.

Here are also a few NN models implemented with DepthAI:

Thoughts?
Thanks. Erik

moscardo

erik Thank you so much for your reply,

I think I will opt for a Pro camera as you said. I will also look for the PoE version, if available, so as to place it even further away from the control PC.

On Mouser, I see that the OAK-D Pro PoE will be available from August 2022 and unfortunately only in a limited number of units, so I think they are all booked up or not in time to get it.
Maybe I can start making some experiment with the OAK-D Poe (not Pro) in the meantime...

If I can ask you some more question I'll list them here below, but, since there are many and they are not very relevant to the topic of this forum intervention, let me know if it would be better for me to send an e-mail instead (to which address? maybe to support@luxonis.com?):

I think in testing I will use it with a PoE injector rather than a PoE switch, so since the link in the documentation seems broken, which type of PoE injector should be used?
on the camera side, from the image I see some kind of special connector or a black cable clamp, but in the tutorial I see instead that the RJ45 plugs directly into the camera. Should I plan to buy a special connector or prepare to solder an ad-hoc one?

Since, if the product turns out to meet my needs, it is very likely that I will want to adopt it as a default alternative to the products I have been using so far (Kinect, Realsense), I would feel very secure in knowing that, this product:

will remain on the market for quite some time and
in larger quantities in stock,
that the code and tutorials will continue to be expanded and enriched,
that technical support will remain available and operational over time.

Do you have any information on this?

Let me know and thank you for your patience and support.

erik

Hi moscardo ,
I think these cams should be available sooner on our shop, so maybe check there as well🙂
Feel free to ask any/all questions here.

Could you share where you found this link, so we can quickly fix it? The correct url is here.
So OAK-D-POE and OAK-1-POE have standard RJ45 connector. Our Series 2 POE cameras (OAK-D S2 POE, OAK-D PRO POE, OAK-D W POE, OAK-D PRO W POE) have M12 ethernet connector. We ship these cameras together with M12-RJ45 cable (M12 connector connects to camera, RJ45 connector connects to POE switch/injector). Thoughts?
We plan to never EOL our cameras (docs here)
We can scale our production quickly depending on the demand. We have secured hard-to-get components to produce a few tens of thousands of cameras, and can secure additional stock depending on the demand.
Even on our next-gen devices (Series 3 with KeemBay, docs here) the depthai library will be backwards compatible - so all demos/tutorials and code you wrote will work - and the library will constantly get improved. Oh and we are extremely excited for the Keem Bay, as it will allow our users to build so many cool projects that are currently not possible!
We believe that great support is essential for our success - so it will for sure be available in the future as well.

Thoughts on the above?
Thanks, Erik

moscardo

Thank you @erik for your super clear and comprehensive answer in all aspects.
I will take some time to go through them all and make my evaluations. Thank you!

In particular, in relation to your question about the corrupted link, here is a screenshot and here is the page to reach it directly.

Thanks again for your support,
so I reserve the right to come back and write here if I have any further doubts or questions.
See you soon!

erik

Hello moscardo , I'm glad it was helpful, and thank you for the link! We will ask OpenCV team to fix the link.
Thanks again, Erik