IR night vision with NN detection (SDK)

npeditto

Hi All,

I'm trying to create an example app using the SDK that combines IR functionality (for night vision) with object detection (using mobilenet-ssd). Is this possible?

This is part of my example:


        with OakCamera() as oak:

            left = oak.create_camera('left')
            right = oak.create_camera('right')
            stereo = oak.create_stereo(left=left, right=right)
            stereo.set_auto_ir(auto_mode=True, continuous_mode=True)

            nn = oak.create_nn('mobilenet-ssd', stereo.out.encoded)  

            oak.visualize(nn)
 
            oak.start(blocking=True)

The error is:

'input' argument passed on init isn't supported!You can only use NnComponent or CameraComponent as the input.

jakaskerl

npeditto
I feel like you can't use encoded input to the NN as the bitstream can not be interpreted by the NN node. Use default stereo - though I am not sure if this is what is intended. Do you have a model that is capable of running detection on a depth map?

Thanks,
Jaka