Loading custom networks to the DepthAI OAK-D

nickjrz21

Hi Luxonis team,

I was wondering if it was possible to load custom models to the depthAI OAK-D camera such as FlowNet 2.0 or PWCNet to do optical flow estimation. I have been reading through the documentation and these network architectures do not seem to be supported by the Myriad plugin on OpenVINO. Are there any workarounds to using these networks on the device?

Thanks,
Nick

erik

Hello nickjrz21,
from quick search, it doesn't seem many tried to achieve the same as you. From openvinos docs, there's a bullet point pwcnet - converts output of PWCNet network to OpticalFlowPrediction., so this might be possible by the openvino. I would suggest checking our documentation about model conversion, especially the Troubleshooting part, which you might need if you want to make these models available for depthai devices (eg. OAK-D).
Thanks, Erik

nickjrz21

Hi erik

Thanks for your prompt reply, I will definitely look into that. It seems openVINO supports the actual network structure for optical flow but my concern is if the Myriad plugin will be able to handle the network architecture. I will review the layers of the PWC-net to see if the are any layers that are not supported on openVINO.

Thanks,
Nick