Switching NN models while runtime

sivaParvathimannem

Hi! I have two different NN models, one is Yolo another is Mobilenet. If oak camera is already running with Yolo model, is it possible to switch Mobilenet model during runtime? and what parameters i can change during runtime? I am using Oak-D PoE by the way.

justincdavis

Are both models compiled for more than 6 shaves such that both cannot be allocated ahead of time? If you create your pipeline with both models (assuming you do not need the shave cores for a single one and you have enough memory) than simply switching the link at runtime will be sufficient.

In terms of routing, I believe you would have to use a script node on the device which based on some other parameter it observes will switch which stream to send data along.

sivaParvathimannem

Thanks for the reply. Both models are compiled for 6 shaves only. Is there any example that i can use to route between the models

jakaskerl

Hi @sivaParvathimannem
Not for two models, but here is a similar example: http://localhost:3000/software/depthai/examples/script_change_pipeline_flow/

Thanks,
Jaka

sivaParvathimannem

jakaskerl
Hi
Thanks for the reply, but i am unable to open the above link. One more thing, i am currently working with depthai-ros driver is it possible to change the models using Ros-driver as well ?
Thanks
Siva

erik

@sivaParvathimannem link here:
https://docs.luxonis.com/software/depthai/examples/script_change_pipeline_flow/

No, ros driver doesn't support that, but you can create custom c++ program and use ros bridge to stream depthai data to ros (ros driver is also built on top of the ros bridge).