Limitation of streaming frames over SPI?

wajeeha77

Currently, the bottleneck for some use cases is the SPI throughput, which is about 1MB/s (8Mbps). This means that you can stream frames over the SPI, just not high-resolution / unencoded streams.
This means over the wifi, we will not be able to stream not high resolution camera stream??

erik

Hello wajeeha77 ,
You won't be able to stream high-res non-encoded streams. You can encode video stream (eg. H265) on the device, stream it over SPI to ESP32, and then stream it over the WiFi.
In other words, if some degradation of quality (due to encoding) isn't an issue, then you can still stream high res camera streams in realtime over the wifi.
Thanks, Erik

wajeeha77

erik thankyou so much erik, correct me if I am wrong, HD video stream( 1080p )will be encoded on OAK IOT (with some degradation)and then can streamed over the wifi through esp32 in realtime.

erik

Hello wajeeha77 ,
Yes, it will be first streamed from VPU (Myriad X) to ESP32 (max 8Mbps throughput) and then from ESP32 via WiFi. We also have an example of this here.

(docs here).
Thanks, Erik

wajeeha77

And if I want to program it with my own AI models, I will be needing a host laptop, after I have flashed the models using bootloader, I can completely use it in standalone mode, and stream the results over the wifi or any cloud platform. Right?

erik

Hello wajeeha77 , Yes, that's correct, when flashing pipeline it will also flash all assets (like AI models) that will then run in standalone mode. If you need faster responses please consider asking questions on our Discord server.
Thanks, Erik

wajeeha77

Please reply.

wajeeha77

Thankyou so much:👍👍