Myriad X Stereo Depth (Uncalibrated) and Feature Tracking

Brandon

Hey guys,

So we got hardware depth and video tracking working. It's not calibrated depth yet (so that's why it doesn't look so great - it's using a unity 3x3 homography matrix). But it's working! (Caveat on that, it's still buggy and crashes on startup 9/10 times, but the 1/10 is so satisfying!)

But to re-iterate, all the calculation shown in the video is being done on the Myriad X (depth calculation and feature tracking). The host is doing nothing (other than just displaying the data that the Myriad X is streaming, which is optional).

The nice part is the Myriad X doesn't even get warm doing this. And that's with zero heatsink. Just the chip exposed to ambient air.

And for more reading check out our hackaday.io project and commuteguardian.com, as it's the end-goal of this work.

Best,
Brandon

Brandon

Oh, and our calibration attempts are currently seg-faulting. So we're trying to figure out what's going wrong there. Anyone ran a C++ debugger on C++ code that's called by Python? I haven't...

hanooi

I can see the point cloud in the example. What Myriad X solution is generating that? Is it the Intel Realsense or your Myriad X dev board from Intel?

Afrath

Hi Brandon, Congratulations!!, i like the idea of converting Myriad USB type device to carrier board. it definitely unlock the power of myriad X. I'm playing with NCS stick + rpi3 for quite sometime and i feel direct access to myriad X could always improve the performance of your object detection. sorry to trouble you but i have few questions for which i would like to get a reply from you.

Do you see performance increase of mobilenet SSD taking input directly from Myriad X mipi camera? compared to the same mobilenetSSD taking input from rpi3 camera over USB ?
Do you have any plans to release the carrier board for others?

Brandon

Hi Afrath!

We don’t have this working yet... but it should up the framerate from say 8FPS to over 30FPS. We expect to have this working around late June, which is when we plan to first offer the boards for sale.
Yes we’d be open to releasing carriers for other neural accelerators. Right now we’re only planning on the Myriad X, but say the Intuitive NU4000AI would be awesome as well.

elforce001

Brandon Nice! Would you have pricing for startups too? My startup is trying to develop CV services and we're having issues finding a good board to fit our general case.

Brandon

Certainly. So elforce001 shoot me an e-mail at brandon at luxonis dot com and we can take it from there. Our new module design (rendering below, we haven't ordered it quite yet) will probably fit well.

Quick specs:

Up to 3x MIPI cameras
USB connection to host (i.e. doesn't use up a PCIE slot/doesn't require host w/ PCIE)
To supports neural inference and disparity depth direct from the image sensors.

And we're making a main board that will host this module and also the Raspberry Pi Compute Module, allowing the ease of the Raspberry Pi with the speed of the Myriad X.

Cheers,
Brandon