Yes actually @msvlavascu in our Discord has done this WebRTC depth streaming:
He's streaming the left/right above but depth could be done instead.
https://github.com/OSSDC/OSSDC-VisionAI-Core
IIRC @Luxonis-Lukasz also did a WebRTC streaming example, but I think he did it with our Gen1 API, and I don't think it's updated yet.
The WebRTC work from @msvlavascu is Gen2.
Thanks,
Brandon
@Brandon the examples from @msvlavascu have many features, so it's pretty hard to find the needed parts for only transmitting the depth data. Is the WebRTC example from @Luxonis-Lukasz open-source? If so, I could probably update it to Gen 2 myself and create a pull request.
Brandon I had a results aggregation server that collected the data from multiple devices in Gen1, but I haven't use WebRTC with DepthAI yet.
I have however used it in another project where I accessed the web camera using JavaScript, sent the video to the server, did inference on the frames and sent these back to the JS client.
I think that we should have the WebRTC experiment along the mjpeg one, so will implement it soon. In the meantime, Gi_T I can give you access to the WebRTC project I did, if you'd like to give it a try yourself (with some explanation how ICEs and offers work if needed)
@Luxonis-Lukasz I would be very interested in the JavaScript code. I'm also willing to help create the DepthAI WebRTC example if you need any help.
Kind regards,
Gilbert Tanner
Gi_T Great, could you reach out to me on Discord or send me an email at lukasz@luxonis.com? Will give you access and provide more background.
Thanks!
@Brandon I mounted my OAK-D on my car today and tried to capture depth data using the depth_preview.py script and OBS, but my results weren't nearly as good as shown in the video (I couldn't detect objects clearly even when they where really close). What is the difference between the depth_preview.py script and the script shown in the video?
Kind regards,
Gilbert
Hello Gi_T,
so this code experiment was used when creating that video: https://github.com/luxonis/depthai-experiments/tree/gen2-replay/gen2-replay (with subpixel mode) in combination with vehicle-detection-adas-0002 NN model. Also the stereo confidence is set to 240 instead of 200 (as in depth_preview script). This actually reminds me that we should change all example codes to 240 conf.
Thanks, Erik
Thanks @erik,
I just tried it out but I'm getting the following error messages.
TypeError: cannot pickle 'depthai.Device' object
and
raise RuntimeError('''
RuntimeError:
An attempt has been made to start a new process before the
current process has finished its bootstrapping phase.
This probably means that you are not using fork to start your
child processes and you have forgotten to use the proper idiom
in the main module:
if __name__ == '__main__':
freeze_support()
...
The "freeze_support()" line can be omitted if the program
is not going to be frozen to produce an executable.