depthai SDK 1.9.2 Gaze Estimation

rexn8r

hello

is it possible to integrate gaze estimation with depthai sdk 1.9.2?

I did try following code;

from depthai_sdk import OakCamera
import blobconverter

with OakCamera() as oak:
    color = oak.create_camera('color')
    path = blobconverter.from_zoo("gaze-estimation-adas-0002", shaves=4,
        compile_params=['-iop head_pose_angles:FP16,right_eye_image:U8,left_eye_image:U8'],
    )
    nn = oak.create_nn(path, color)
    oak.visualize([nn], fps=True)
    oak.start(blocking=True)

**following error thrown;**

Traceback (most recent call last):
  File "test.py", line 11, in <module>
    oak.start(blocking=True)
  File "C:\ProgramData\Anaconda3\lib\site-packages\depthai_sdk\oak_camera.py", line 268, in start
    self.build()  # Build the pipeline
  File "C:\ProgramData\Anaconda3\lib\site-packages\depthai_sdk\oak_camera.py", line 354, in build
    component._update_device_info(self._pipeline, self._oak.device, self._pipeline.getOpenVINOVersion())
  File "C:\ProgramData\Anaconda3\lib\site-packages\depthai_sdk\components\nn_component.py", line 136, in _update_device_info
    raise NotImplementedError()
NotImplementedError

I would like to use depthai sdk to detect person and use gaze estimation for heat map creation functionality.

is it possible?

thanks

erik

Hi rexn8r ,
Your approach was a bit optimistic - SDK is smart, but not that smart. To implement gaze estimation with SDK you would need to implement quite a few models and features (in the SDK). Feel free to look into the source code of it (on depthai repo on github) and perhaps add those, otherwise I would suggest just sticking with the depthai API demo.
Thanks, Erik