I was trying to see if I could do this with a single camera, but after having just received my oak-d lite, I figure I may post my question here.
I am able to get the pose of an ArUco marker, detect the tip of my index finger, then draw a line from a target_corner of the marker to the finger point, using OpenCV and MediaPipe, as seen in the image below.
Now, with my oak-d lite, I would be curious how to get the [x, y, z] world coordinates of the finger point, relative to the target_corner, where I could use target_corner as the origin for a coordinate system, the side of the marker as the unit vector, and the plane (ArUco marker) would lie at z = 0?
