Hi chandrian ,
For UVC, I believe the current limitation is that frames need to be 720P and in NV12 format, so you would likely need to rotate the image after retrieving it on the host, or use some other option (eg streaming via dephtai library, then creating virtual camera on the host). Would that work for your application?
THanks, Erik
Rotate camera by 90 DEGREES
Thanks erik you've been so helpful on this. I dont think we can flip it after the host has it... I think the idea was to rotate it so that it has more height to work with in the frame analyzing.
What size is the image coming out?
What does this crop do?:
crop_manip = pipeline.create(dai.node.ImageManip)
crop_manip.initialConfig.setResize(300, 300)
crop_manip.initialConfig.setFrameType(dai.ImgFrame.Type.BGR888p)
cam.isp.link(crop_manip.inputImage)
crop_manip.out.link(mobilenet.input)
I think the idea was to rotate it so that it has more height to work with in the frame analyzing.
This was the wrong assumption above. I think I can just make the face-detection-crop more tall than long and I'll be ok. It is hard to follow the dimensions.
Is it possible to crop into a different (smaller) size image for the face tracker? Where in the code does it need to be 1920x1080? before or after the script running?
Yes I attempted that but was not successful. Can you give me general instructions of where to implement that? The problems I faced were that the UVC needed 1920x1080 and when I rotated that, it was 1080x1920, and that the face recognition did not work when the camera was rotated 90 degrees.
Thanks,
Aaron
Hi chandrian ,
I assume you are using something similar to Lossless Zooming. So first you would want to rotate the frame 90deg (so people are upright), do the face detection, crop the original (rotated) 4k image into 1080x1920 (as in the lossless zooming example), then rotate that to 1080P, which you can feed into the UVC node. Thougths?
Thanks ,Erik
- Edited
Ok so this wouldnt be in the script then. I realize script is mostly for changing the pipeline anyway. Yes that sounds like a plan for me. I will attempt and let you know. Thanks!!
I will probably need to remove this before the rotate then? : cam.setVideoSize(1920, 1080)
- Edited
Ok thanks! Is all of this happening in before the script node? Or is that unnecessary.
And how does the script node work in terms of code path. I see a "while true" in the script with no breaks and a while true after the script. do they run in parallel?
I tried keeping the same dimensions as my working code and just flipping twice and I didnt not get an output stream and then I tried a zero degree turn twice and still no stream. Am I messing something up here:
manipRgb = pipeline.createImageManip()
rgbRr = dai.RotatedRect()
rgbRr.center.x, rgbRr.center.y = cam.getPreviewWidth() // 2, cam.getPreviewHeight() // 2
rgbRr.size.width, rgbRr.size.height = cam.getPreviewHeight(), cam.getPreviewWidth()
rgbRr.angle = 0
manipRgb.initialConfig.setCropRotatedRect(rgbRr, False)
cam.preview.link(manipRgb.inputImage)
manipRgb2 = pipeline.createImageManip()
manipRgb2.initialConfig.setCropRotatedRect(rgbRr, False)
manipRgb.out.link(manipRgb2.inputImage)
# Create an UVC (USB Video Class) output node. It needs 1920x1080, NV12 input
uvc = pipeline.createUVC()
manipRgb2.out.link(uvc.input)
I actually cant get the cam.video to go through any manipulation node and into the UVC
I tried passing the cam.video into the manip node and into the uvc. Then I tried setting the preview to 1920x1080 (is that a possible size?) and feeding that into the manip node and into uvc and I still could not get that working either.
- Edited
Ok I will try to submit that. I have a deadline soon so I am not sure that will be done in time. Do you think it would be possible to rotate the facial recognition input so that, if the camera is 90 rotated, it will still recognize faces? I will try that today but no luck so far. Actually I think its working now.. more details to come
Thanks,
Aaron
edit:
Facial recognition seems to be working (blue square coming up) but not tracking at this moment.
edit2:
I think the blue squares were windows camera app tracking face, not the depthai.
I am not having much success with rotating the input to the facial recognition. Do you think this is possible? If not, do you have another suggestion?