Hi @all, Is it possible to rotate camera lens by 90 degrees programmatically? We have below options, I don't see 90 DEG... class depthai.CameraImageOrientation Members: AUTO NORMAL HORIZONTAL_MIRROR VERTICAL_FLIP ROTATE_180_DEG Thanks & Best Regards, Ram

Hi @"ramkunchur"#p1578 , I do not think this is currently supported. The other rotations I believe are being done on by the image sensor itself (changing the readout/etc.). That said, I'm not sure if the Image Manip node can be used for this. Looking. Thanks, Brandon

On the subject of Image Manip - we will be adding quite a bit of functionality soon-ish, with the efforts below starting likely at the end of this month: https://github.com/luxonis/depthai/issues/376 That said, it looks like you can use Image Manip now to rotate an image 90 degrees: https://docs.luxonis.com/projects/api/en/latest/components/nodes/image_manip/ [URL=https://i.imgur.com/ihet5jd.png][IMG]https://i.imgur.com/ihet5jdh.png[/IMG][/URL] That said, I don't immediately see the function. Asking @"erik"#175 . Thanks, Brandon

Hello @"ramkunchur"#p1578 , here's a [minimal demo code](https://gist.github.com/Erol444/73383c07df936608bb7041790522dc16) that achieves rotating of the frame with ImageManip. You could also use `colorCamera` instead of mono camera - you would just need to change the values of the `dai.RotatedRect` (center and size) according to the resolution. I hope this helps! Thanks, Erik

Hi @"Brandon"#p1581 and @"erik"#p1584 . Thanks so much for the information... I'm trying to implement camera rotation to 90 degrees using specified method using colorCamera Below is code snippet, I get an error, seems there is unknown property error. pipeline = depthai.Pipeline() if camera: print("Creating Color Camera...") cam = pipeline.createColorCamera() # code to rotate camera by 90 degrees - start manip90 = pipeline.createImageManip() rr = depthai.RotatedRect() rr.center.x, rr.center.y = cam.getResolutionWidth() // 2, cam.getResolutionHeight() // 2 rr.size.width, rr.size.height = cam.getResolutionHeight(), cam.getResolutionWidth() rr.angle = 90 manip90.initialConfig.setCropRotatedRect(rr, False) cam.out.link(manip90.inputImage) # problem with this line... # code to rotate camera by 90 degrees - end cam.setPreviewSize(300,300) cam.setResolution(depthai.ColorCameraProperties.SensorResolution.THE_1080_P) cam.setInterleaved(False) cam.setBoardSocket(depthai.CameraBoardSocket.RGB) cam_xout = pipeline.createXLinkOut() cam_xout.setStreamName("cam_out") cam.preview.link(cam_xout.input) Error message as below: cam.out.link(manip90.inputImage) # problem with this line... AttributeError: 'depthai.ColorCamera' object has no attribute 'out' Requesting your kind help here.. Please let me know if my implementation is correct and also how to resolve this error. **I need to simply implement the following: The camera is placed horizontally, so need to rotate it to 90 degrees so that straight image is captured... This needs to happen both at sending image for inference and the one which we display finally in imshow method.** Thanks & Best Regards, Ram

Hello @"ramkunchur"#p1586, the [colorCamera](https://docs.luxonis.com/projects/api/en/latest/components/nodes/color_camera/) doesn't have `out` output, you should use `preview` instead. Please refer to our [documentation](https://docs.luxonis.com/projects/api/en/latest/components/nodes/color_camera/) for more information. I just tried it out with color camera instead of mono but it doesn't seem like it's working correctly ([code here](https://gist.github.com/Erol444/4659af8c53db5462673e3fb340622f9c)). We are investigating this further and it should be fixed this week, we apologize for the inconvenience. Thanks, Erik

Hi @"erik"#p1587 Thanks a lot for your quick response, really appreciate it. I'll wait for an update about the fix. Thanks & Best Regards, Ram

Hello @"ramkunchur"#p1588 , sorry for the troubles, it turns out I was incorrect - rotating color frames is already available, the width of the (input) frame just has to be in **multiples of 16**. Here's a [minimal example code](https://github.com/luxonis/depthai-python/blob/imagemanip-rotating-mono/examples/image_manip_rotate.py). Thanks, Erik

Hi @"erik"#p1591 , Thanks so much. I have come across another issue now, since I set preview to multiples of 16 i.e (640,400) originally it was (300,300) **cam.setPreviewSize(300,300)** changed to... **cam.setPreviewSize(640,400)** Inference doesn't work due to above changes, I tried to reset (300,300) to (640,400) in all other instances, inference doesn't work. Can you please tell me how I should adjust in other instances after changing preview size to 640,400? I also tried to change to (640,640) in all instances, get following error: **[NeuralNetwork(2)] [warning] Input image (640x640) does not match NN (300x300)** Need your help with this last step. Thanks & Best Regards, Ram

Hello @"ramkunchur"#p1593, here I quickly prepared a [minimal solution](https://gist.github.com/Erol444/4cead08da26adb1fddf4d7a8ec2d66e2) to achieve that. It uses another ImageManip to crop the frame into 300x300. You could also use cropping on the first imageManip, but for some reason, the output frame doesn't keep its aspect ratio (it gets stretched). Thanks, Erik

Hi @"erik"#p1596 Thanks so much for detailed help. The program doesn't seem to run... nothing happens Could you please check once? Thanks & Best Regards, Ram

Rotate camera by 90 DEGREES

erik

Hi chandrian ,
For UVC, I believe the current limitation is that frames need to be 720P and in NV12 format, so you would likely need to rotate the image after retrieving it on the host, or use some other option (eg streaming via dephtai library, then creating virtual camera on the host). Would that work for your application?
THanks, Erik

chandrian

erik

Thanks erik you've been so helpful on this. I dont think we can flip it after the host has it... I think the idea was to rotate it so that it has more height to work with in the frame analyzing.

chandrian

What size is the image coming out?

What does this crop do?:
crop_manip = pipeline.create(dai.node.ImageManip) crop_manip.initialConfig.setResize(300, 300) crop_manip.initialConfig.setFrameType(dai.ImgFrame.Type.BGR888p) cam.isp.link(crop_manip.inputImage) crop_manip.out.link(mobilenet.input)

chandrian

~~I think the idea was to rotate it so that it has more height to work with in the frame analyzing.~~
This was the wrong assumption above. I think I can just make the face-detection-crop more tall than long and I'll be ok. It is hard to follow the dimensions.

chandrian

Is it possible to crop into a different (smaller) size image for the face tracker? Where in the code does it need to be 1920x1080? before or after the script running?

erik

Hi chandrian ,

The image should be full HD if you are using depthai with UVC pipeline (docs here).
The code snippet resizes input frame to 300x300 and converts it to 8bit BGR format.
Yep that should be possible🙂
Can you please share what exactly you want to achieve?

Thanks, Erik

chandrian

Thanks again for the response Erik. Basically we need to zoom in on the person like this and crop to this more vertical size.

erik

Hi chandrian ,
with UVC mode this (currently) isn't possible, as UVC node needs full hd images. You could, however, stream exact same image but rotated by 90deg. Thoughts?
Thanks, Erik

chandrian

Yes I attempted that but was not successful. Can you give me general instructions of where to implement that? The problems I faced were that the UVC needed 1920x1080 and when I rotated that, it was 1080x1920, and that the face recognition did not work when the camera was rotated 90 degrees.

Thanks,
Aaron

erik

Hi chandrian ,
I assume you are using something similar to Lossless Zooming. So first you would want to rotate the frame 90deg (so people are upright), do the face detection, crop the original (rotated) 4k image into 1080x1920 (as in the lossless zooming example), then rotate that to 1080P, which you can feed into the UVC node. Thougths?
Thanks ,Erik

chandrian

Ok so this wouldnt be in the script then. I realize script is mostly for changing the pipeline anyway. Yes that sounds like a plan for me. I will attempt and let you know. Thanks!!

I will probably need to remove this before the rotate then? : cam.setVideoSize(1920, 1080)

erik

Hi chandrian , by default you will want to rotate the images by 90deg. So you will likely want 4k, then rotate it by 90deg, then do inference, then crop, then rotate back by -90deg to get to 1920x1080.

chandrian

Ok thanks! Is all of this happening in before the script node? Or is that unnecessary.

chandrian

And how does the script node work in terms of code path. I see a "while true" in the script with no breaks and a while true after the script. do they run in parallel?

chandrian

I tried keeping the same dimensions as my working code and just flipping twice and I didnt not get an output stream and then I tried a zero degree turn twice and still no stream. Am I messing something up here:

        manipRgb = pipeline.createImageManip()
        rgbRr = dai.RotatedRect()
        rgbRr.center.x, rgbRr.center.y = cam.getPreviewWidth() // 2, cam.getPreviewHeight() // 2
        rgbRr.size.width, rgbRr.size.height = cam.getPreviewHeight(), cam.getPreviewWidth()
        rgbRr.angle = 0
        manipRgb.initialConfig.setCropRotatedRect(rgbRr, False)
        cam.preview.link(manipRgb.inputImage)

        manipRgb2 = pipeline.createImageManip()
        manipRgb2.initialConfig.setCropRotatedRect(rgbRr, False)
        manipRgb.out.link(manipRgb2.inputImage)

        # Create an UVC (USB Video Class) output node. It needs 1920x1080, NV12 input
        uvc = pipeline.createUVC()
        manipRgb2.out.link(uvc.input)

chandrian

I actually cant get the cam.video to go through any manipulation node and into the UVC

chandrian

I tried passing the cam.video into the manip node and into the uvc. Then I tried setting the preview to 1920x1080 (is that a possible size?) and feeding that into the manip node and into uvc and I still could not get that working either.

erik

Hi chandrian ,
With the new depthai you can also use cam.video with ImageManip. I believe we plan to update the depthai uvc branch to latest, so you will be able to achieve this. Regarding the issue, please submit the full MRE.
Thanks, Erik

chandrian

Ok I will try to submit that. I have a deadline soon so I am not sure that will be done in time. Do you think it would be possible to rotate the facial recognition input so that, if the camera is 90 rotated, it will still recognize faces? ~~I will try that today but no luck so far.~~ Actually I think its working now.. more details to come
Thanks,
Aaron

edit:
~~Facial recognition seems to be working (blue square coming up) but not tracking at this moment.~~
edit2:
I think the blue squares were windows camera app tracking face, not the depthai.

chandrian

I am not having much success with rotating the input to the facial recognition. Do you think this is possible? If not, do you have another suggestion?

erik

Hi chandrian , yes it should be possible.

« Previous Page Next Page »