• DepthAI-v2

  • How to use YOLOv5n-seg for object segmentation with OAK1/OAK-D?

Hi @jakaskerl

The output generated by the code sample you provided (segmentation_map) holds a OpenCV Mat of a single color (like a mask that covers the entire frame), instead of drawing the individual segmentation masks surrounding the objects in the scene.

5 days later

Hi @daniqsilva,

apologies for the delay in our response. Currently our tools support the conversion of only object detection models. We are also actively working on supporting instance segmentation Yolo models. However, we don't have any ETA yet. Could you please elaborate on how you converted the model using our tools? Did you edit the model in some way?

Best,
Jan

Hi @JanCuhel,

I converted the model using http://tools.luxonis.com. I didn't edit the model in any way. I assumed that segmentation was supported at least for YOLOv5 since, in your conversion tool, when I check the "Yolo version" list, YOLOv5 appears without the "detection only" label like YOLOv7 or YOLOv8.

Best regards,

Daniel

Hi @daniqsilva,

I see; it's interesting that the conversion didn't fail.

I apologize, but as I said, currently, http://tools.luxonis.com doesn't support the conversion of segmentation models for any Yolo version. We are actively working on supporting it. As soon as we add it, we'll let you know. Until then, unfortunately, you will have to convert the model partially manually with the help of our blobconverter or use a different segmentation model.

I am very sorry for the unclear description of the conversion options and that I can't help you more now.

Best,
Jan

Hi @JanCuhel,

Thank you for your feedback!

I will be waiting for an update on this matter. In the meantime, I will try other approaches.

Best regards,

Daniel

a month later

Hi @daniqsilva @JanCuhel ,

Did you find an alternate approach to run instance segmentation models in the OAK devices? Is there any other model architecture that is supported by oak (which can be loaded with a model trained on custom data)? I also want to get the depth (z - axis) value along with the center (X, Y) points and segmentation masks array. By when could the on device support for yolo segment models be included @JanCuhel ?

Hi @u111s ,

So far I have no developments regarding running inference with YOLO-based instance segmentation models in OAK devices. The only approach that I've found was this one.

    Hi!

    Maybe it will help:

    "The only approach that I've found was this one.">>> Here use tensorflow 1.15 and below version 2 is no longer supported in google colab. Last TF version (2.16) it is not possible to convert with openvino and blobconverter. It's an eternal labyrinth

    Pytorch is the only option for Mobilenet and depthai.

    The ideal is yolo5
    It works better than mobilenet, it is quick to train and convert with tool.luxonis

      EmilioMachado

      Thank you for the video suggestion!

      Yeah, YOLOv5 or YOLOv8 are preferable for the reasons you mentioned, but as @JanCuhel said earlier in this thread, so far tool.luxonis.com is unable to convert YOLO segmentation models for OAK devices.

        7 months later