Segment Anything Model (SAM) running at OAK

LucasRambo

I am trying to run SAM in a model with OAK. But I can´t convert the model to a blob file. Using the blob converter tool, the following error occurred.

I am using the vit_h model (with I was able to convert to a onnx model and input that model to blob converter).

LucaLucas

Hey, I'm also trying to run SAM on the oak-d. Were you able to get it to work in the end?

From the error, it looks like onnx doesn't support that layernorm layer. But it should be added as of onnx 17 (onnx/onnxreleases/tag/v1.12.0) which was published before your initial post. Perhaps your version is outdated, or the layernorm in SAM is slightly different than the one there?

jakaskerl

Hi @LucaLucas
Or maybe it can be switched to some other normalization layer that is supported.

https://docs.openvino.ai/2022.3/openvino_docs_MO_DG_prepare_model_Supported_Frameworks_Layers.html

Thanks,
Jaka

LucasRambo

At the time of the post, I ended up being able to use SAM in other ways. Thank you very much for these references, now I understand better what happened.

Gianlucaiit

LucasRambo Hi, how do you succeeded in converting into blob file? Because I get the same error.