Hi all, I just successfully converted my saved model (.pb) trained in a TF2 framework to both ONNX (.onnx) and IR (.xml and .bin). I tried converting the ONNX one to a .blob file directly using this [conversion web app](http://blobconverter.luxonis.com/), so I could deploy my custom object detection model on my OAK camera, but it kept failing: [upl-image-preview url=https://discuss.luxonis.com/assets/files/2023-08-09/1691589965-122124-screen-shot-2023-08-10-at-20555-am.png] [upl-image-preview url=https://discuss.luxonis.com/assets/files/2023-08-09/1691589998-72531-screen-shot-2023-08-10-at-20629-am.png] [upl-image-preview url=https://discuss.luxonis.com/assets/files/2023-08-09/1691590018-491818-screen-shot-2023-08-10-at-20651-am.png] Previously I was converting IR to a .blob, and still failed. I am not sure if there is any problems with the input nodes in my model: [upl-image-preview url=https://discuss.luxonis.com/assets/files/2023-08-09/1691590068-6616-screen-shot-2023-08-10-at-20738-am.png] Now I really have no ideas if I should adjust my model architecture (this is a custom efficientdet-d0 model for object detection), or find a better way converting to a .blob file. Here I upload some model files so you could have a look: [link](https://github.com/KoKonutZzz/tf2_object_detection) Many thanks, Austin

Hi Austin, I am happy to hear that your YOLOv5s model is working! Yeah, with the EfficientDet model, there must be some troublesome layers that are causing the export to fail (maybe it could be because of the `Loop` layer, which object detection models usually don't have). Best, Jan

Hi @"YWei", could you please provide us with the arguments that you've used to convert the model into ONNX and IR? Thanks, Jan

@"YWei"#p10958 Are you using TF Object detection API? If yes, which version? You best bet to compile it would be to follow this: https://docs.openvino.ai/2022.1/openvino_docs_MO_DG_prepare_model_convert_model_tf_specific_Convert_EfficientDet_Models.html. Please use 2022.1 OpenVINO version. If you are using TF1, then you will have to use Python 3.6 or 3.7 I believe. Also, the model need to be frozen or full directory needs to be provided. > File with a pretrained model (binary or text .pb file after freezing) OR **`saved_model_dir `** for the TensorFlow 2 models

Hi @"JanCuhel"#p10988 This is how I converted my saved model (.pb file) to IR, hope it helps: (csl-load-count-ml) csl@CSL-MacBook-Pro \~ % mo --saved_model_dir /Users/csl/Documents/TF-dirt-overflowing-detection/fine_tuned_model/saved_model/ [ INFO ] The model was converted to IR v11, the latest model format that corresponds to the source DL framework input/output format. While IR v11 is backwards compatible with OpenVINO Inference Engine API v1.0, please use API v2.0 (as of 2022.1) to take advantage of the latest improvements in IR v11. Find more information about API v2.0 and IR v11 at https://docs.openvino.ai/latest/openvino_2_0_transition_guide.html [ INFO ] IR generated by new TensorFlow Frontend is compatible only with API v2.0. Please make sure to use API v2.0. Find more information about new TensorFlow Frontend at https://docs.openvino.ai/latest/openvino_docs_MO_DG_TensorFlow_Frontend.html [ SUCCESS ] Generated IR version 11 model. [ SUCCESS ] XML file: /Users/csl/saved_model.xml [ SUCCESS ] BIN file: /Users/csl/saved_model.bin Regards, Austin

@"Matija"#p10991 Thank you for your reply, it seems really helpful. Just two things I want to double check with you please: * Do I have to freeze my .pb model no matter I am using TF1 or 2? * There is no content about converting it to a .blob in the documentation you shared. Does it mean it would be pretty easy for me to convert it to a .blob file using any ways finally (such as the web converter, or several code lines in Python)? Regards, Austin

Hey @"YWei"#1436 , You can try using saved_model directly. Though according to the docs you should be able to freeze the saved model using `mo --runmode=saved_model --model_name=efficientdet-d4 --ckpt_path=efficientdet-d4 --saved_model_dir=savedmodeldir` Then I would expand you command for generating IR with the following flags: * `--transformations_config=/lib/python3.8/site-packages/openvino/tools/mo/front/tf/automl_efficientdet.json`\` (please use correct path to env) * `--input_shape "[1,512,512,3]"`\` (or whatever your actual input shape is)

You could then use blobconverter and just pass the xml and bin to it. It should generate a proper blob. If it fails, please share the revised files generated using the above flags here.

@"Matija"#p10994 Thanks. I reckon we might replace the model_name 'efficientdet-d4' with 'efficientdet-d0' in your recommended command line? As efficientdet-d0 model was my config during training, or it doesn't matter at all? I will have a try anyways :) Cheers

Yeah, it's just the name here so it doesn't matter. But might be best to rename it to d0 for consistency and to avoid any confusion ;)

Hi @"Matija"#p11005 Sorry to bother you again. Another issue when trying this: ``` (tf-openvino) cloudscapespare@Cloudscapes-MacBook-Pro ~ % mo --runmode=saved_model --model_name=efficientdet-d0 --ckpt_path=efficientdet-d0 --saved_model_dir=savedmodeldir --transformations_config=/Users/cloudscapespare/anaconda3/envs/tf-openvino/lib/python3.7/site-packages/openvino/tools/mo/front/tf/automl_efficientdet.json --input_shape "[1,512,512,3]" Traceback (most recent call last): File "/Users/cloudscapespare/anaconda3/envs/tf-openvino/bin/mo", line 5, in from openvino.tools.mo.__main__ import main ModuleNotFoundError: No module named 'openvino' (tf-openvino) cloudscapespare@Cloudscapes-MacBook-Pro ~ % mo --runmode=saved_model --model_name=efficientdet-d0 --ckpt_path=efficientdet-d0 --saved_model_dir=savedmodeldir --transformations_config=/Users/cloudscapespare/anaconda3/envs/tf-openvino/lib/python3.7/site-packages/openvino/tools/mo/front/tf/automl_efficientdet.json --input_shape "[1,512,512,3]" Traceback (most recent call last): File "/Users/cloudscapespare/anaconda3/envs/tf-openvino/bin/mo", line 5, in from openvino.tools.mo.__main__ import main ModuleNotFoundError: No module named 'openvino' ``` In terms of the openvino 2022.1 version, do you mean I should install the openvino-dev 2022.1, as this is the only option I can download (for MacOS): [upl-image-preview url=https://discuss.luxonis.com/assets/files/2023-08-10/1691677986-490087-screen-shot-2023-08-11-at-23259-am.png] That just confused me now. I have no ideas how can I get the openvino module. Any suggestions please? Cheers, Austin

Error when converting a .onnx file to a .blob file

YWei

Hi Jan,

Yeah I guess so. Anyway it's been a great lesson for me about how to select a model better. And thank you and all of your team mem :bers for being stick around with my problems these days. I've learnt a lot!!

Best,

Austin

JanCuhel

Hey,

no problem! We are glad we could help!

Best,

Jan

« Previous Page