Embedding models into c++ executable

christiangda

Hi depthai folks,

I'm trying to see if I can embed models into my C++ binary. I want to distribute a single executable file that can run on any system without downloading the model files separately.

Do you have any examples, ideas, similar implementations, or documentation on how to do this?

More context:

After reading CPP / C++ - Embed Resources Into Executables I'm using xxd` to generate a header file with the context as


// This file was generated using: xxd -i face-detection-retail-0005_openvino_2022.1_6shave.blob > ../src/AIModels.h

unsigned char face_detection_retail_0005_openvino_2022_1_6shave_blob[] = {

0x7f, 0x65, 0x6c, 0x66, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00, 0x00,

…. // removed lines

};

unsigned int face_detection_retail_0005_openvino_2022_1_6shave_blob_len = 5596659;

the problem is that the c++ library only has two methods to set the blob into the pipeline and these are expecting a path,

so, how can I set the model to the pipeline using the unsigned char face_detection_retail_0005_openvino_2022_1_6shave_blob[]` variable content?

Thanks

erik

Hi @christiangda ,
Looking at the source, you can create Blob obj with vector of uint8 in constructor:

christiangda

erik Amazing, thank you very much

christiangda

christiangda This is working fine, thanks again.

Leaving a partial code here to help others

... // others include files
#include <depthai/openvino/OpenVINO.hpp>
... // others include files
#include "AIModels.h"
... // more code here

auto faceDetNet = pipeline.create<dai::node::MobileNetDetectionNetwork>();
faceDetNet->setConfidenceThreshold(0.7);

std::vector<uint8_t> faceDetectionBlob(face_detection_retail_0005_openvino_2022_1_6shave_blob,
                                           face_detection_retail_0005_openvino_2022_1_6shave_blob + face_detection_retail_0005_openvino_2022_1_6shave_blob_len);

dai::OpenVINO::Blob netBlob = dai::OpenVINO::Blob(faceDetectionBlob);
faceDetNet->setBlob(netBlob);
faceDetNet->input.setBlocking(false);
... // more code here