"the external ONNX file data" to NNModel Instance

Unity Engine
,
1

I would like to read the external ONNX file of ML-Agent and import it during runtime.

The code I wrote is as follows.

7477069--919337--upload_2021-9-7_12-0-12.png
7477069--919337--upload_2021-9-7_12-0-12.png1005×280 21.2 KB

save me.

Please…

2

7479965--919796--upload_2021-9-8_15-48-4.png
7479965--919796--upload_2021-9-8_15-48-4.png1403×480 99.9 KB

this is error text

3

https://docs.unity3d.com/Packages/com.unity.barracuda@1.0/manual/Loading.html

Does this help?

1 Like
4

I’ll check. Thank you for your interest.

5

Is there a way to change the model to NN Model?

6

I don’t quite understand what you mean?
Maybe it might help if you explained what you have done and what you want to achieve?

Where is this .onnx model from? Did you train a model using mlagents or did you train a model somewhere else and converted into onnx and you want to load it to unity? Need more context! :slight_smile:

7

Having the same issue with a build. The model is trained using ML-Agents but it is not in the Projects Asset directory. It’s being loaded from a completely different directory. Not sure why but unless the NNModel is in the asset database, which isn’t an option for a build, it will throw the error 244.

8

Hey guys, did anyone solve this?

We need to load models that we download in runtime from a webserver, and we execute it in a build (not in Editor), is it possible?
All the examples and code I find only work within Editor using the Resources Folder.

9

Any updates on this?

10

Edit: figured it out. For future people wanting to dynamically load ONNX model files from disk without relying on Resources or Assets:

var ONNXPath = "/my/onnx/path/file.onnx";
var converter = new ONNXModelConverter(optimizeModel: true); // requires the Unity.Barracuda.ONNX assembly

// Read file at path and convert to byte array
byte[] modelData = File.ReadAllBytes(ONNXPath);
var model = converter.Convert(modelData); // type is Unity.Barracuda.Model
// profit...
2 Likes
11

I have an issue when I import onnx model in unity it doesn’t load as NNModel. Could you help me please

1 Like
12

How can I load a NNModel model from a .onnx file?

13

you can’t load “onnx” directly , and you should use NNModel byte[ ] value.
you can use “model” to NNModel .modelData.Value.
The point is ,asset can not be null,and do not create a new NNmode or modelData , just give the modelData.Value, that’s all .

            NNModel asset = NNmode;// just drag a  policy brain.
            asset.modelData.Value = null;

ONNXModelConverter onnx = new ONNXModelConverter(true, false, true);

            Model model = onnx.Convert(Application.streamingAssetsPath + "/SimAgent.onnx");

            using (var memoryStream = new MemoryStream())
            using (var writer = new BinaryWriter(memoryStream))
            {
                ModelWriter.Save(writer, model);
                byte[] bbb = memoryStream.ToArray();
                asset.modelData.Value = bbb;
                BehaviorParameters.Model = asset;
//when it done , policy will change.
            }