I was looking around for object detection solutions that were cross platform on Android/IOS due to ARCore/ARKit not having the same features for 3d object detection, mediapipe would be a fantastic useful addition to the ARFoundation tool set or even just as a standalone plugin.
Tried your plugin and I would like to know how I can get the distance over 2 object detected ? or object detected and an 3d object in scene ? Any method to get the bounding box face ?
What I do know is that it currently only works on android, the object detection samples are limited, box tracking is in the works (you can see all of this on the main readme screen in the link above if you scroll and read).
I have offered to help the repository owner with testing and development of the plugin but unfortunately they are not very active.
If you need ML object detection running in AR, check out this repository from the talented @derenlei , it works with Darknet Yolo v2 tiny models converted to ONNX used in Unity Barracuda. I am hoping to get Yolo-v3-tiny models working in the example at some point also as Barracuda 1.2.0 preview now supports that also. It works on IOS and Android which is very good!
Sorry I cannot help with mobilenet, the example only works with Yolo-v2-tiny, you will have to figure out how to adapt it for your model.
Let me know if you find a way to or what you did as I am investigating adapting Detector.cs for Yolo-v3-tiny.
As you can see, a lot of the ground work has been laid at least for running Barracuda in AR, sticking labels on detected objects in AR, passing the AR camera image to an .onnx model.
Maybe you know how to do surface tracking using mediapipe, I need an object to appear conditionally on the table and be fixed in space, I’ve been trying to find a solution for a very long time
