Unity MARS Real-time Object detection

[naveen-ds]

Hi Team,

Using Unity MARS how can we detect real-time objects.
Please suggest any supporting tutorials.
Appreciate your response.

Regards,
Naveen

[jmunozarUTech]

Hello @naveen-ds ,

Out of the Box MARS doesn’t offer object recognition; for this you will have to use another package and write a provider for MARS to do so (Software development guide | Unity MARS | 1.3.1)

Depending on what your goals are you could use Apple’s content anchors Scanning and detecting 3D objects | Apple Developer Documentation or you could use a machine learning model with Barracuda (Introduction to Barracuda | Barracuda | 2.1.0-preview) and use it within MARS, again you will need to write a provider for it.

[Ricardotlpz]

@naveen-ds

Hi Team,

Using Unity MARS how can we detect real-time objects.
Please suggest any supporting tutorials.
Appreciate your response.

Regards,
Naveen

Hey Naveen, just as @jmunozarUTech suggested, I’d use Barracuda. You can make a quick implementation using this mediapipe model and further build over it. You’ll just need to make a port to Unity.

https://google.github.io/mediapipe/solutions/objectron.html

[eslicenses]

@jmunozarUTech

Hello @naveen-ds ,

Out of the Box MARS doesn’t offer object recognition; for this you will have to use another package and write a provider for MARS to do so (https://docs.unity3d.com/Packages/com.unity.mars@1.3/manual/SoftwareDevelopmentGuide.html#providers)

Depending on what your goals are you could use Apple’s content anchors https://developer.apple.com/documentation/arkit/content_anchors/scanning_and_detecting_3d_objects or you could use a machine learning model with Barracuda (https://docs.unity3d.com/Packages/com.unity.barracuda@2.1/manual/index.html) and use it within MARS, again you will need to write a provider for it.

Thank you!

[eslicenses]

@Ricardotlpz

Hey Naveen, just as @jmunozarUTech suggested, I’d use Barracuda. You can make a quick implementation using this mediapipe model and further build over it. You’ll just need to make a port to Unity.

https://google.github.io/mediapipe/solutions/objectron.html

Thank you!

[gekko22]

It’s hard to believe that there hasn’t been someone to incorporate this fundamental feature into MARS.
I would personally really appreciate it.
@eslicenses , did you achieve?

[Ricardotlpz]

@gekko22

It’s hard to believe that there hasn’t been someone to incorporate this fundamental feature into MARS.
I would personally really appreciate it.
@eslicenses , did you achieve?

My guess is that MARS is an augmented reality framework, not a convolutional neural network thus they won’t be adding support for that. Sure it would make work lighter but I’d focus on adding other features instead of this one.