Cross-compatible solution for spatial anchors on mixed reality compatible headsets

Unity Engine
, , , , , ,
1

Hello,
In general, I have the following setting: I would like to have a cross-compatible mixed reality application. In this application multiple people should be colocated (at the same physical environment). The idea is that they are maybe 3-5 people and standing around one virtual object. But, I want them to see the object out of their perspectives. Thus, I would need one or more spatial anchors which may be detected by the clients who join the session to align their coordinate systems.
I investigated several solutions, but could not find one which is fully cross compatible or still supported. Thus, I wanted to ask if someone has an idea how I could overcome this issue or if there is a solution I missed.

The existing solutions I investigated are:
Azure spatial anchors: Will not work because it retires this month
Meta quest SDK: Will work very well, but is absolutely not cross compatible
ARCore: Seems to have the technology, but it does not run on Oculus devices as far as I know (الأجهزة المتوافقة مع ARCore  |  Google for Developers)
Custom solution 1: using Ar foundation to identify body of other player, create a mesh with collider from that and take the raycast hit from the current player and adjust the coordinate system according to that. That could work, but seems very inaccurate…
Custom solution2: using object detection algorithms or YOLO to identify objects in local room and make anchors out of them. The technology is there, but it seems to not work because we cannot take passthrough images on oculus devices or apple vision pro.

I would be happy about any kind of discussion about those aspects or further ideas regarding that issue. Would you suggest me to just build with Meta SDK and hope that something else will be released in the future? Or do you have a better solution?

2

Yes, as you’ve discovered each platform runs on it’s own backends and they are not compatible with each other. I’ve seen people roll their own solution by using an image target to establish a common frame of reference but you will have to handle communication between devices yourself.

4

There used to be an actually cross platform solution, that was Wikitude! Sadly it has been bought up by Qualcomm to be now defunct, no idea what the point was of that purchase and shut it down soon after.