AR Remoting & Simulation

Update: May 11, 2020
We have shared a new update on AR remoting and current plans: AR Remoting Alpha - User Studies

Update: December 5, 2019
Hi everyone, an update on where we are. We aimed to have an initial version of remoting for ARKit and ARCore devices by the end of 2019, but this work is still in development and has been pushed out to early 2020. In the meantime, feel free to complete this form if you are interested in early access when it’s available.

Latest information on AR Foundation can be found in our session at Unite Copenhagen.

August 1, 2019
Hi everyone, there have been a lot of conversations around reducing iteration time when working with AR Foundation. We owe the community an update and in an effort to improve our communication and transparency, we have created a dedicated post to keep you updated as we progress. You can expect more details to be posted on this thread moving forward.

It’s clear from many of you that iteration time continues to be a significant pain point. Remoting is the most requested feature and we are currently solidifying our plan to ensure we have the tools that fit your needs. At a high level, we plan to include the following features:

Remoting & Simulation:

  • Connect to a remote device from the editor
  • Test AR features (planes, raycast, reference points, etc.) on-device without having to build your app
  • Record sessions and play them back in the editor
  • Simulate AR features (planes, raycast, reference points, etc.) in the editor

This is a large, comprehensive project that will take time and continue to evolve as new AR features are supported. However, we want to make sure you have the proper tools to test features you use the most, as soon as possible. We are working on this now, so stay tuned for more updates.

24 Likes

Thanks for the update! Question about recorded sessions - is the idea that the raw video feed and full suite of sensor data will be recorded for playback and simulation? Would we basically be able to launch the recorded video + sensor data from editor and otherwise interact with the app via UI or other events normally?

Thanks for the update. Not sure how far you guys are but it would be great if you could push out a preview as soon as possible. The recording feature is nice but a working preview of just the remoting (incl. raycasts) would already help tremendously.

9 Likes

Agree.

I basically just want to see changes happening in the editors hierarchy and to check variables in the inspector. Would help a lot to understand how AR Foundation works.

2 Likes

watching this.

Looking forward to it too. Thanks mfuad for the update!

Awesome that you guys are working on a solution. I’m really looking forward to the in-editor simulation of AR features as I can see this being useful for my projects.

Is there any information you can give us about expected timeframes?

1 Like

@BuoDev this may interest you, Satwant Singh published this video just a few days ago:

4 Likes

@vincentfretin Thanks for the video. Those are some really helpful assets. The creator of the Runtime Inspector asset has some really useful Unity tools (including an in game console tool) his GitHub page is worth a visit for sure

Hi! Thanks for the update, this was much needed.

Although I greatly disagree with the approach. We know that when you announce to be willing to be more transparent but don’t give any estimated release date, it’s most likely because the development didn’t start yet.
I have the feeling this feature is passed beyond due by now, and is a good candidate for the new “nested prefab” type of feature, where everyone says it’s gonna be soon but it takes years.

Now there’s an opportunity to change that, please release a WIP as soon, that will work for few people, help them out, then expend the support one by one instead of adding all the features at beforehand.
Helping 10 people is still better than not helping.
We want a preview package. We want a pre-alpha, a early access, whatever. Anything will be better than nothing, to solve your transparency problem.

2 Likes

Hello ! I’m also starting to play around with AR and not having this feature is a real bummer for newcomers. Please keep us informed of the current state of this solution ;).

8th Wall have had AR Remote for more than a year…

2 Likes

Any news on this project @mfuad ?
Is it possible to be part of a pre-alpha of AR Foundation Remote?

1 Like

I’m new to AR and really surprised this isn’t already a thing. The remote tool shown here

is one the way or the one that doesn’t work anymore? Must be a real pain to make a non trivial AR app without these kind of tools? Or is everyone just using another solution like 8th wall?

No updates…
I understand that the original post says it’s a large feature and will take time. I get that the big new updates to AR Foundation might make it more difficult, and that it’s a help for them to implement this in the first place.

Making the thread, and then not posting any updates in over a month though. Why make the thread in the first place?

2 Likes

They wanted to be more transparent, but they’ve gone completely invisible :frowning:

7 Likes

Has anyone here attempted to create a remote app for AR Foundation? I’m curious to see if it’d be relatively straightforward port given that we have access to the ARKit Remote source.

Hi @mfuad
can you please release even alpha for this because i’d really help us save time?
Dev AR atm with unity is painful :confused:

2 Likes

+1

2 Likes