ARKit 3

[ina]

Is ARKit 3 fully supported by ARFoundation?

Or is the existing ARKit plugin getting updated soon?

Starting a new Slack for AR Dev for Unity. Feel free to join here:

https://join.slack.com/t/unityardev…Y2OWQzYzA4OTBlZGRhNWZiYTAxOThmYzgxYjJlNWFhMDM

[louisch]

ARKit 3 was announced yesterday, and will release in iOS 13, which hasn’t been released yet.

[MassiveTchnologies]

iOS 13 beta has already been released to developers. And Unity team can work on the integration already. I wonder how long will it take to integrate features like people occlusion and motion capture (and possibly with support for Mecanim). And ETA from the team would be greatly appreciated.

[Staus]

I don’t expect it to be a small task for the team to “just” implement these things and it’s only 2 days old news. However, it would be really nice to be kept informed on when/if and to what degree these tools could be expected. Many ongoing projects could benefit from them and I would rather not optimize for issues that are automatically fixed very soon with the ARkit3

[Staus]

Oh! I just realised that the ARkit plugin has been deprecated and we should now use ARFoundation?? Isn’t ARFoundation only catering to the features that the platforms have in common? Something like body tracking, body occlusion etc. are currently unique to iOS. Does that mean that Unity will down prioritize those features until ARcore catches on?

[KLWN]

@Staus

Oh! I just realised that the ARkit plugin has been deprecated and we should now use ARFoundation?? Isn’t ARFoundation only catering to the features that the platforms have in common? Something like body tracking, body occlusion etc. are currently unique to iOS. Does that mean that Unity will down prioritize those features until ARcore catches on?

I hope not, that would be a huge bummer for Unity Devs around the world. My guess is they will implement ARKit3’s new features in order to be a state-of-the-art dev platform for which Unity is known for.

[MassiveTchnologies]

@Staus

Oh! I just realised that the ARkit plugin has been deprecated and we should now use ARFoundation?? Isn’t ARFoundation only catering to the features that the platforms have in common? Something like body tracking, body occlusion etc. are currently unique to iOS. Does that mean that Unity will down prioritize those features until ARcore catches on?

We seriously hope that’s not the case too. Maybe they would have platform specific features on top of the cross platform functionality. Hoping the devs would clarify more on this matter.

[Jelmer123]

No, AR Foundation also features ARKit-only functions (for instance object tracking).
But what worries me is that the ARKit plugin has always been updated very quickly. In 2017, ARKit was available in Unity within days (I suppose they worked on it before the beta release). But with AR Foundation I’ve seen that things takes much longer time. Only recently image tracking was added, while this has been around for ages in ARKit and ARCore.
edit: Unity support for ARKit3 Unity Blog

[MassiveTchnologies]

@Jelmer123

No, AR Foundation also features ARKit-only functions (for instance object tracking).
But what worries me is that the ARKit plugin has always been updated very quickly. In 2017, ARKit was available in Unity within days (I suppose they worked on it before the beta release). But with AR Foundation I’ve seen that things takes much longer time. Only recently image tracking was added, while this has been around for ages in ARKit and ARCore.
I hopes ARKit3 stuff comes soon, otherwise I’ll start learning RealityKit I think…

We were wondering too if we could get our assets out of Unity into RealityKit through USDZ for example. RealityKit has many cool features that the current Unity struggles with (using image effects like motion blur in AR without affecting up the tracking and severely impacting the performance, accurate camera based depth of field, raytraced soft shadows and many more)

[Jelmer123]

@MassiveTchnologies

We were wondering too if we could get our assets out of Unity into RealityKit through USDZ for example. RealityKit has many cool features that the current Unity struggles with (using image effects like motion blur in AR without affecting up the tracking and severely impacting the performance, accurate camera based depth of field, raytraced soft shadows and many more)

There is a USDZ preview package for Unity that allows you to export assets to USDZ I think. Check the package manager
And yes, I’m also going to look into RealityKit, it looks very promising. Motion tracking, depth of field blur, HDR environment maps, camera grain, good looking realtime soft shadows on mobile, recording an AR session for in-editor testing, continues mapping&relocalization across multiple devices, easy multiplayer.

Mostly also possible in Unity, but with RealityKit it’s by default it seems

[Jelmer123]

PS: Unity ARKit3 announcement

Unity Blog

[MassiveTchnologies]

That was fast! Exciting!
I can’t see a mention of improvements to the post processing workflow in AR to match RealityKit level. I hope the devs address that soon.

[eco_bach]

Wow. “people occlusion features are available only on iOS devices with the A12 Bionic chip and ANE.” Anyone know which specific devices these are?

Also, just to confirm

https://github.com/Unity-Technologies/arfoundation-samples

This repo contains latest ARkit 3 features? Not perfectly clear either from the blog post or reading the manifest.json file.

Also am wondering about LWRP + ARkit3 support.

[KLWN]

@eco_bach A12 chip is available in iPhone Xs

@Jelmer123

PS: Unity ARKit3 announcement
https://blogs.unity3d.com/2019/06/06/ar-foundation-support-for-arkit-3/

wow, that was really fast, so excited!!

Has anybody tried the samples already?

[tdmowrer]

We published a version of ARFoundation today that supports the new features in ARKit 3. Please see our blog post for more details.

[tdmowrer]

@eco_bach

Wow. “people occlusion features are available only on iOS devices with the A12 Bionic chip and ANE.” Anyone know which specific devices these are?

Also, just to confirm

https://github.com/Unity-Technologies/arfoundation-samples

This repo contains latest ARkit 3 features? Not perfectly clear either from the blog post or reading the manifest.json file.

Also am wondering about LWRP + ARkit3 support.

The samples repo has now been updated with new samples for ARKit 3 features.

[Jelmer123]

@eco_bach

Wow. “people occlusion features are available only on iOS devices with the A12 Bionic chip and ANE.” Anyone know which specific devices these are?

Also, just to confirm

https://github.com/Unity-Technologies/arfoundation-samples

This repo contains latest ARkit 3 features? Not perfectly clear either from the blog post or reading the manifest.json file.

Also am wondering about LWRP + ARkit3 support.

• iPhone XS and XS Max
• iPhone XR
• iPad Mini (2019)
• iPad Air (2019)

edit: whoops also all A12X devices of course:

• 11-inch iPad Pro
• Third-generation 12.9-inch iPad Pro

from https://en.wikipedia.org/wiki/Apple_A12 & https://en.wikipedia.org/wiki/Apple_A12X

[edee1337]

@tdmowrer

The samples repo has now been updated with new samples for ARKit 3 features.

Thank you for the update!! Looks like I’m getting the following error when trying to deploy the ARFoundation 1.5 LWRP sample to iPhone X running iOS 12.1.2:
dyld: Symbol not found: OBJC_CLASS$_ARMatteGenerator

[tdmowrer]

@edee1337

Thank you for the update!! Looks like I’m getting the following error when trying to deploy the ARFoundation 1.5 LWRP sample to iPhone X running iOS 12.1.2:
dyld: Symbol not found: OBJC_CLASS$_ARMatteGenerator

The latest ARFoundation 1.5 (and also 2.2) currently requires Xcode 11 beta. That linker error is expected if using Xcode 10 (or less).

[newguy123]

@Jelmer123

PS: Unity ARKit3 announcement
https://blogs.unity3d.com/2019/06/06/ar-foundation-support-for-arkit-3/

Cool. I wonder when ARCore 1.9 will be supported…