Keeping an ARPlaneMaterial aligned to planes

Unity Engine
, ,
1

Hey all – I see some AR apps that have a super-clean visual representation of the AR Planes, where the texture of the ARPlane aligns quite well to the perspective of the camera & the shapes in the scanned world.

Like in this below example, notice how the white plane lines & dots pretty accurately follow the edges of the scanned space. Vertical planes have lines that go straight up and down, and horizontal planes have lines that generally go left & right.

8077406--1044278--example2.jpg
8077406--1044278--example2.jpg400×865 138 KB

I’ve copied the FeatheredPlanes.unity demo from the examples. But when planes are detected in my environment, they appear skewed (see screenshot below). Note how my vertical plane dots are tilted at roughly a 45 degree angle (see the red line screenshot). I’ve verified that the FeatheredPlaneMaterial texture is in fact straight-on; it’s not rotated.

What causes the below rotation that I am seeing, and how do I get my texture to lie “straight” on the plane?

8077406--1044275--example.png
8077406--1044275--example.png295×640 171 KB
8077406--1044281--example2.png
8077406--1044281--example2.png295×640 173 KB

Thanks!

2

It looks like the upper image shows the app that uses a meshing algorithm. In AR Foundation, meshing is supported on HoloLens and iOS (LiDAR sensor required) with the help of ARMeshManager.
You can ask the ARMeshManager to supply texture UV coordinates and use them to apply texture to the scanned model. I haven’t tested this myself, but I assume you should receive the same result as on the upper image.

3

Thanks, Kirill! I’ll take a look at the ARMeshManager and see if I can coax what I’m looking at from that.