XRHands Package - AVP ARKit Hand Tracking Data Fixup

Will Unity be fixing the XR Hands package for visionOS to provide the hand tracking data in the format that conforms to the OpenXR output that is normally returned? It feels like having to change the code per platform will be detrimental to the agnostic nature of Unity APIs.

2 Likes

It’s something we are considering but not currently being worked on.

2 Likes

Thanks, @DanMillerU3D. I cannot seems to find the documentation or video for the differences between the XR Hands package hand pose data and the data returned when running on AVP. Could you point me to where that is at?

2 Likes

We don’t have any documentation on this currently. The gist is the difference between OpenXR and ARKit hands. With the biggest part being the rotation of the joints in ARKit hands.

OpenXR hand joints:


source: Hand data model | XR Hands | 1.4.0-pre.1

ARKit hand joints:


source: Meet ARKit for spatial computing - WWDC23 - Videos - Apple Developer

ARKit joint rotations:


source: Meet ARKit for spatial computing - WWDC23 - Videos - Apple Developer

Hope this helps a bit.