Polyspatial Objects Do Not Behave Properly when Manipulated in an MR Space

We are encountering a serious issue with object behavior in Mixed Reality mode when being manipulated by either an XRGrabInteractable, or when using the sample code provided by the documentation here PolySpatial Input Documentation

The issue is that there seems to be some multiplicative behavior that occurs in object manipulations when a user moves.

  • If a user selects an object with either of the above scripts, and then walks forwards, the object progressively moves farther and farther away from the user.
  • If the user walks backwards the object progressively moves closer and closer to the user until it moves through them and then continues behind them.
  • If a user rotates their body and head while maintaining the same relative position of their hand in their view the object suddenly moves at a much greater rate than their hand

Is this behavior intended? If not, what suggestions do you have for resolving it?

In all of the above cases these behaviors are very different than what we see if the user simply manipulates the model without moving their head or body. In this situation the model moves almost 1 to 1 with how the user’s hand moves. In the above situations something is very wrong.

We are building a MR app, and users are expected to pick things up and move around a physical space with them, so we need to resolve this issue.

(I will provide additional examples via video recordings from inside the AVP at a later time)

Also, if someone can explain how I can put this post in the right location, specifically the Vision-OS MR Forum, that would be appreciated.

This new forum format does not make sense, when choosing “New Topic” it doesn’t create a topic for the forum you are viewing… it just seems to put your post wherever it feels like.