Gaze-based hover effects in Metal

[DrummerB]

From an other topic:

@AndrzejUnity

One feature of RealityKit/PolySpatial that I didn’t see mentioned in this thread is the gaze hover behavior (and, related to that, gaze-based foveated rendering). Apple doesn’t provide CPU access to the gaze vectors, so this feature can’t currently be supported in Metal mode.

Now that gaze highlights are supported in Metal, are there any plans to support this in Unity? @AndrzejUnity

Ideally, the low level API would allow us to generate and provide the index texture using whatever rendering method we want, pass it over to Unity and Unity to the visionOS compositing system.

Mid- to longer term, of course, it would be great to have UI Toolkit be able to just support this out of the box. It’s great to see that world space support is available in Unity 6.2, so maybe a UI Toolkit world space UI with highlighting support is not too far in the future?

If you plan to build this into UI Toolkit, it would be great to be able to combine it with non-UI objects as well. This means, we would need to be able to blit or render into the same index texture as UI Toolkit.

[ddi7i4d]

Are there any updates on this? This is really an important feature.

[unnanego]

they replied in multiple places saying they are not going to develop any new functionality, so you can forget about it. We did manage to implement it ourselves, but the lack of dynamic gaze kills the whole point of using metal mode, since aliasing is unbearable.

[ddi7i4d]

Oh wow, how did you manage to do that?