Does grab pose detection work with XR Hands package?

Unity Engine
,
1

Hi, I am investigating pose hand pose detection for a project, is there a way to grab objects on the XRIT using the new XR Hands package, using gestures such as the fist? Could it be done through the Meta Interaction SDK, or in that case I would need to use its components?
And in case it isn’t implemented yet, is there an ETA for it?

2

I am also researching this. I know Oculus SDK, has a way to create and save hand poses. Probably a way to detect when they are being used as well.

I am planning on making my own tool to work with XR hands. Not sure how well it will work, but basically, I’m going to get joint rotations and positions of the hands, and compare them to saved values, and if enough are within a certain rage, I’ll declare that the pose is correct.

3

Hey, is there any updates in this? I’m also trying to create this thing

4

hope that can help you mate, cheers

5

Just popping in here for future people. As of this date you can download the 1.4.0-pre.1 XR Hands package and it supports hand poses.

You can download the Gestures Sample to see how it works. And it has ‘fist’ as one of the default examples poses. You could just use this for grab, or you could create your own custom poses.

If you want better ‘physical’ grabs, checking out Unity Assets such as AutoHand would also be good

1 Like
6

I tried that, and can detect a fist gesture being performed. But then how do I use that gesture with the XRDirectInteractor? Is it possible to modify the Interactor to make the fist pose trigger the select action?

1 Like
7

Searching for the exact same thing. Is it possible to bind a custom hand pose to a particular input action? For example, instead of the pinch gesture to trigger the select action, I want to bind the fist pose to trigger that action.

8

im trying to figure this out right now too. How are there no tutorials for this?!?!

9

For anyone still interested in this kind of feature, with the new Input Readers architecture of XR Interaction Toolkit it is actually possible to override the “interaction input” of an Interactor component, using a custom behaviour instead of an Input Action (for example, an hand gesture detection).

In this thread I opened I asked for some clarification and I managed to achieve my hand gesture input detection system.
Hope you’ll find it interesting, let me know if you understood the process (I may be thinking of doing a more in depth look if it could be desired).