How to disable visionOS hand shortcut

When in Virtual Reality, how do you disable the visionOS shortcut that allows a user to look at their hand to access the toolbar?

This interferes with gameplay, and ideally can be disabled during gameplay and enabled in menus.