how do you simulate XR input in unit tests?

How do you simulate VR input in play mode unit tests using Unity Test Framework? I’ve been struggling with this all day

I need to automate testing of the VR player grabbing things, dropping them, etc…

I tried adding the XR Device Simulator prefab to the test scene and controlling that, but it throws a bug.

I tried writing my own InputDevice, but I can’t figure out how to make that device control the actual hands in the scene.

Been struggling with this all day, any help appreciated.

btw I’m using the now fairly standard setup of XR Interaction Toolkit, the new Unity Input System, etc… all of the packages are on the latest versions as of this writing