I am trying to run the URP VisionOS Metal sample apps (not polyspatial) in the simulator but none of the input is working. I cannot click or move or do anything. The sample app does work in the editor.
Suggestions on what to check?
Hey there! Sorry to hear that you’re having trouble.
Does this include the “head look” rotation and translation that you can normally do in the simulator with WASD and mouse dragging? Just to rule it out, are you able to move around in the simulator in the home screen (when the app is not running)? Do you have the XR Interaction Toolkit imported into your project? It shouldn’t be required for basic head pose updates but it is required for pinch/gaze input in the Main sample scene. When you imported the package, did you say “Yes” to the dialog asking you to enable the new input backend and restart the Editor? Do you see any errors in Project Validation (Project Settings > XR Plug-in Management > Project Validation)?
Some more background info would be helpful as well. What version of Unity are you using? What version of com.unity.xr.visionos do you have? What version of Xcode and visionOS Simulator/SDK are you using? Is your app mode set to Metal in Project Settings > XR Plug-in Management > Apple visionOS?
If you’re still having trouble after checking these things, could you please submit a bug report and attach the project? I would expect the samples to work in a fresh project after fixing project validation issues, so it will help if I can see the whole project to diagnose the issue.
HI Matt, thanks for the reply. I went back and double checked everything again. Things seem to be working better now. I can move and click but things seem to work differently in the editor vs the simulator.
In the editor i can use the mouse to click on any UI and it activates. I am not sure how to control the simulated controllers (yellow balls and + signs). In the simulator the mouse clicks on the UI do not activate anything but the yellow ball does move to where i clicked the mouse. Would you point me to any docs that explain how to use these controls in the avp simulator?
Hm… None of the spheres are yellow… The particle system UI turns on a particle system with mulit-colored spheres, which are sometimes yellow? Do you mean the green spheres that are attached to the hand position? And for “+ sign” is that maybe the world anchor prefab?
That thing isn’t directly attached to the hand, but it’ll be spawned at the hand position if the gaze ray doesn’t intersect with any colliders. There’s also a red/green/blue “axis” that we show while the pinch is held. There’s an intermittent issue I’ve noticed in the simulator where mouse input is a little “sketchy” if you haven’t moved yourself from the initial camera position, but that doesn’t sound exactly like what you’re describing. Here’s a screen capture of what it looks like when I interact with the sample in the simulator:
HI Matt, sorry yes you are correct they are green but looked yellow to me as I am partially color blind. I was able to figure out what to do and do appreciate you posting the video. When copying over some of the game objects from the main scene to my own I had missed a script required for the UI interactions.
Aha! That’ll do it 
In the future I recommend making prefabs out of things and exporting a UnityPackage. It can be a little “greedy” with the dependencies it selects, but it ensures you don’t miss anything.
Glad you were able to sort it out. Good luck on your project!