Is it possible to use mouse to click things on the computer screen while on VR?

Questions & Answers
1

I’m developing a Unity VR application with Oculus Rift that should be used by two people: one with the HMD and another looking at the computer screen. The person without the HMD should be able to highlight some objects in the scene, and one of the simplest ways I can imagine to do it would be allowing this guy to click the objects in the scene and they will be highlighted. This seems to be simple because Unity already renders the HMD view to the 2D computer screen. However, the easiest way I found to do it doesn’t work with the OVRCameraRig (yes my object has a Collider and yes my Camera has a Physics Raycaster). I’ve also tried the raycasting method described here.

2

We’re doing that in our VR project via this (though we’re doing it at a time when one switched to desktop mode already, which is when we’ve turned off the VR headset view). Let me know if it helps:

using System;
using UnityEngine;
using System.Linq;

// ...

if ( Input.GetMouseButtonDown(0) ) {
    const float maxDistance = 100f;
    Ray ray = camera.ScreenPointToRay(Input.mousePosition);
    RaycastHit[] hits = Physics.RaycastAll(ray, maxDistance).OrderBy(h => h.distance).ToArray();
    for (int i = 0; i < hits.Length; i++) {
        RaycastHit hit = hits*;*

if ( hit.collider.gameObject.CompareTag(“SomeTag”) ) {
// do something with this object
}
}
}