Raycasting an object in oculus

I am trying to design a game for the oculus rift that is moving an object on a plane using the mouse. I have a code that works great in unity but when I load the game into the oculus, both the camera and mouse move the object. Does anyone know if there is a way to separate the head movement from the mouse movement (maybe casting from a child of the object I am trying to move)? Thank you!

Here is the code that I have so far…

RaycastHit hit;

private float raycastLength = 1000;

void Update()
	GameObject Mouse = GameObject.Find ("Mouse");

	Ray ray = Camera.main.ScreenPointToRay (Input.mousePosition);

	if (Physics.Raycast (ray, out hit, raycastLength)) {
		Debug.Log (hit.collider.name);
		if (hit.collider.name == "Tablet") 
			Mouse.transform.position = hit.point;

		Debug.DrawRay(ray.origin, ray.direction * raycastLength, Color.yellow);


On what object(s) is this script on ?

Camera.main calls the first camera tagged Main Camera that Unity finds, you should be more specific when you choose from where to launch your ray. Like shoot only from the left eye or so.