World space UI Not tracking mouse correctly

I have a fully built UI that works PERFECT in overlay mode. This is a virtual reality project. I have everything running on mouse events. I have the mouse locked to the middle of the screen in VR.

When I place the UI in world mode, if the camera is perfectly aligned with the menu, the events “Mouse enter” track correctly, which im guessing is the Raycast on the canvas. If its rotated/angled, instead of having to hover the mouse above the button, Its somewhere off to the side of the menu. Everything gets offset in a weird direction.

For example. Instead of hovering over the button, I am hovering over nothing an inch to the right which then activates the button.

This is a BIG project for work. If anyone could help me, I would bow down to you. Thank you very much.

If anyone else ever runs into this problem. I ended up using google cardboard’s camera code. I use their camera, disable them, and use their reticle script. Now I can use the mosue event functions in VR in the Samsung gear easily. It also lets me with a couple clicks, to turn off Samsung gear, and switch to google cardboard now.