Raycast-forwarding through rendertexture-camera

Hello everyone,

in the thread Control through rendered texture with raycasting i tried to explain my problem and i got no response. So I guess the matter is that my problem is to complex and my english to bad. So i try to differentiate the problem a little bit more.

I got a rendertexture which represents a cameraview. Now i want to shoot a ray to the target I already see on the rendertexture. My idea was to get the uv coordinates from the rendertexture and convert them to the screencoordinates of the texturecamera.

Any idea how to solve this or maybe someone has a better idea? The reason for this constellation can be seen on the upper link.

Here is a graphical explanation of my problem

Thank you very much.

Best regards
André

I think you need to know what quad the mouse is in within the warp mesh of the dome camera rig.
Then you can interpolate it with its exact (x,y) position, and combine with the main camera orientation, then you get your adjusted vector for the raycast.

How to actually do this, is another question.
One I’m really stuck on, Can anybody help??
With any part of this??