Making a map moveable in game

kind of a complicated thing I want to do so I thought I would look here.
I’m making a VR game with a “tycoon” game feel and I need a way to let the player move the map relative to them (so they can build in other places without walking there). Preferably with the ability to shrink or grow the map. If youve ever played “black and white” for the PC thats basically what im looking for, but I need limits for how far in any direction the player can go. Is there a plugin or script I can use?
the standard “make an object grabbable” script wont work since you can rotate stuff with it or have it fall, and i want the map to keep its orientation and stay at the same height.

I am not sure what library/framework you use for VR but have you checked at the components that you add to make something grabbable. But they often have some system for constraints, like constraining the rotation. It might be possible to freeze the rotation in the rigidbody aswell. If the object is falling it might be because you have a rigidbody on it. The rigidbody has a variable called useGravity that you could disable.