How to change Rigidbody position and rotation without causing weird behavior?

I want to be able to adjust the Rigidbody position and rotation each frame without unrealistic and weird behavior.

Did you try setting the freeze position and freeze rotation constraints for the rigidbody on?