How to remove give from collisions?

Questions & Answers
1

When my player controlled object collides with another object, instead of just pushing it around like I want, it sort of glitches into the other object while pushing it. This also result in a glitch with the camera that makes it look like the object is bouncing against the object it is pushing.

How do I remove the give on the collision so that one object does not go inside another and collides smoothly?

2

I solved this myself.

For anyone wondering, moving an object by using the rigidbody instead of the transform should avoid many physics glitches.