Faced with this problem when I started writing my rigidbody controller, and then I noticed that when moving all the objects begin to twitch. I began to look for other controllers. Maybe I did something wrong to write, so I began looking for other controllers, they have the same problem. I decided to test standard RigidBodyFPSController, that come with Unity 5, he had the same problem. If this problem is not only in my controller, it can issue the engine? Please help me, maybe someone had this problem. Let me advice based on a standard RigidBodyFPSController.
There’s 2 things you should try:
1.) Do you have any code in Update? Try doing your code for your FPS controller in FixedUpdate. Are there any scripts on your Camera with Update? Try FixedUpdate.
2.) Increase the FixedUpdate from default 0.2, and make it something like 0.1
Standard RigidBodyFPSController use FixedUpdate (), I tried to write the Camera code in FixedUpdate(), problem is solved, but the camera control is deteriorating