A position locked hinge joint with drag and no gravity?

I’m loosing my mind here. I need an object to be stuck in place, but be able to rotate on every axis. I also need it to slow down fast after being rotated.

So my object has a rigid body, and a hinge joint.
Gravity is off, and spring is disabled, but the object keeps slowly rotating to it’s original position. I suppose it’s center of mass is offset, but why does that matter without gravity?! And it doesn’t seem to have any drag no matter what I set the Drag and Angular Drag, on the rigidbody, to. Why?

So how do I create a very stiff hinge joint that doesn’t have a prefered rotation?

Okay so it kind of works now. I turned off freeze postion (x, y, and z) and attached the hinge joint to an empty object; which has a fixed joint locking it in place. Kind of works okay now.