I got similar problem. I had a swinging anchor attached to a cube with rigidbody. And when I selected the cube in scene hierarchy, swinging became faster.
I limited app fps with 30, and difference disappeared.
Seems like app in editor works slower, with less fps, when a rigidbody is selected in scene hierarchy. And it means that your behaviour depends on fps.