Why does Rigidbody component make the object fly away?

When I put a rigidbody component onto my character, the character just flys away and disappears.

I had a cylindrical floor which had a capsule collider on it. Taking away that capsule collider and replacing it with a box collider, fixed the issue for me.