Problems with Rigidbody when firing a gun

I am having some stupid issue when I use rigidbody on my characters. When my gun is firing a gun, the gun kinda jumps to the side and causes the gun flash effect to show to the side of the guy.

here is a youtube video of it happening. the first character has rigidbody, ragdoll and capsule colliders on the limbs. The second character has rigidbody (dosnt do anything at this point) and has no ragdoll or capsule colliders

Are your bullets colliding with your own character? You can use Physics.Ignore to ignore collision between two entities explicitly but there is a bug with this right now. See: