Actually, you don’t need the gun to follow the player at all. You can renderer it with an other camera which will render only the gun’s layer, when the main camera, the one that follow your player, will render everything but. The same goes for the players hands, if you want any.
The gun camera mustn’t have an AudioListener, must have it’s clear flags to depth only, and the culling mask to you’re weapon’s layer only.