Multiplayer shows different scenes

My problem is that whenever a player switchen to a different scene, he can still see all the other players from the previous scene walking around and the other player can see him, although they are in different scenes. This is most likely due to the DontDestroyOnLoad on the player gameobjects. I tried the following thing to prevent it without success:

Account allPlayer = FindObjectsOfType ();

         foreach(Account temp in allPlayer)
         {
             if(temp.gameObject.scene != gameObject.scene)
             {
                 Destroy(temp.gameObject);
             }
         }
 if (!isLocalPlayer)
             return;
 DontDestroyOnLoad(gameObject);

3: Making different Network Managers.

I think you’re not supposed to just destroy local players on current connected clients, you’ll get a lot of problems. Maybe you can use a player object with no renderers, and then use another object for the visible player, then when loading new scenes you can disable or enable the visual avatar of any player without destroying the UNET player object.