SceneManager.MoveGameObjectToScene reset animation

Hello! I have a problem where my animation continuously restarts when I move my player object between Physics Scenes. I have to constantly move the player’s game object between scenes because one scene is the main loop and then the other is a simulation loop which requires the player as well to perform some calculations. While debugging the problem, I noticed the animator is constantly restarting the idle animation. If I do not move the game object between physics scenes, the animations play as expected but of course the simulation fails.

Has anyone worked with Physics Scenes and seen this problem or know how to fix it?

I am using this code to move between scenes:
SceneManager.MoveGameObjectToScene(player.GameObject, serverReconciliationScene);

SceneManager.MoveGameObjectToScene(player.GameObject, otherMovingEntitiesScene);

I fixed the problem by not moving the whole player GameObject to the physics scene, instead I have a slimmed down game object that is updated with the players state before the simulation runs.