Use two similar prefabs for single networked object Photon Fusion?

Hello, I am newer to networking in unity and am using photon fusion to network game objects.

When a player connects to the server you are supposed to spawn in the user’s networked avatar (Avatar prefab) to all instances across all clients.

My question is, is it possible to have two prefabs, one for the “User As” local client (which has all of the input control on it including the VR HMD manager on it) running on their client sending networked input to the server and one for the other players clients so that when “User A’s” input gets recieved it updates the second prefab which is the same as the first minus all of the input control scripts (basically so it just updates the avatar joints).

I would appretiate any feedback or suggestions or if any clarification is needed please let me know!