Multi-player Unity application using OVR libraries

If there is a better place for me to ask this question, please direct me there. My apologies in advance for the vague question, since I don’t understand the problem well enough to ask in greater detail.

I want to create a multi-player Unity application using the Oculus SDK. Let’s say there are two players in the scene, A and B. When player A presses a button using his index finger, the hand avatar for player B also displays a moving index finger. In short, hand movements for one player are also observed for the other. Controller inputs are also read without any ability to distinguish whether they originate from player A or B.

What are the possible approaches for eliminating this problem, if it is mandatory that I continue using Oculus SDK?

You may get more salient answers in the AR/VR/XR group on this forum.