Object transform anchor point moves when adding another object as a child

I’ve made a sword and a human in blender, and the human has a rig in it. When I move the sword in to Hand.R, the transform anchor point (I dont know how to call it) of the human moves to the left. The transform anchor points of the other .R children move to the position of the sword. I tried to completely unpack the model prefabs but it did nothing. Theres also no error message. How do I fix this?

Found it out myself. If you have the same problem as I had, then you need to change the toggle tool handle position from center to pivot.