Some children move inverse to parent

So my game is in VR
The idea is that when you grab a plate, the other plates get “stacked” on top via setParent
(the plates higher in the stack become child objects of the one you grabbed)

For some reason, all / some of the other plates, once becoming children, move seemingly “inverse”
of where you’re holding the parent. (Not sure the correct term)

I checked the heirarchy and can’t find any differences between plates that get properly parented
vs ones that don’t. I’m also sure they’re being parented.

I’m using the XR Interaction Toolkit

Thanks!