Change the attach point of an object

Hi, I got a problem that I can not change the attach point of the object. I create a object and added the XR Grab Interactable components to it, and I create a empty object under that and link it to the Attach transform for my object. From the tutorial I watched, I should able to change modify the attach point for my object, so that when I grab the object it is in the correct direction I want, but there is nothing happen to the attach point, I can not change it. I am not sure if there are any other setting that I need to do/select. Please help me for this if anyone knows how to solve it.