AR prefab scale issue(XR interaction toolkit)

I am new to Unity AR development and decided to use the XR Interaction Toolkit for basic gesture interaction for my model. I am able to spawn my prefab on detected planes but for some reason when I tap the model to use gestures it becomes too big. When I hold on the plane to spawn the prefab and gestures aren’t used on it yet it remains at it set scale but when I tap to use the gestures, the scale just increases exponentially before I am able to use gestures on it. Please help me fix this issue.