Poke interaction Select Exited attached script runs multiple times

I am working on the poke interaction with a sphere I have in my scene, using Hand Visualizer and XR Interaction Toolkit. I attached to the “Select Entered” and “Select Exited” a script that should run when I touch the object and stop touching it. Right now what happens is that the functions on the script run multiple times for as long as I keep the hands on the object, both the “Select Entered” and the “Select Exited”.
How can I fix this? I don’t have any collision on my hands so they go through the object, might that be the issue? If so, how am I supposed to implement collision?

Thank you