Vr painting problem

Hi, I’m making a VR app using XR interaction toolkit, I’m trying to create a scene where you can paint with the roller a wall, the problem is that when the roller collides with the wall it tilts and makes it impossible to be precise, I’ve already tried to block the rotation of the object when it collides with the wall but makes the movement of the painting too limited .

i followed this tutorial btw , in the video he blocks the rotation of the brush but I can’t do it because I need it to be as realistic as possible , any suggestions?

unity : 2021.3.19f1

maybe something similar like these plugins do,

i believe with some objects they don’t allow vr hand to “push” current object too much (inside the wall, or too close that it rotates by push force), so it stops your hand and the tool…
even when your vr hand should go inside the wall, since its moved that far.