Scrollrect inertia is weird in mobile

When I set the inertia on for scrollrect, It weirdly stutters and randomly goes to the top or bottom of the scroll rect whenever I drag the scroll in mobile. No matter what the deceleration rate or scroll sensitivity is.
The only solution I found was setting the intertia to off, and I could really use a solution that keeps it on and removes this stuttering issue.

I 've changed Canvas Render Mode to Screen Space - Overlay and stopped doing that.