Not sure if this just happens to me but I move around my scene view by clicking the Mouse Wheel button and the scene view will move to where I clicked as expected. But if I click and hold the mouse wheel and drag the scene then the scene will move correctly but when I release the mouse wheel it springs back some so it is no longer in the right place. Is there a fix for that? If I use the ‘Hand Tool’ move and use the left mouse button to do the same then it works just fine.
i havent noticed such issues… (now briefly tested in 2019.2, 2020.1.x - no issues)
which unity version?
Its done it all through my years of using Unity, all different versions, different PC’s, different OS’s, different mice even. It’s just on my current project there is a lot more moving around the scene than I usually do and its getting a bit annoying 
Quick video showing the way the view springs back sometimes.