Okay so I am assuming you are just applying force to the ball. That is why. The ball is sliding and when it hits a bump, it bounces. To move the move, do not apply a force. Instead apply torque and cause the ball to rotate. If you have friction on the material, it should roll. Then it should hopefully just roll over the bump (if you have enough friction so that sliding is not a problem).
If the blocks are the same colour & you don’t want gaps just use 1 block & change its scale along that axis so it is as long as you want. That way there’s no gap/s