Not without using proper forces and masses. Also use Physics materials. This isn’t rocket science, it’s the easiest possible use of the physics engine. Playing with settings is normal.
The top gif is what would actually happen if a radio car hit a blow-up plastic football.
You’ll have to fiddle with settings, but there are some things you could try:
tuning the mass of the car and ball. When two (non-kinematic) things hit each other, the amount of force is dependent on their mass. This is how physics work IRL too - a 1 kg thing hitting something at 20kph is not going to give as much force as a 100kg thing hitting something at 20kph.
create an invisible box collider at the front of your ride. Set up colliders that makes it only collide with the ball. Angle it upwards. This will mean that the ball doesn’t glide off your hood as it’s doing now.
Manage the collision force through scripting. This will give you The Ultimate Level Of Control, but it’ll take a lot of time to make it look “realistic”.