PhysicsMaterial2D bounces back in a strange angle when increasing bounciness

I have a (Rigidbody2D) ball with PhysicsMaterial2d with bounciness 1 and friction 0. The pink wall has also a PhysicsMaterial2D but with bounciness 2 and with friction 0 (doesn’t have a Rigidbody2D). When ever the ball hits the pink wall, the ball doesn’t bounce back in a 90 degree angle.
187664-2021-10-19-13-57-08.gif

If I increase the bounciness of the pink wall, then the angle gets even stranger.
187665-2021-10-19-13-58-23.gif

Is there a fix for it?

Wondering if you got your answer as I’m having a similar issue with bouncing physics.