HDRP High Quality Shadow Filtering really noisy for some reason

When I had set my HDRP quality setting to High the entire scene became super noisy, so I did a little digging and the culprit seems to be the High Quality Filter under Shadows, but has anyone seen this before?

This object is completely untextured and best shows what I mean, but this weird noise pattern is on the entire scene and only disappears when I toggle the Shadow Filter down to Medium or below. Is this my GPU being not up to the task or is this something I can fix in engine?

I have the same problem, only worse!
I am trying to solve it two days straight! I can’t find a way to solve this!