I have an issue where after running the game for a while some shadows from the directional light of the scene starts to flicker lightly. It then slowly builds up over the course of about 5 minutes until every single shadow from any directional light source flickers uncontrollably. Here in the debug view you can see the light shaking uncontrollably. This shaking builds up over time.
It is HDRP version 10.6
It seems to not be related to the directional light itself, as I have tried deleting it and replacing it with a fresh one. It also seems to have nothing to do with Post-processing, since it continues after I turn it all off. The only way to make it disappear is to turn off the shadows of the directional light, or set its shadow dimmer to 0, but then of course I got no shadows at all.
As I already mentioned, it is as if something slowly builds up under the hood in some way.
I know it is not much to work with, but I would greatly appreciate any ideas of what might be going on.