I already solved the performance issues by optimizing how shadows are generated in Unity, and also applied some visual softening. But thanks for the reference, I will take it into account in case I find any new technical impediment.
https://discussions.unity.com/t/844784