Yep I’ve got this too! I submitted a bug report (#1381681) a week ago, but haven’t heard from anyone yet. I’ve seen a few different threads about it, so I’m fairly sure we’re not alone @ukn !
I will say that I don’t think it’s an Apple Silicon only problem. I feels way worse on my M1 Pro, but I’m fairly sure it’s also happening on my Intel Mac.