Failed to destroy editor windows:

I got an error
Invalid editor window UnityEditor.FallbackEditorWindow
UnityEditor.EditorApplicationLayout:FinalizePlaymodeLayout()
I looked for the answer, found it, and did it but then got this error.

I have the same issue and nothing seems to help. I am on the 2020.2.3f1 yet I see people posting about this error going back to 2019. Any solutions here as it is so annoying.