Answering my own question… found this article: Window as transparent overlay not working since 2018.3.0b12
Seems there was a change in more recent versions of Unity that requires this checkbox to be unchecked in order for transparent windows to work, its checked by default:
Build Settings → Player Settings → Player → Resolution and Presentation → Use DXGI Flip Model Swapchain for D3D11