Entering playmode sometimes gets really long (2+ minutes)

This issue seems specific to XR due to the stack trace I got when trying to enter play mode :


I’m just having this problem after spending probably 4h without any issue.
I noticed this old thread but it only talked about SteamVR, so no idea if this is linked or not.