VR controllers don't track in editor until OpenXR plug-in provider is toggled

I’m running into an issue every time I load my VR project. I’m noticing that in play mode, the controllers don’t track until the OpenXR plugin provider in the XR Plugin Management settings is turned off and back on. I’m having to do this every time I reload Unity. This issue is not present in builds.
This wasn’t an issue until the project was upgraded from 2021.3.23f1 to 2022.3.22f1. Obviously, this is a migration issue but I’m unsure how to fix it.
Any help would be greatly appreciated. Thanks!

EDIT: I’ve made a new project from scratch and discovered this wasn’t a migration issue. The issue is with XR Interaction Toolkit 2.5.4. Does anyone have any info?

Maybe update to the latest 2022 version. That one is quite old already. If it happens in the latest, file a bug report