Got a similar issue some time ago, not sure it will work in every case but if that helps, here is what I did :
I found out that in my case the issue was related to VSync being enabled and somehow messing with the game in the background, the simplest solution I found was to add a monobehaviour implementing the function “OnApplicationFocus” on a gameobject that has DontDestroyOnLoad attribute and automatically enable/disable VSync depending on wether or not the application is focused
Edit : looks like from other threads ( Unity Silicon crashes when minimize Game Window or turn off Vsync ) that it indeed has to do with VSync.