Arcore will freeze rendering of my scene when I look at the sky. How to stop that?

Arcore will freeze my scene while it looks for trackable planes. I just want the rotation and camera to update during this time. Arcore by default stops rendering new frames when it looses tracking. How to make it keep rendering and updating the gyroscope rotation of camera?

Having this issue as well