This is a great optimization, but unfortunately when a probe is moved - the “look-at” target is where the probe used to be, and not where it is currently located. Seems like lookat target for probes is static on startup/awake.
Example:
You add a reflection probe to cover the interior of the car. Everything works fine, until the car starts moving and the camera looks in a different direction than where the car was originally positioned - then the probe no longer affects the geometry inside the car.
Edit: A temp fix is to switch active scene back and forth, this updates the lookat target for probes.