Syncing a collider to a video

I am working on a top down bullet hell style shooter. I had the idea to use a video texture as the scrolling background to save on draw calls ala Ikaruga… My question is: to have the background be interactive how can I sync the video playback to move colliders in tandem with the spatial aspect of the video? I imagine using Videoplayer.Time would enable me to map the time elements spatially but I am struggling with having the colliders move in sync with the respective video objects while onscreen. Any suggestions or thoughts?

My initial instinct is to take the total spatial length of the video sequence / divide it by the time and pass that movement chunk to the overlapping colliders…