UCB Team - build delays (24 February 2017)

Hello -
Some builds in Cloud Build are currently delayed; one of Cloud Build’s two environments has run into some internal errors initializing new build machines, which are being diagnosed and worked on now. Look for an update with more info soon when it’s fully back in action.

Any builds that are currently queued (“waiting for available build agent” or “queued”, or any other pending status) will be processed automatically as soon as possible either by the remaining or restored capacity.

Update: resolved, and the few remaining queued builds are being processed now. For the curious, a PuppetDB process ran out of memory - it was then automatically killed and restarted as it was configured to do, but that took longer than expected (it ended up coming back online shortly after the team started investigating what had happened, naturally). That system looks healthy now, and the team will check if there’s some further scaling or resizing to do there as Cloud Build grows.