All systems operational

The power failure and associated infrastructure failures in Amazon US-EAST-1 impacted several CloudBees servers and core infrastructure.

We have since worked around this outage and brought replacement servers online in a different data-centre.

All systems are working correctly.

Power failure - Resolved

There has been a power outage in one of our provider's data-centres.

We are actively failing-over services to another data-centre in the same region.

shared routing service latencies resolved

We have made some changes that have resolved problems with some apps in US (that were not using SSL) receiving 502 errors (and generally being slower than usual).

Increased latencies for RUN@cloud apps on shared routing service

We are looking into slowness (increased request latencies) for RUN@cloud apps that use the shared routing service in the US. Apps that use SSL or their own routing service are not affected, nor are EU apps. We expect a resolution soon.

RUN@cloud back to normal

Normal service should be restored. We had to restart some applications (and there may be some limited application restarts to come). Many apologies.

Working through deployment problems

We are working through a list of apps that had deployment problems and restarting them, things should resolve shortly, sorry about the interruption.

RUN@cloud new deployment problems

We are working on problems with the RUN@cloud console and new deployments.

Services back to normal

Service is restored (and website is also back), things are back to normal.

cloudbees.com (website) intermittent

We are working to restore the website - but peoples apps and databases take priority. Grandcentral.cloudbees.com is available, as is the support site. Full service back shortly.

Some servers are unavailable

A data centre has gone offline (or is severely struggling) and this is affecting some applications and services. We are working to migrate applications and restore service ASAP.

Shared routing service problems resolved

All applications should be back to normal.

Problems with shared app routing service

We are working on fixing problems that the shared routing service (for *.cloudbees.net applications) is currently having. This is causing problems when some new applications are deployed (deployments may fail temporarily, or apps be temporarily unavailable).

Those with dedicated routers (SSL service) should be unaffected.

We hope to have this resolved shortly.