Project Lifecycle Issues in eu-west-1

Updates timeline

1. Investigating Sep 24, 03:36 PM UTC

   We are investigating project lifecycle operation issues in eu-west-1.

2. Identified Sep 24, 03:50 PM UTC

   We have isolated the scope of the problem to a specific upstream incident. We are working to address the upstream incident and determine mitigations.

3. Identified Sep 24, 04:23 PM UTC

   All projects affected by the upstream infrastructure issues, and mitigation efforts are underway internally. These affected projects will be brought back up on new hardware as quickly as possible.

4. Identified Sep 24, 04:56 PM UTC

   Most projects have been brought back up, and the team is working on the remaining projects, which should be completed soon. This issue was related to specific underlying hardware in the region, so this was isolated to only projects on that hardware. Project lifecycle operations (restarts, upgrades, etc) broadly across the region remain available.

5. Identified Sep 24, 05:03 PM UTC

   The remaining projects have now been brought back up, and we have no projects remaining on the unhealthy underlying hardware in the upstream infrastructure. We are monitoring to ensure ongoing stability.

6. Monitoring Sep 24, 05:12 PM UTC

   We are continuing to monitor to ensure ongoing stability.

7. Resolved Sep 24, 05:38 PM UTC

   This incident has been resolved.