Network connectivity in us-east-1-az4

Updates timeline

1. Investigating May 8, 12:50 AM UTC

   Increased connection times for Supavisor since about 00:10 UTC is affecting a limited number of projects in us-east-1

2. Identified May 8, 01:06 AM UTC

   We have identified the root cause of the connection issues as an outage with an upstream provider affecting a single availability zone (us-east-1a). All affected projects are located in this zone.

3. Identified May 8, 02:05 AM UTC

   We are waiting on a resolution from our upstream provider. We will provide an update in an hour.

4. Identified May 8, 02:30 AM UTC

   We have disabled project creation in us-east-1. We will provide another update in an hour, if not sooner.

5. Identified May 8, 03:11 AM UTC

   We've disabled pausing projects in us-east-1. We recommend not changing project configurations at this time. Users cannot access their databases or run any authentication-dependent services. We are continuing to monitor this situation with our upstream provider.

6. Identified May 8, 04:21 AM UTC

   We are continuing to work on a fix for this issue.

7. Identified May 8, 05:30 AM UTC

   We are continuing to work on a fix for this issue.

8. Identified May 8, 05:31 AM UTC

   We're starting to see a number of affected projects starting to recover. We're still working with our upstream providers on a full recovery of all affected projects.

9. Identified May 8, 06:44 AM UTC

   Affected projects are continuing to recover. We are monitoring the recovery of the AZ and will provide regular updates until full recovery.

10. Identified May 8, 07:59 AM UTC

    Affected projects are continuing to recover. We are monitoring the recovery of the AZ and will provide regular updates until full recovery.

11. Identified May 8, 10:52 AM UTC

    Affected projects are continuing to recover. We are monitoring the recovery of the AZ and will provide regular updates until full recovery.

12. Identified May 8, 12:09 PM UTC

    Our team is actively working to bring impacted projects back online as quickly and safely as possible. While we are seeing progress, full recovery may still take several hours based on the latest guidance from our infrastructure provider. We appreciate your patience and will continue to share updates as more information becomes available.

13. Identified May 8, 04:34 PM UTC

    Our team continues to make progress restoring impacted projects safely and as quickly as possible. To support recovery efforts, project pausing and new project creation in the us-east-1-a4 region continue to be disabled. While recovery efforts are moving forward, full resolution is still expected to take several more hours based on the latest guidance from our infrastructure provider. We understand the impact this is having and appreciate your continued patience. We’ll continue to share updates as more information becomes available.

14. Identified May 9, 01:32 AM UTC

    Our team continues to make progress restoring impacted projects safely and as quickly as possible. To support recovery efforts, project pausing and new project creation in the us-east-1-a4 region continue to be disabled. While recovery efforts are moving forward, full resolution is still expected to take several more hours based on the latest guidance from our infrastructure provider. We understand the impact this is having and appreciate your continued patience. We’ll continue to share updates as more information becomes available.

15. Identified May 9, 04:10 AM UTC

    Our infrastructure provider has resolved the underlying incident, and the majority of impacted projects have now recovered. Our team is currently working through the remaining projects that did not automatically self-heal during recovery and is actively restoring them manually where needed. We have also re-enabled project creation, pausing, and compute resizes in the us-east-1 region. We are continuing to monitor platform stability closely and will provide additional updates as recovery progresses.

16. Monitoring May 9, 04:34 AM UTC

    Our infrastructure provider has resolved the underlying incident, and impacted services have recovered. We have completed recovery efforts for affected projects, re-enabled project creation, pausing, and compute resizes in the us-east-1 region, and are now monitoring the platform to ensure continued stability.

17. Resolved May 9, 04:49 AM UTC

    Recovery efforts are completed and this incident is now resolved. Thank you for your patience throughout this incident.