Failures to load data across multiple services on the Vercel dashboard, API, and CLI

Updates timeline

1. Identified May 5, 03:15 PM UTC

   We've identified an issue where various services in the Vercel dashboard, API, and CLI are failing to load data. These services include Observability, Speed Insights, Alerts, Usage, Web Analytics, Firewall, and CDN observability. Broadly, areas backed by analytical data are affected. We have identified the issue and are working on a fix. Production applications running on Vercel are not impacted.

2. Identified May 5, 03:58 PM UTC

   We are continuing to work on a fix for this issue.

3. Identified May 5, 04:30 PM UTC

   We are seeing services start to recover as we incrementally apply the fix.

4. Identified May 5, 04:37 PM UTC

   Reading data from impacted services has recovered. We are working to backfill any missing data in Observability.

5. Monitoring May 5, 04:50 PM UTC

   Impacted services have recovered. We are continuing to monitoring, while backfilling remaining missing data.

6. Monitoring May 5, 05:12 PM UTC

   We are continuing to monitor for any further issues.

7. Monitoring May 5, 05:14 PM UTC

   All systems are operational. We are continuing to monitor the backfill process, which is expected to take a couple of hours. New data is being processed as expected.

8. Resolved May 6, 12:38 AM UTC

   All services remain operational. New data is being processed as expected. The majority of the backfill is complete and a long tail of data will be processed within the next couple of hours.