Delays in creation of DNS records

Updates timeline

1. Investigating Jul 27, 08:34 PM UTC

   We are investigating failures in provisioning DNS records for projects, there may be delays in creation of DNS records for new or unpaused projects.

2. Identified Jul 27, 08:39 PM UTC

   We have identified the cause of delays in DNS records creation and are actively working on a fix. We will continue to provide updates as things progress.

3. Identified Jul 27, 08:53 PM UTC

   We have identified and mitigated the issue that was blocking DNS updates. DNS record creation is succeeding, and latency has returned to normal levels. A subset of projects that encountered provisioning failures during the incident will require DNS records to be backfilled, and we are actively remediating these affected projects.

4. Monitoring Jul 27, 10:23 PM UTC

   All failed DNS creation has been backfilled, and customers should no longer see missing DNS records in their projects. DNS record creation and latency have returned to normal levels. We will continue to monitor before resolving this incident.

5. Resolved Jul 27, 10:36 PM UTC

   This incident is resolved. DNS creation for new projects has been fixed since 20:35 UTC. Backfill of missing DNS records has been completed at 22:20 UTC. Please contact Support if your project seems impacted by missing DNS records.