Elevated Errors in China Network Colos

Updates timeline

1. Investigating Oct 10, 04:13 AM UTC

   We are investigating a spike in errors observed in our China colos.

2. Identified Oct 10, 05:48 AM UTC

   The issue has been identified and a fix is being implemented.

3. Identified Oct 12, 04:23 AM UTC

   We are investigating reports of degraded performance for traffic traversing the public internet between certain cities and provinces in mainland China and origin servers located outside the region. The impact is being reported across multiple ISPs and manifests as slower speeds or intermittent timeouts. While this congestion occurs upstream of Cloudflare's network, our engineering team is actively working to mitigate the effects. Intermittent 524 timeout errors is expected to continue due to ongoing congestion. While there is no fixed timeline for full resolution, as there are dependencies outside our network, we are taking steps to reduce customer impact.

4. Identified Oct 12, 03:33 PM UTC

   We have identified that increased latency and 5xx errors affecting certain China Network colos are caused by cross-border routing instability in the China network. We are actively working to mitigate impact for affected customers by adjusting traffic routing, and are continuing to work with our network partners on a resolution. Customers experiencing issues may contact Cloudflare Support.

5. Monitoring Oct 14, 05:50 PM UTC

   A fix has been implemented and we are monitoring the results.