What this tests
retry-logicmonitoring
Point your client at this specimen and find out — before prod does — whether it backs off, retries, and knows when to stop.
Anatomy
A routine network change in the busiest locations withdrew prefixes it shouldn't have, and nineteen cities briefly forgot how to internet. Not all of them — that would be honest work. Just enough that half your users saw errors while the other half refreshed smugly and concluded you were lying about the outage. This is the geographically-weighted coin flip, the failure mode that makes "works on my machine" an internationally distributed problem. Your client in London: dead. Your client in Frankfurt: fine. Your monitoring: split down the middle like a committee. Fifty-fifty success on a per-request basis — the specie of flakiness that survives retries by luck and dies by statistics. If your test suite retries three times and calls that resilience, this specimen passes it one time in eight and fails it seven. Which, if you think about it, is the point.
Source: Cloudflare blog — Cloudflare outage on June 21, 2022 · 2022-06-21
Replay it
curl -i https://faultydata.com/r/FD-2026-024
// response appears hereSignature
{Status:0 Headers:map[] Body: Corrupt: Delay:<nil> Flaky:<nil> Sequence:<nil> Drip:<nil> StallAfter:0 Hang:false Reset:false Raw: Phases:[{Weight:50 Signature:{Status:500 Headers:map[] Body:{"error":"internal server error"} Corrupt: Delay:<nil> Flaky:<nil> Sequence:<nil> Drip:<nil> StallAfter:0 Hang:false Reset:false Raw: Phases:[]}} {Weight:50 Signature:{Status:200 Headers:map[] Body: Corrupt: Delay:<nil> Flaky:<nil> Sequence:<nil> Drip:<nil> StallAfter:0 Hang:false Reset:false Raw: Phases:[]}}]}
Keep digging
FD-2026-002 — CDN edge degradation (Fastly, June 2021) FD-2026-021 — S3 us-east-1 subsystem removal (AWS, Feb 2017) FD-2026-044 — Three-day outage from a consensus bug (Roblox, Oct 2021) FD-2026-059 — East-west network partition (GitHub, Oct 2018) FD-2026-089 — Launch-day capacity collapse (Pokémon GO, Jul 2016) FD-2026-003 — Elevated latency + partial 5xx (AWS us-east-1, Nov 2020)