The Thundering Herd has thundered, apparently.

I kinda assume it's because one went down and a large amount of work shifted to another.

I'm also aware that they have overlap in some areas on data centers.

Maybe the stack behind it is down, like AWS or something

They all rent compute from SpaceXAI

I assume it cascaded from one provider to the other as people who lost claude access for instance moved to openai who moved to grok when it went down, etc.

Probably same public cloud or CDN in front of them.

Think of it like one big distributed system. OpenAI is down, so people migrate to Claude, now this one gets overloaded and goes down, etc.

So not a coincidence, one went down first and users migrated causing further DOS. At least that's my guess.

Some npm library that makes headers bold would be broken.

Too early to know, let’s wait and see

SkyNet is arming..

Well no one said it yet so I will, "international actors" is at least a possibility. And I don't mean any specific country because pretty much anyone is a potential these days, which makes it a perfect cover for different anyones. Demonstrating vulnerability in the US's AI boom can move the markets. That's a financial incentive and a strong geopolitical one.

More likely just cascading overload though: "Never attribute to malice what can be explained by incompetence", or in this case, "growing as fast as possible"

My gut feeling tells me it has something to do with Cloudflare. Along with AWS, they're two of the main suspects in such incidents.

Pretty sure it's a US thing since it's available here in France. What exactly is down, idk

They're all using Cloudflare.

everything in this thread is raw speculation, obv, but if i had to put money on anything i'd say this is a left-pad incident. some piece of something or other that all of these services happen to depend on went down. Second most likely seems to be some random failure of one leading to an unexpected traffic spike in others, though it seems like we've been talking about automated scalability in web apps for so long that there should at least be a response to, if not a solution for, this sort of problem.

according to https://downdetector.com/ Gemini is down too (and copilot, but that just uses ChatGPT right?)

What about a hard-takeoff scenario of an unleashed OpenAI Astra taking other models down for computational resources control?

The IRGC has cut the fiber-optic cables in the Strait of Hormuz. LOL

ChatGPT is up

chatgpt is back

Heard on the grapevine that the OpenAI blip was a cloudflare issue

claide.ai is working for me, so is chatgpt.com. grok still has a status message about issues, i can't try it without signing up.

they all rent compute from each other

I suspect Azure is having issues, Microsoft has had outages the paat two days, especially with email.

Didn't SpaceX overbuilt infra and leases it out Anthropic? I f their dc goes down it probably takes a chunk out of Claude's capacity before even considering the flood of users switching over

Obvious answer is it's the AI singularity. Been nice run for humanity. So long everyone.

Seeing 503s on Gemini via API as well

Fable 5.1 got released and generally I tend to think as soon as there's a new release there's this massive spike in people benchmarking & comparing, that services tend to go slow everywhere as everything gets super loaded. This should hypothetically be visible on OpenRouter too, so I guess someone could check and see if there's any merit to this idea.

My guess is someone pulled the switch to go back to the Dark Ages. [0]

[0] https://www.youtube.com/watch?v=YCzitO446ZY

Somebody in another thread said gastown and wheelhouse automatically move to the next provider if one fails.

Cloudflare, Azure, AWS, and Google Cloud all have a similar uptick in reported errors around 7:30. I suspect an outage on Cloudflare or another load-bearing service cascaded through all the major cloud providers.

https://downdetector.com/status/cloudflare/

https://downdetector.com/status/windows-azure/

https://downdetector.com/status/aws-amazon-web-services/

https://downdetector.com/status/google-cloud/

It's always DNS

Traffic rerouting through NSA had a hiccup…

Users perceiving the products as largely interchangeable and quickly DDoS'ing the other providers when one is down. So much for the possibility of a moat.