Ask HN: Claude Opus performance affected by time of day?

15•scaredreally•5h ago

I am a big fan of Claude Opus as it has been very good at understanding feature requests and generally staying consistent with my codebase (completely written from scratch using Opus).

I've noticed recently that when I am using Opus at night (Eastern US), I am seeing it go down extreme rabbit holes on the same types of requests I am putting through on a regular basis. It is more likely to undertake refactors that break the code and then iterates on those errors in a sort of spiral. A request that would normally take 3-4 minutes will turn into a 10 minute adventure before I revert the changes, call out the mistake, and try again. It will happily admit the mistake, but the pattern seems to be consistent.

I haven't performed a like for like test and that would be interesting, but has anyone else noticed the same?

Comments

bayarearefugee•1h ago

I mostly use Gemini, so I can't speak for Claude, but Gemini definitely has variable quality at different times, though I've never bothered to try to find a specific time-of-day pattern to it.

The most reliable time to see it fall apart is when Google makes a public announcement that is likely to cause a sudden influx of people using it.

And there are multiple levels of failure, first you start seeing iffy responses of obvious lesser quality than usual and then if things get really bad you start seeing just random errors where Gemini will suddenly lose all of its context (even on a new chat) or just start failing at the UI level by not bothering to finish answers, etc.

The sort of obvious likely reason for this is when the models are under high load they probably engage in a type of dynamic load balancing where they fall back to lighter models or limit the amount of time/resources allowed for any particular prompt.

kevinsync•1h ago

I suspect they might transparently fall back too; Opus 4.5 has been really reasonable lately, except right after it launched, and also surrounding any service interruptions / problems reported on status.claude.ai -- once those issues resolve, for a few hours the results feel very "Sonnet", and it starts making a lot more mistakes. When that happens, I'll usually just pause Claude and prompt Codex and Gemini with the same issue to see what comes out of the black hole.. then a bit later, Claude mysteriously regains its wits.

I just assume it went to the bar, got wasted, and needed time to sober up!

scaredreally•1h ago

Precisely. Once I point out the fact that it is doing this, it seems to produce better results for a bit before going back to the same.

I jokingly (and not so) thought that it was trained on data that made it think it should be tired at the end of the day.

But it is happening daily and at night.

woleium•50m ago

I find it helps to tell it to take some stimulants

stavros•39m ago

I didn't believe such conspiracy theories, until one day I noticed Sonnet 4.5 (which I had been using for weeks to great success) perform much worse, very visibly so. A few hours later, Opus 4.5 was released.

Now I don't know what to think.

janalsncm•1h ago

It’s possible that they could be using fallback models during peak load times (west coast mid day). I assume your traffic would be routed to an east coast data center though. But secretly routing traffic to a worse model is a bit shady so I’d want some concrete numbers to quantify worse performance.

dcre•1h ago

To be clear, the company has very directly denied doing this.

causal•1h ago

I've had the same suspicion for various providers - if I had time and motivation I would put together a private benchmark that runs hourly and chart performance over time. If anyone wants to do that I'll upvote your Show HN :)

oncallthrow•1h ago

For what it’s worth, Anthropic very strongly claim that they don’t degrade model performance by time of day [1]. I have no reason to doubt that, imo Anthropic are about as ethical as LLM companies get.

[1] https://www.anthropic.com/engineering/a-postmortem-of-three-...

joshribakoff•1h ago

Banning paying users with no warning doesn’t seem super ethical. Probably not unethical, either, but I would not frame them as “the most ethical”

phist_mcgee•1h ago

I'd say they're about as good as the average billion dollar American tech company when it comes to ethics.

hagbard_c•1h ago

Simple, the model is tired after a long day of working so it starts making mistakes. Give it some rest and it is ready to serve again.

anonzzzies•1h ago

Many people 'notice' it (on reddit); I notice it too, but it is hard to prove. I tried the same prompt on the same code every 4 hours for 48 hours, the behaviour was slightly different but not worse or much different in time. But then I just work on my normal code, think wtf is it doing now??? look at the time and see it is US day time and stop.

People put forward many theories for this (weaker model routing; be it a different model, Sonnet or Haiku or lower quantized Opus seem the most popular), Anthropic says it is all not happening.

RickS•1h ago

I've certainly noticed some variance from opus. there are times it gets stuck and loops on dumb stuff that would have been frustrating from sonnet 3.5, let alone something as good as opus 4.5 when it's locked in. But it's not obviously correlated with time, I've hit those snags at odd hours, and gotten great perf during peak times. It might just be somewhat variable, or a shitty context.

Now GPT4.1 was another story last year, I remember cooking at 4am pacific and feeling the whole thing slam to a halt as the US east coast came online.

UncleEntity•23m ago

>> ...or a shitty context

This is my guess, sometimes it churns through things without a care in the world and other times is seem to be intentionally annoying to eat up the token quota without doing anything productive.

Kind of have to see which mode it's in before turning it loose unsupervised and keep an eye on it just in case it decides to get stupid and/or lazy.

joshribakoff•1h ago

Yep, i have long felt like i randomly get sonnet results despite opus billing. I try to work odd hours and notice better results.

jgbuddy•1h ago

It seems clear that, rather than throttling, anthropic serves lower quality versions of their models during peak usage to keep up with demand. They refuse to admit it, and it's hard to prove, but these threads consistently happen ~3 months after every single model release.

killingtime74•47m ago

Are you using the API or a subscription?

storus•43m ago

I had something similar with GPT, like a clockwork every day after like 1pm it started producing total garbage. Not sure if our account was A/B tested or they just routed us to some brutal quantization of GPT, or even a completely different model.

East Germany balloon escape

Cloudflare acquires Astro

6-Day and IP Address Certificates Are Generally Available

Cursor's latest “browser experiment” implied success without evidence

Michelangelo's first painting, created when he was 12 or 13

Releasing rainbow tables to accelerate Net-NTLMv1 protocol deprecation

LLM Structured Outputs Handbook

Just the Browser

Install.md: A standard for LLM-executable installation

Lock-Picking Robot

Slop is everywhere for those with eyes to see

Reading across books with Claude Code

CLI's completion should know what options you've typed

HTTP RateLimit Headers

STFU

Patching the Wii News Channel to serve local news (2025)

Launch HN: Indy (YC S21) – A support app designed for ADHD brains

Zep AI (Agent Context Engineering, YC W24) Is Hiring Forward Deployed Engineers

Why DuckDB is my first choice for data processing

Dev-owned testing: Why it fails in practice and succeeds in theory

Drawbot: Let's hack something cute (2025)

We Gave Our Browser Agent a 3MB Data Warehouse

Read_once(), Write_once(), but Not for Rust

Brain: PC virus [audio]

Elasticsearch was never a database

Show HN: 1Code – Open-source Cursor-like UI for Claude Code

LWN is currently under the heaviest scraper attack seen yet

Independent Guest Virtual Machine (IGVM) File Format

Our approach to advertising

The Alignment Game (2023)