frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Anthropic appears to be A/B testing reduced effort levels in Claude Code

https://twitter.com/argofowl/status/2091150597374537729
49•matthieu_bl•1h ago

Comments

N_Lens•56m ago
I suspect it's not just this, there's plenty of 'optimization' around rubberbanding usage limits as well as routing to a different model in the backend. The incentives are too strong.
rrr_oh_man•48m ago
I've been using the API (shameless plug: via alyph.ai) and the difference is crazy.

The chat-based models are obviously being lobotomized based on personal usage and general load (e.g. PST business hours are worst).

API doesn't seem to be affected by this.

Wowfunhappy•47m ago
...the evidence, as best I can tell from the tweet, is that they asked Claude what effort level it was set to. But how would the model even know that?

Not convinced here.

jerbear4328•44m ago
Effort level is actually controlled entirely by system prompt (as I understand it, the model is trained on that format but still), so actually this is a valid way to check I think
Wowfunhappy•39m ago
I know that's true for Qwen but I don't think most models work that way?
wren6991•18m ago
OpenAI models also work this way, as evidenced by full cache blowout when changing reasoning level. Every single open-weight model I've seen also works this way (your "reasoning_effort" argument just changes a small section of the system prompt in the chat template). I would have to see some evidence to believe Anthropic were doing anything different.
ranie93•42m ago
I don’t know if this is still the case but while using Copilot if you looked through the chain-of-thought output you would see it reasoning about a “budget”. i.e. “since I’m close to the session budget I should…”. So it could be possible
varispeed•27m ago
Then model can say it's Opus, but really it is some old Sonnet. This seems to be happening less often, but some weeks ago I had to give models some test problems to gauge whether I am getting Opus or something knee-capped.

The problem is that Anthropic seems to be getting away with selling one thing and delivering another. You pay for Opus, you get something else etc.

pizzafeelsright•44m ago
Whatever Opus 5 is doing should not happen.

Prompt was "read and update the config file with new data". This work on 4.6 takes <2 minutes to read the file, parse the new data, and patch.

Opus 5 Result: 43 minutes of pulling containers, running sandboxes, creating testing suites, which included evaluating the entire repo beyond the scope of the config file.

Both: one file modification

clickety_clack•40m ago
Yep, they’re lighting tokens on fire with that thing.
vinyl7•39m ago
AI companies have a financial incentive to burn more tokens than the task actually needs
Rudybega•23m ago
This is only true if they can't saturate token production with a model that does less superfluous things. Given that they can (they're hilariously compute strained), having a model that solves tasks more quickly adds way more perceived value to users.
chrisjj•23m ago
A.k.a. theft.
pizzafeelsright•4m ago
Agreed although the differences between the effort and reasoning is massive. I generally ship 40 hours in three with AI. I could not figure out why my delivery was behind until I started going through the logs. The thinking was extensive, the effort was beyond the original request by a magnitude of 50x
Glyptodon•39m ago
I mean whatever models I use (with Claude code) sub agents seem to use absurd amounts of tokens for trivial (or at least small) tasks.
Insimwytim•37m ago
LLM users don't want to put in effort, so they offload tasks to LLM.

LLM doesn't seem to be keen to put in effort either!

Is this AGI?

perching_aix•37m ago
I have been as well. Based on my own sessions, Max vs Max, same 1M context window size, the literal majority of the cost overhead of Opus vs Sonnet comes from Opus being chattier. So I started using Low reasoning instead of falling back to Sonnet, and I've been really happy with the results. Way better quality at a comparable spend. I also rarely go past High lately, which was another major cost save.
arjie•33m ago
Is it actually entirely a prompt-based information? I’d assume that some of it is the harness part of the agent setting reasoning token budget and compacting reasoning etc.

In that case, the agent will respond incorrectly because it has no visibility into what reasoning mode it’s in.

willy_k•20m ago
IIRC responding to effort level settings appropriately is part of the (post)-training. In that case it could be considered another instance of the Bitter Lesson. Uplifting.
adithyassekhar•29m ago
Does anyone know what setting effort means for models like these? Do they allow longer thinking sessions? Some kind of system prompts? What’s stopping someone from getting max effort output from low effort setting?
willy_k•15m ago
My understanding is that the current effort settings is a part of the system prompt, and that the levels and their intended results are a part pf the training process. The effect is more or less tokens spent reasoning before the model outputs a stop token. However it is as consistent as any other aspect of LLM behavior is..
matheusmoreira•25m ago
So glad I switched away from Anthropic. I'm certainly running into problems with OpenAI but nothing quite on the level of Anthropic's insufferability.
MuffinFlavored•22m ago
I submitted an application for Anthropic's Cyber Verification Program.

I was approved.

3 months later, my approval was degraded into "in review" (revoked). I'm sure my account was flagged based on contents of debugging/researching firmwares/etc.

I opened a support ticket. No response. I opened another support ticket. No response.

1-2 weeks later, I got a response that I will not be re-approved and I need to reapply. No problem.

The page to reapply on does not allow me to re-apply because it my account is stuck in an "in review" status.

https://github.com/anthropics/claude-code/issues/84352

The community thinks it's a bug. I'm 95% sure it's not and a bunch of us who were previously approved had it revoked due to flagged content and will not be reapproved.

I switched to Codex + got TAC approved instantly and have not looked back. It's a shame. That's 100% separate from whatever the heck the quality of Opus 5's outputs are. The way it talks... insane. I would bet a good amount of money their next release will focus "reduced simplified responses" if I had to guess.

$2t company by the way

benjiro29•2m ago
* Anthropic's Cyber Verification Program // Codex + gotTAC approved*

Meanwhile the Chinese models are "go ham dude"...

If it was not for capacity issues, Chinese models have a higher change to just dominate.

> $2t company by the way

It used to be that OpenAI and Anthropic had such a moat around them, that such a valuation was worth it. But these days, its gross overvalued (like so many).

The more stuff is being pulled like cyber verifications, downgrading effort levels, downgrading usage (OpenAI), the more people move to those Open Weight Chinese models.

A fun recent event ... https://opencode.ai/data/

When DeepSeek Flash 0731 came out and provided a massive jump in cheap inference capability. It resulted in a 10x increased OpenCode token usage.

It took a 2.5x to 5.0x price increase AND a reduction by 4x usage (later to 2x) usage, and several cheaper models + a free model, to push the traffic down.

Traffic towards open weight models is increasing, even if providers can not keep up with the influx of new customers. This is not something you want to see as two companies, trying to go for IPOs.

So the idea of stonewalling cyber capabilities, when the rest of the world is just doing whatever with open weight models, on their own hardware even! This entire strategy from Anthropic never made any sense.

boredumb•18m ago
Not specifically Anthropic but why are we allowing billing to take place in tokens that are nebulous and fully controlled by the operators who have no aligned incentives?

If I have a user input and then sanitize and inject that into a prompt to do something, I have no idea how much that is going to cost at all and no real way to measure this properly. A parallel example is digital ocean or aws, i can go and measure/limit my compute/fs/memory/startup times/etc and while it can be impossible to get down to the last flop of money allocated - i can run things on a real budget with real constraints, opposed to an LLM where I have to .. prerun a sanitized user prompt through a tokenizer and then ask an LLM to guess what it may do and give token consumption estimates and then act on those in any sane manner for the user?

Perhaps i'm missing something to do realistic and static rails on things but I don't see a serious way at scale to use the token billing model handling things requiring a users free text input short of having to go pander to VC money to throw money at it until someone else figures it out.

*to clarify my rambling... We should be billed and given controls based on resource usage itself and not an opaque token concept on top of not being able to spin any knobs that control it's resource usage.

demibabs•16m ago
How else would they bill tho? Their operating cost is per token.
dijit•6m ago
Charge on the input tokens, then you will naturally optimise for fewer output tokens.

Theoretically.

In reality, one sessions output tokens become the next sessions input tokens (at least if you continue the topic) so, its not as aligned as all that.

But the parent is right, when incentives are not aligned, friction will happen. Its inevitable.

ACCount37•5m ago
karmicthreat•11m ago
What’s currently the best pattern if I want to combine Fable and GPT if a workflow but keep using subsidized tokens?
fractorial•8m ago
Roll your own harness or use an open source harness with a Codex subscription.

I maintain a Claude subscription for Fable but seldom use it.

hmokiguess•27m ago
The business bottom line depends on tokens, shareholders want to see exactly that.
daishi55•13m ago
With how competitive the LLM field is, it would surprise me greatly if any of these players were doing anything other than trying to make the best possible product. I certainly do not believe they are intentionally training the models to use more tokens unnecessarily.
cyanydeez•6m ago
Theyre training the system to minimize compute,so most likely theyre dynamically downgrading quants in the first few turns hoping to find the cheapest model to run. The side effect may be excessive token gen
guluarte•22m ago
and ending with: "One thing I need to tell you:" and bunch of AC, R1 and §
rshnotsecure•16m ago
Thought I was going to be on Claude Code forever.

Recently got approved at work for ChatGPT Pro so I could use Codex.

Blown away by the speed. It feels like using Claude Code for the first time again. I don't think Codex is doing anything revolutionary, just better handling of which requests should go to which model, and having faith in some of the "less powerful" models for more than you would think.

It seems the TUI coding experience is very much an open race. This is motivating me to look at other agents / harnesses as well (maybe Gemini, OpenCode, etc).

brador•12m ago
Gotta milk the cows homie.
Foobar8568•3m ago
Opus 5 in xhigh can't do basic math as well. They dumbed it down to a point where I just cancelled my subscription yesterday. I used to be a $200 subscriber, dropped to $20 after the fable shenanigans, and use it only when I have no usage left with Codex.

/on The prose is load-bearing unbearable — every sentence feels like it was engineered to sound profound rather than to be read.

And tokens can be metered reliably. Unlike something like "task completion".
bob1029•11m ago
> the operators who have no aligned incentives

The model providers are quite aligned with concerns like customer retention. These arguments only work if there is no competition. We exist in a marketplace of black boxes. There's not just "the one" you must suffer. You have options. You can build your own too.

boredumb•7m ago
there are roughly three of them and they all use the same pricing model. I am also not in the position to build a frontier model company these days.
daishi55•4m ago
For OAI and Anthropic at least you can set a spend limit per response. Also tokens are well-defined.

ElevenLabs, TwelveLabs, ThirteenLabs

https://quantumi.sh/public/labs.html
125•jemoka•3h ago•50 comments

A Friendly Introduction to Racket

https://geometridae.bearblog.dev/a-friendly-introduction-to-racket/
70•signa11•4h ago•18 comments

New MCP Roadmap

https://blog.modelcontextprotocol.io/posts/mcp-roadmap/
128•pentagrama•4h ago•95 comments

RF Cafe

https://www.rfcafe.com/
28•gregsadetsky•3d ago•4 comments

Munder Difflin – Agent harness to run an office of your clones

https://munderdiffl.in/
198•simonpure•8h ago•81 comments

Learning about "The Unix Time-Sharing System"

https://playtechnique.io/long/the-unix-time-sharing-system.html
14•gwynforthewyn•2h ago•3 comments

Hister – A private, full content search index that you control

https://hister.org/
17•auraham•3d ago•0 comments

Z80 – The 1970s Microprocessor Still Alive (2021)

https://www.computer.org/csdl/magazine/mi/2021/06/09623402/1yJTvlRLmhi
88•asdefghyk•8h ago•43 comments

Belgian car salesman becomes prince after DNA test proves royal parentage

https://www.cnn.com/2026/08/22/europe/prince-belgium-secret-son-scli-intl
36•MilnerRoute•1h ago•20 comments

Show HN: Rotation via Double Reflection

https://static.laszlokorte.de/rotor-reflect/
36•laszlokorte•1d ago•8 comments

Anthropic appears to be A/B testing reduced effort levels in Claude Code

https://twitter.com/argofowl/status/2091150597374537729
51•matthieu_bl•1h ago•41 comments

Ameliorate

https://ameliorate.app/
50•hakkikonu•1d ago•15 comments

Rust Glancer: Rust LSP using 100x less RAM

https://rust-glancer.github.io/blog/hello-world/
370•matklad•22h ago•82 comments

Dynamical dark energy and the week that broke cosmology

https://perimeterinstitute.ca/news/dynamical-dark-energy-and-week-broke-cosmology
17•rznicolet•1d ago•1 comments

Felony Bench

https://www.felonybench.com/
806•colinprince•1d ago•321 comments

What's in a PowerPoint File?

https://editide.com/blog/what-is-a-pptx-file/
16•danielochoa0620•3d ago•10 comments

Kobo can run apps now

https://bandarlabs.github.io/Cobalt/
633•thepoet•1d ago•201 comments

Why it might be time to rethink the human family tree

https://nautil.us/why-it-might-be-time-to-rethink-the-human-family-tree-1283985
13•Anon84•2d ago•8 comments

Felony charges for citizen deleting phone data at US Border

https://www.nytimes.com/2026/08/21/us/politics/samuel-tunick-deleted-phone-felony.html
1005•floathub•1d ago•1224 comments

typ.ing

https://typ.ing/
16•bookofjoe•4d ago•3 comments

MiniageOS: "Dumbphone" Version of LineageOS

https://github.com/ofdryads/miniageOS
15•ashenke•2d ago•5 comments

Show HN: Anonymous age verification with passkey-powered encryption

https://loginwithone.com/
17•mikeysight•3d ago•9 comments

Stop Making TUIs

https://sockpuppet.org/blog/2026/08/20/stop-making-tuis/
349•underdeserver•1d ago•447 comments

I accidentally logged hundreds of thousands of phone calls to military bases

https://lina.sh/blog/hijacking-e164-arpa
636•gavide•1d ago•82 comments

Canada will match US tariffs 'dollar for dollar' as trade talks break down

https://www.bbc.com/news/articles/cvgvyy4x2mvo
156•tartoran•12h ago•740 comments

Kagi added a setting for removing paywalled links from search results

https://kagi.com/changelog#11296
1216•speckx•1d ago•379 comments

There's no reason for software to be slow anymore

https://danluu.com/perf-opt/
590•Jach•17h ago•440 comments

Hook, hold, harvest and hide: Meta's alleged strategy laid out in first week

https://www.theguardian.com/technology/2026/aug/22/meta-trial-children-privacy
176•sbulaev•6h ago•140 comments

Zig’s Io.Threaded is neat

https://matklad.github.io/2026/08/06/neat-io-threaded.html
137•chilipepperhott•1d ago•81 comments

Scientists release biggest 2D map of the universe

https://newscenter.lbl.gov/2026/08/10/scientists-release-biggest-2d-map-of-the-universe/
247•NKosmatos•23h ago•65 comments