If the cost of serving GPT-5.6 just dropped by 20%, does that add up to literally billions of dollars in savings per month?
We know Anthropic spend $1.25 billion renting inference capacity from SpaceX (in two Colossus datacenters) from the SpaceX IPO, but we don't know how much of Anthropic's inference capacity that is (presumably a small fraction, since they were operating on top of AWS and other providers before the SpaceX deal.)
I've not seen any numbers that hint at OpenAI's per-month inference bill, but surely that has to be in the multiple billions of dollars as well.
So 20% is a really, really big deal.
> reduced inference cost by 20 percent saving company x billion dollars per month
I have no doubt that further work was required to enable this, but it's still very cool to be possible to say that.
> it doesn't feel like night-and-day.
I see what you did there. :)
Now, if cost is your concern, then that’s a problem in all of computing. Hence why I’m sending you short plain text messages using an iPhone with a many-core CPU and gigabytes of RAM.
With this new price change, Terra does look pretty Pareto’ed by Luna.
On agentic coding, pairing Sol Medium for architecting with Luna High for coding does kinda make sense. But beware that architecting can be very read-heavy, and Sol is a bit read-pricey compared to Terra.
I don't have the words.
I genuinely thought we were in a stage where we were plateauing and going in for 5-10% improvements over months. Seeing spikes like this makes me question about where the floor really is.
This is very likely priced below recovering the cost of the hardware but still above operating expenses.
I have no idea either way but one thing that detracts from these threads is folks claiming things as a fact without evidence.
makes it by far the best choice for most workloads that do not need bleeding edge intelligence (reminder: luna can be comparable to opus 5!)
Whereas Google with Gemini 3.x, Anthropic with Fable etc are happy to just go for 'big model with dense params'
It's hard to guess from the outside of course but just this kind of talking points focus on GPU efficacy is what we see from OpenAI and Chinese open source labs more often than from Anthropic or Google Deepmind and this benchmark chart seems to concur
I was already a huge proponent of Luna for things like deep research. Being able to run 5x more for the same cost is simply bananas. We are already running 10 parallel agents for hypothesis generation. I cannot imagine 50. The statistics become much more interesting & powerful when you can run so many samples of the exact same prompt+model without breaking the bank.
Taking actions that mutate the environment is a different story. I think this is where you run into diminishing returns very quickly. You generally want one strong agent to act given the results of all the searching that was done. If the plan is clear, you don't need a genius model to execute it.
One hopes that, maybe one day, we'll have completely transparent inference profit, calculable carbon footprint per token, and no more predatory market-capture tactics. Maybe one day.
It is going to be remarkable how many question will be answered when we finally get to see the S-1.
https://files.catbox.moe/csxl32.png
(2 cents to run AA index, score 40)
Looks like OpenAI broke the pareto frontier on the trust-me-bro benchmarks!
(One has to wonder if they used any of the neat tricks from the DSV4 paper :)
This applies even more strongly to model choosing. I know for a fact that majority of my work doesn't require a very strong model, but separating the trivial and non-trivial tasks is a famously hard problem (if at all decidable).
I was still using GLM-5.2 in my personal projects, but this just made Luna a very easy choice.
Haiku was already in a ditch.
But this is coming straight for the jugular of a ton of models on openrouter.
For our production app, OpenAI clearly is the best provider now. Their API is very reliable and has many nice features. The price-performance of the model lineup is incredible. We used open weights model via Fireworks for a long time (e.g. Kimi K2.5). Fireworks is a great provider but we still ran into issues here and there (Same with Anthropic and Google). OpenAI just works, is fast and in my view has a better price-performance ratio across almost all levels of intelligence.
https://deepswe.datacurve.ai/ - (See the Agent Steps view)
Or is the output speed so much higher that it cancels out?
I don't see a lot of benchmarks that record actual time. But on AA, Sol on Low beats Luna on High for Time Per Task.
Personally, I'm having surprisingly good results with DeepSeek 4 Pro at home, which is very good value for money: it's not as good as Claude / GPT 5.6 (I have Co-pilot license at work), but it's still really useful for code reviews, validating thoughts, and especially designing / writing unit tests for new (and old before refactoring) functionality.
And it's very cheap per task. (Flash is even cheaper, but I've had issues with that on more complex tasks where it starts forgetting things and arguing with itself "but wait, let me read the function again").
Anthropic's big marketing push this year has been entirely focused on getting people to use Opus via a Claude Code subscription, to the point that Sonnet is almost viewed as the poor man's alternative, and from what I've seen, almost nobody uses it.
Actually, here's an interesting project for all the vibe coders looking for their next front page post: scrape a ton of commits from GitHub with Co-Authored-By: Claude and figure out what the percentage split between Opus/Fable/Sonnet is. I'm willing to bet it's less than 10% Sonnet.
This may be misleading, since I suspect many are using a blend through sub-agents. I tend to bias for Fable to orchestrate and Opus for implementation via sub-agents.
Luna is an extremely strong model.
Assuming the efficiency gains are real, I feel like something has to give, maybe worse quality due to aggressive quantization/kv cache compression?
If you use Codex it's different, the harness has a lot to do with it and there's definitely been changes including recently.
The dynamic GPU clusters will be used for the 5% of tasks, and pushing out the frontier. Also there will be a set of knowledge tasks that are not done today (because they are too difficult for most knowledge workers), that will start being done in the future.
bakugo•47m ago
Looks like the Chinese models are really making a dent. Having 3 different price categories with the "most affordable" one still costing more than GLM 5.2 never made sense.
measurablefunc•41m ago
cbg0•18m ago
Estimated final electricity price for large industrial customers in energy-intensive industries:
USA 50 USD/MWh
China 68 USD/MWh
https://www.iea.org/reports/electricity-2026/prices
preommr•38m ago