Opus 5 is currently #1 on Artificial Analysis Intelligence Leaderboard

35•aarondong•3h ago

Comments

aarondong•3h ago

Before getting too excited, take a look at the intelligence vs cost matrix: https://artificialanalysis.ai/models?intelligence-index-toke...

midnightbobarun•3h ago

5.6 Sol (max) being cheaper than all of these is wild, considering how good the output is too

Schiendelman•1h ago

This must be on API costs, not counting the $100/200 tiers, right?

giancarlostoro•48m ago

Probably because they made ASICs to run inference for less.

brookst•46m ago

Are those actually deployed at scale yet?

brcmthrowaway•37m ago

Yes.

wmf•23m ago

I hate to disagree with Broadcom Throwaway himself but it's unlikely that the OpenAI Jalapeno ASIC has been deployed yet. It takes 6-12 months to test, develop software, ramp production, etc.

nijave•34m ago

I think on swebench verified luna was only like 3% points lower for 1/5 the cost

Like 96% vs 93% or something

impulser_•22m ago

It shouldn't be surprising OpenAI does have the most compute out of all the major labs. The only reason why Anthropic models are expensive is they are the most in demand models in the world and Anthropic is fighting for compute. The only way to you limit demand for your model is increasing API pricing this is also why Anthropic probably has great margin and probably is profitable compared to OpenAI.

scrlk•14m ago

Plus GPT-5.6 is more token efficient across the board vs the Anthropic equivalents: https://artificialanalysis.ai/models?intelligence-index-toke...

No wonder why Tibo can afford to hit the reset button liberally.

charcircuit•5m ago

I also suspect there is a price fixing agreement between all of the inference providers for Claude (such as Amazon, Anthropic, Microsoft, etc).

eli•22m ago

Max is lot of extra reasoning. I wonder how many fewer tasks it solves on high. I bet that costs quite a lot less.

claude-ai•2h ago

On my end, Opus 5 is Haiku level vs. Opus 4.8 (good) and Fable (superb).

Gets confused by permission prompts, cannot debug a failing test it caused (Opus 4.8 got it right after, without tens of rounds "thinking").

reilly3000•20m ago

Are you using Claude Code/CoWork or an API client? I’m curious if it has different training that makes it more effective with specific instructions/ tool calling methods that are only implemented in official harnesses.

pixelesque•10m ago

I'm curious about this too, and it's difficult to get any information about this given everyone has different setups, workflows and use-cases.

I bizarrely had Opus 4.8 this week (in pi.dev within a podman container, using openrouter) start installing various python packages (and uv!) within the environment (not as root) when I asked it to code review some fairly basic Rust .rs files that were generally stand-alone (it did very nicely work out and write some stubs for them to build them and work out how they worked).

It only gave up with the weird Python installing stuff when it discovered one of the Python packages needed Tensorflow.

It seems pretty focused and persistent in continuing its initial approach, and I'm wondering if I need to alter some instructions / initial prompts to rein it in a bit...

firasd•15m ago

Very interesting that one of the components is "AA-Omniscience Index"

AA-Omniscience Index (higher is better) measures knowledge reliability and hallucination. It rewards correct answers, penalizes hallucinations, and has no penalty for refusing to answer.

This seems to be a good proxy for param size/density and the ranking breaks down as such: Claude Fable 5 (with fallback), Gemini 3.1 Pro Preview, Claude Opus 5 (Max), Grok 4.6 (high), Gemini 3.6 Flash, GPT 5.6 Sol (Max)

I've thought for a while that Gemini 3.x has 'big model smell'

sggyamg•7m ago

It's new, normal.

andy99•4m ago

#1 in a very close race is way less useful when you have to walk on eggshells to avoid triggering censorship (“safeguards”) that either refuse or knock it down to another model. I’ve almost completely stopped using Claude (except some legacy workflows) for this reason, reliability matters more than scoring 61 instead of 57. To me Claude is the most compromised and unreliable model (between the censorship and the id checking - which I have not experienced personally), it’s not worth whatever slight benchmaxxing they did for the latest release.

chmod775•4m ago

The more interesting finding here is that it's still the second most expensive model (after Fable 5) by a wide margin, with plenty of models essentially matching its score (~1-2% diff) for half the cost.

Claude Opus 5

Postgres LISTEN/NOTIFY actually scales

My security camera shipped a GitHub admin token in its login page

Show HN: I simulated closing the Strait of Hormuz on real oil trade data

India's first privately-developed rocket reaches orbit on debut launch

Opus 5 is currently #1 on Artificial Analysis Intelligence Leaderboard

Designing an Ethernet Switch ASIC

Nvidia, Microsoft, Meta warn against overregulating open-weight models

Fil-C: Garbage In, Memory Safety Out [video]

An old patent inspired the new "Y-zipper", a three-sided fastener

Gsxui – Shadcn-style components for Go

The Secret Origins of Amazon's Alexa

Marimo now runs in PyCharm

If coding has been solved, why does software keep getting worse?

Half-Life 2 running natively on HaikuOS

Kimi K3 exploited the latest Redis server

Don't Take the Black Pill [video]

Firefox Containers Preview

Show HN: Max Studio Tools – C++ DSP Modules for Max and Ableton Live

Unitree As2-W

Be skeptical of OpenAI's rogue hacker agent story

Flux 3 X Mimic: The Next Generation of Video-Action Models

The footprints of every building in NYC

Government orders GitHub to remove Bluetooth-based chat app Bitchat: Jack Dorsey

Future euro banknote design proposals

IRGC claims it destroyed Amazon's Bahrain data center

Programming language file extensions that match ISO 3166-1 alpha-2 country codes

How to Write a Quine

The case for MUDs in modern times (2018)

I got into YC Startup School by hacking it

Claude Opus 5

Postgres LISTEN/NOTIFY actually scales

My security camera shipped a GitHub admin token in its login page

Show HN: I simulated closing the Strait of Hormuz on real oil trade data

India's first privately-developed rocket reaches orbit on debut launch

Opus 5 is currently #1 on Artificial Analysis Intelligence Leaderboard

Designing an Ethernet Switch ASIC

Nvidia, Microsoft, Meta warn against overregulating open-weight models

Fil-C: Garbage In, Memory Safety Out [video]

An old patent inspired the new "Y-zipper", a three-sided fastener

Gsxui – Shadcn-style components for Go

The Secret Origins of Amazon's Alexa

Marimo now runs in PyCharm

If coding has been solved, why does software keep getting worse?

Half-Life 2 running natively on HaikuOS

Kimi K3 exploited the latest Redis server

Don't Take the Black Pill [video]

Firefox Containers Preview

Show HN: Max Studio Tools – C++ DSP Modules for Max and Ableton Live

Unitree As2-W

Be skeptical of OpenAI's rogue hacker agent story

Flux 3 X Mimic: The Next Generation of Video-Action Models

The footprints of every building in NYC

Government orders GitHub to remove Bluetooth-based chat app Bitchat: Jack Dorsey

Future euro banknote design proposals

IRGC claims it destroyed Amazon's Bahrain data center

Programming language file extensions that match ISO 3166-1 alpha-2 country codes

How to Write a Quine

The case for MUDs in modern times (2018)

I got into YC Startup School by hacking it

Opus 5 is currently #1 on Artificial Analysis Intelligence Leaderboard

Comments