frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Schema Harness Achieves ~99% on Arc‑AGI‑3 Public

https://schema-harness.github.io/
47•jasondavies•4h ago

Comments

westurner•1h ago
> Schema, the harness we introduce today, reaches 99% on the ARC‑AGI‑3 Public set using Claude Opus 4.8 and Fable 5, and 95.35% using GPT‑5.6 Sol.

Impressive results. Will this translate to coding agents (and training general purpose and for coding LLMs) too?

---

> When Michelson and Morley could not detect the medium light was supposed to wave in, Lorentz took the first route: keep the aether, patch the rules with contraction hypotheses that absorbed the null result. Einstein took the second: in special relativity, he discarded the aether as part of the state and made simultaneity frame-relative, yielding a simple electrodynamics of moving bodies.

BECs, SVT, Superfluid Quantum Gravity

Massful photons are modeled with Proca fields. Like Einstein, Proca was also a student of Minkowski. The Mass-Equivalence principle ~~does not~~ still holds if photons have mass.

(edit) Energy-momentum relation: https://en.wikipedia.org/wiki/Energy%E2%80%93momentum_relati...

> could not detect the medium light was supposed to wave in,

Superfluid Quantum Gravity (Fedi,) says that there is a medium that light waves through; there is not nothing in space, space is a quantum dilatant superfluid with near-zero viscosity.

Alifatisk•1h ago
What does it mean to reach 99% score on Arc-AGI-3? That the agent is able to tackle difficult problems?
modeless•1h ago
It doesn't necessarily mean anything to reach 99% on the public set. All of the public set is known in advance, so it's possible to hardcode rules that make this easy for the models. ARC-AGI-3 is supposed to measure generalization to unseen games, so the only score that matters is the score on the held out private test set that nobody outside the ARC prize foundation has access to. Also, I believe the private set is significantly harder than the public set.
levocardia•1h ago
(1) What does it score on the private test set? (2) Does this approach generalize to, e.g., Atari or NES games, or is it just hard-coding priors about the games into the model (as Chollet specifically warned was a chronic problem in benchmarks in the original Arc-AGI paper)
stared•59m ago
In the spirit of ARC-AGI-3-like challenges, we just tested if frontier AI models are able to solve a lovely puzzle game, Baba Is You: https://quesma.com/blog/baba-is-bench/

A year ago, Sonnet 4 barely solved the first level. Now, both Fable 5 and GPT-5.6 Sol beat the first two stages. GPT 5.2 is slow, but efficient, while Gemini 3.1 Pro and 3.5 Flash struggle.

sva_•17m ago
I'm wondering what's up with the release of Gemini 3.5 Pro, they keep postponing it. For a while, Google was doing pretty well with their releases.
causal•48m ago
We need to see private set results, but if this holds then it might represent a breakthrough in other domains as well.
daytonellwanger•38m ago
Can someone tell me what the catch is? To outperform the state-of-the-art so drastically would be massive news, and surely the ARC Foundation would have tested this against the private data set, right?
gandalfgeek•23m ago
Big jump for sure, but definitely comes with a giant grain of salt lacking open-sourcing the harness itself and measuring performance on the held-out set.
teravor•14m ago
it looks like what they are doing is using a frontier model to write a simulator for a game and then solve using it.

it's not as impressive as it looks. the goals of Arc-AGI-like constructs is to get an IQ-like figure using raw'ish 2D measurement 'games' in the hope that it would signify something meaningful.

what this harness does is get the model to write a simulator first, it's measuring something entirely different.

ClassAndBurn•8m ago
Any custom harness for a problem shows that harness engineering is going away. Eventually models will introspect problems, then build custom harnesses tailored to that. Then use and modify the ephemeral harness as required.

Sol Ultra style is the path forward. The models are smart enough to self serve their tooling and processes. Given a problem they can figure it out and ask for directions when needed.

vessenes•7m ago
To be clear, we’ll want to see how this performs against the hold-out set. If it holds up, though, it’s a big deal, and kind of in line with the vibes this year, which I’d typify as ‘harness matters’. Maybe we’d upgrade to ‘harness matters immensely’ if this can 100% ARC-AGI-3 on existing models (more in the 13% range without this harness).

I’m pretty excited to see what sort of generalization we come to over the next 12 months on the harness side: if it turns out this can be RLed in as ‘consider if building a world model might help here’ and we get this as another native capacity, that will be interesting. If we get 100 of those problem-solving strategies all included, feels like we will see another hurdle cleared in terms of usefulness.

Kimi K3 is now live

https://www.kimi.com/en
624•vincent_s•4h ago•336 comments

Microsoft Comic Chat is now open source

https://opensource.microsoft.com/blog/2026/07/16/microsoft-comic-chat-is-now-open-source/
287•jervant•3h ago•76 comments

Decoy Font

https://www.mixfont.com/experiments/decoy-font
177•ray__•3h ago•63 comments

Detecting LLM-Generated Texts with “Classical” Machine Learning

https://blog.lyc8503.net/en/post/llm-classifier/
84•uneven9434•3h ago•54 comments

NotebookLM is now Gemini Notebook

https://blog.google/innovation-and-ai/products/gemini-notebook/notebooklm-gemini-notebook/
108•xnx•3h ago•74 comments

OnePlus halts operations in USA and Europe

https://community.oneplus.com/thread/2170715118587871237
459•pilililo2•9h ago•254 comments

Immersive Linear Algebra Book with Interactive Figures (2015)

https://immersivemath.com/ila/
82•srean•4h ago•9 comments

Goes-19 weather satellite enters Safe Hold mode

https://www.spaceweather.gov/news/goes-19-safe-hold
122•yabones•6h ago•61 comments

The lost joy of music piracy

https://www.pigeonsandplanes.com/read/music-piracy-what-cd-oink-nine-inch-nails-streaming
720•mcgin•14h ago•479 comments

How Our Rust-to-Zig Rewrite Is Going

https://rtfeldman.com/rust-to-zig
291•jorangreef•8h ago•160 comments

Adaptional (YC S25) Is Hiring

https://www.ycombinator.com/companies/adaptional/jobs
1•acesohc•2h ago

How to Train a Gen AI Kick Drum Model on Your Old Linux Desktop with 6GB VRAM

https://www.zhinit.dev/blog/training-a-kick-drum-diffusion-model
55•zhinit•4h ago•38 comments

Launch HN: Traceforce (YC S26) – Company-wide security monitoring for AI apps

15•XiaHua•2h ago•7 comments

Show HN: Leaves – A text-UI disk usage treemap visualizer

https://github.com/patonw/leaves
37•patonw•3h ago•10 comments

Guide to data tools landscape for developers

https://sinja.io/blog/data-landscape-guide-for-developers
72•OlegWock•4h ago•23 comments

Sony deletes more movies from the accounts of people who ‘bought’ them

https://www.techdirt.com/2026/07/15/sony-deletes-a-bunch-more-movies-from-the-accounts-of-people-...
452•nekusar•7h ago•280 comments

Let's Build PlanetScale from Scratch: Infrastructure

https://onatm.dev/2026/07/16/homescale-part-1/
120•onatm•7h ago•17 comments

Ente – Opening Our Books

https://ente.com/open/
191•Sherex•9h ago•69 comments

Schema Harness Achieves ~99% on Arc‑AGI‑3 Public

https://schema-harness.github.io/
47•jasondavies•4h ago•13 comments

Cottage Computer Programming (1984)

https://www.atariarchives.org/deli/cottage_computer_programming.php
21•lioeters•4d ago•3 comments

Agent-talk: Enabling coding agents to work together

https://github.com/xhluca/agent-talk
24•xhluca•3h ago•9 comments

German AI consortium releases Soofi S, an open 30B model that tops benchmarks

https://the-decoder.com/german-ai-consortium-releases-soofi-s-an-open-30b-model-that-tops-benchma...
53•amai•1h ago•8 comments

Optimizing Lua string literals to save 400 bytes

https://purplesyringa.moe/blog/guest/optimizing-lua-string-literals-to-save-400-bytes/
7•ibobev•3d ago•1 comments

GC shape stenciling in Go generics

https://rednafi.com/go/gc-shape-stenciling/
34•ingve•4d ago•6 comments

56,000 lines of DOOM, in a language I made up

https://betlang.dev/about/
27•ghuntley•3h ago•19 comments

1,300 Beautiful Wildlife Illustrations from the 19th Century Now Restored

https://www.openculture.com/2026/07/explore-1300-beautiful-wildlife-illustrations-from-the-19th-c...
226•gslin•16h ago•45 comments

Show HN: A modern port of Linux to a ten-year-old QWERTY phone

24•tmzt•3h ago•4 comments

Show HN: Galois connections for composable numeric casts in Rust

https://github.com/cmk/connections
14•partialsolve•3h ago•1 comments

Teardown: A Generic 7-Port USB 3.0 Hub That Wasn't

https://goughlui.com/2026/07/09/teardown-a-generic-7-port-usb-3-0-hub-that-wasnt/
188•speckx•4d ago•87 comments

Accidental Anonymity

https://macwright.com/2026/06/24/accidental-anonymity
42•caminanteblanco•2d ago•9 comments