Transformers Are Inherently Succinct

https://openreview.net/pdf?id=Yxz92UuPLQ

19•brandonb•1h ago

This paper is being published at ICLR 2026 (top AI conference), and was selected as one of three outstanding papers.

Comments

brandonb•1h ago

This paper is being published at ICLR 2026 (top AI conference), and was selected as one of three outstanding papers.

dang•1h ago

(We'll add that bit to the toptext as well. Thanks!)

dang•1h ago

Discussed (a bit) here:

Transformers Are Inherently Succinct (2025) - https://news.ycombinator.com/item?id=48014197 - May 2026 (9 comments)

lkm0•17m ago

I had no idea that LLMs (or the transformer architecture) were within reach of complexity theory. But if transformers "can be" exponentially more succinct than RNNs, doesn't that mean we're approaching optimality?

Astronauts told to return to ISS after sheltering over air leak repairs

pg_durable: Microsoft open sources in-database durable execution

Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency

My Agent Skill for Test-Driven Development

New method turns ocean water into drinking water, without waste

Mouseless – keyboard-driven control of macOS/Linux/Windows

Conventional Commits encourages focus on the wrong things

Gov.uk has replaced Stripe with Dutch provider Adyen

Accidentally deleted subscriptions for chat integrations (Slack and MS Teams)

Transformers Are Inherently Succinct

Three of our worst VC stories

I tested every IP KVM in my Homelab

Do the Hardest Thing

Did Claude increase bugs in rsync?

Cooldown Support for Ruby Bundler

"Maybe later" was a feature

Launch HN: General Instinct (YC P26) – Frontier models on edge devices

The company I work for is losing all of its humanity, I don't know where to go

Mantine-datatable (and others) compromised – owner account suspended

Ask HN: What was your "oh shit" moment with GenAI?

Inside FAISS: Billion-Scale Similarity Search

Tracing a powerful GNSS interference source over Europe

Nango (YC W23, dev infra) is hiring staff back end engineers

Redis 8.8: New array data structure, rate limiter, performance improvements

Dutch gov't will only allow European company to operate DigiD platform

India's surprise baby bust

C++: The Documentary

Show HN: Lowfat – pluggable CLI filter that saved 91.8% of my LLM tokens

Entanglement Builds Space-Time. Now "Magic" Gives It Gravity

Changing how we develop Ladybird

Transformers Are Inherently Succinct

Comments

Astronauts told to return to ISS after sheltering over air leak repairs

pg_durable: Microsoft open sources in-database durable execution

Gemma 4 QAT models: Optimizing compression for mobile and laptop efficiency

My Agent Skill for Test-Driven Development

New method turns ocean water into drinking water, without waste

Mouseless – keyboard-driven control of macOS/Linux/Windows

Conventional Commits encourages focus on the wrong things

Gov.uk has replaced Stripe with Dutch provider Adyen

Accidentally deleted subscriptions for chat integrations (Slack and MS Teams)

Transformers Are Inherently Succinct

Three of our worst VC stories

I tested every IP KVM in my Homelab

Do the Hardest Thing

Did Claude increase bugs in rsync?

Cooldown Support for Ruby Bundler

"Maybe later" was a feature

Launch HN: General Instinct (YC P26) – Frontier models on edge devices

The company I work for is losing all of its humanity, I don't know where to go

Mantine-datatable (and others) compromised – owner account suspended

Ask HN: What was your "oh shit" moment with GenAI?

Inside FAISS: Billion-Scale Similarity Search

Tracing a powerful GNSS interference source over Europe

Nango (YC W23, dev infra) is hiring staff back end engineers

Redis 8.8: New array data structure, rate limiter, performance improvements

Dutch gov't will only allow European company to operate DigiD platform

India's surprise baby bust

C++: The Documentary

Show HN: Lowfat – pluggable CLI filter that saved 91.8% of my LLM tokens

Entanglement Builds Space-Time. Now "Magic" Gives It Gravity

Changing how we develop Ladybird