frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

Open in hackernews

Hierarchical Modeling (H-Nets)

https://cartesia.ai/blog/hierarchical-modeling
67•marviel•8h ago

Comments

marviel•8h ago
> H-Net demonstrates three important results on language modeling:

> 1. H-Nets scale better with data than state-of-the-art Transformers with BPE tokenization, while learning directly from raw bytes. This improved scaling is even more pronounced on domains without natural tokenization boundaries, like Chinese, code, and DNA.

> 2. H-Nets can be stacked together to learn from deeper hierarchies, which further improves performance.

> 3. H-Nets are significantly more robust to small perturbations in input data like casing, showing an avenue for creating models that are more robust and aligned with human reasoning.

marviel•7h ago
https://arxiv.org/pdf/2507.07955

paper

modeless•7h ago
I don't know if this is the one but something like this is clearly the future IMO. We need more levels of hierarchy to efficiently generalize to longer sequences with high level structure. Back when Byte Latent Transformers came out I thought extending the idea to more levels of hierarchy was the way to go, and this seems to be basically that?

Another article about H-Nets: https://main-horse.github.io/posts/hnet-inf/

macawfish•4h ago
Yes... This seems like a generalization of "large concept models" in a certain way
cs702•7h ago
I've only skimmed the paper, but it looks interesting and credible, so I've added it to my reading list.

Thank you for sharing on HN!

---

EDIT: The hierarchical composition and routing aspects of this work vaguely remind me of https://github.com/glassroom/heinsen_routing/ but it has been a while since I played with that. UPDATE: After spending a bit more time on the OP, it's different, but the ideas are related, like routing based on similarity.

marviel•7h ago
No problem! I'm still parsing it myself, but it seems promising in theory, and the result curves are impressive.
gdiamos•7h ago
How does it handle images?
marviel•7h ago
it mentions native multimodality somewhere in either the Arxiv or post -- seems like it might handle it well?
miven•6h ago
As far as I understand the "chunking" of input bytes is learned completely end to end, so it's basically up to the model to figure out how to most efficiently delineate and aggregate the information from the inputs according to the patterns provided to it during training.

Since it's end to end this allows them to apply this process not only to raw byte encodings but basically representations of any level, such as stacking two stages of aggregation one after another.

So in principle they could either let the model do its thing on raw bytes of an image or alternatively maybe cut it up into tiny patches ViT-style and feed that to their H-Net.

I wonder how hard would it be to adapt chunking to work in 2D and what would that even look like.

Some other notes on how multimodal inputs could be handled using this architecture are mentioned in Albert Gu's (one of the author's) blog, although only briefly, there's still much to figure out it would seem: https://goombalab.github.io/blog/2025/hnet-future/#alternati...

marviel•6h ago
Thanks for sharing this blog post is a great speculative deep-dive.
aeon_ai•7h ago
Seems likely to be relevant for memory formation/consolidation/management.

Big, if so.

cubefox•6h ago
As Mamba didn't make it, will H-Nets replace Transformers?
marviel•6h ago
It's meant to replace the BPE tokenizer piece, so it isn't a full Language Model by itself.

In fact in Gu's blog post (linked in a post below) it's mentioned that they created a Mamba model that used this in place of the tokenizer.

vannevar•5h ago
>The best AI architectures in use today treat all inputs equally.

Doesn't this architecture also treat all inputs equally? It seems like an encoder that preprocesses the input by inferring hierarchy. But don't all models essentially do that while training?

modeless•4h ago
If I understand correctly, each level of the hierarchy divides its input into chunks of variable size, but outputs a fixed amount for each chunk. The chunking is learned. The model can choose to compress data by making its input chunks bigger, depending on their content.
macawfish•3h ago
Hand wavy idea: I wonder if we couldn't take this to another level and have some kind of general graph representation along with hierarchical reductions of it.

I sort of disagree with the assertion that "language is fundamentally hierarchical" in that it supposes there is a single abstraction hierarchy that's universally preferable or correct. That's just not true. It doesn't hurt anybody and it's definitely simpler to choose just one useful one (a hierarchy) but why learn only one? Why not learn multiple and also learn how to modulate between them?

notreallymetho•1h ago
I haven’t read fully yet, but it reminds me of some work I’ve done. https://github.com/jamestexas/papers/blob/main/bread/paper.m...

GPUHammer: Rowhammer attacks on GPU memories are practical

https://gpuhammer.com/
110•jonbaer•4h ago•35 comments

Show HN: Shoggoth Mini – A soft tentacle robot powered by GPT-4o and RL

https://www.matthieulc.com/posts/shoggoth-mini
401•cataPhil•12h ago•81 comments

Running a million-board chess MMO in a single process

https://eieio.games/blog/a-million-realtime-chess-boards-in-a-single-process/
61•isaiahwp•3d ago•6 comments

Reflections on OpenAI

https://calv.info/openai-reflections
424•calvinfo•11h ago•231 comments

NIST ion clock sets new record for most accurate clock

https://www.nist.gov/news-events/news/2025/07/nist-ion-clock-sets-new-record-most-accurate-clock-world
279•voxadam•12h ago•98 comments

Six Years of Gemini

https://geminiprotocol.net/news/2025_06_20.gmi
11•brson•1h ago•0 comments

The FIPS 140-3 Go Cryptographic Module

https://go.dev/blog/fips140
112•FiloSottile•7h ago•41 comments

Where's Firefox going next?

https://connect.mozilla.org/t5/discussions/where-s-firefox-going-next-you-tell-us/m-p/100698#M39094
117•ReadCarlBarks•7h ago•139 comments

My Family and the Flood

https://www.texasmonthly.com/news-politics/texas-flood-firsthand-account/
116•herbertl•6h ago•17 comments

Congress moves to reject bulk of White House's proposed NASA cuts

https://arstechnica.com/space/2025/07/congress-moves-to-reject-bulk-of-white-houses-proposed-nasa-cuts/
39•DocFeind•1h ago•9 comments

To be a better programmer, write little proofs in your head

https://the-nerve-blog.ghost.io/to-be-a-better-programmer-write-little-proofs-in-your-head/
268•mprast•11h ago•111 comments

Encrypting files with passkeys and age

https://words.filippo.io/passkey-encryption/
87•thadt•1d ago•47 comments

How bad are childhood literacy rates?

https://www.vox.com/culture/419070/childhood-literacy-college-students-reading-crisis-ai
23•pseudolus•3d ago•31 comments

The Story of Mel, A Real Programmer, Annotated (1996)

https://users.cs.utah.edu/~elb/folklore/mel-annotated/node1.html#SECTION00010000000000000000
70•fanf2•3d ago•23 comments

Plasma Bigscreen rises from the dead with a better UI

https://www.neowin.net/news/kdes-android-tv-alternative-plasma-bigscreen-rises-from-the-dead-with-a-better-ui/
131•bundie•10h ago•45 comments

Easy dynamic dispatch using GLIBC Hardware Capabilities

https://www.kvr.at/posts/easy-dynamic-dispatch-using-GLIBC-hardware-capabilities/
27•Bogdanp•3d ago•3 comments

Hierarchical Modeling (H-Nets)

https://cartesia.ai/blog/hierarchical-modeling
67•marviel•8h ago•18 comments

Designing for the Eye: Optical corrections in architecture and typography

https://www.nubero.ch/blog/015/
124•ArmageddonIt•10h ago•20 comments

Claude for Financial Services

https://www.anthropic.com/news/claude-for-financial-services
102•mildlyhostileux•6h ago•55 comments

Show HN: Reviving a 20 year old OS X App

https://andrewshaw.nl/blog/reviving-genius
7•shawa_a_a•3d ago•1 comments

Lorem Gibson

http://loremgibson.com/
114•DyslexicAtheist•2d ago•21 comments

Hazel: A live functional programming environment with typed holes

https://github.com/hazelgrove/hazel
50•azhenley•8h ago•11 comments

Show HN: Beyond Z²+C, Plot Any Fractal

https://www.juliascope.com/
76•akunzler•9h ago•22 comments

Mostly dead influential programming languages (2020)

https://www.hillelwayne.com/post/influential-dead-languages/
97•azhenley•3d ago•56 comments

Mira Murati’s AI startup Thinking Machines valued at $12B in early-stage funding

https://www.reuters.com/technology/mira-muratis-ai-startup-thinking-machines-raises-2-billion-a16z-led-round-2025-07-15/
81•spenvo•10h ago•79 comments

Voxtral – Frontier open source speech understanding models

https://mistral.ai/news/voxtral
62•meetpateltech•13h ago•17 comments

CoinTracker (YC W18) is hiring to solve crypto taxes and accounting (remote)

1•chanfest22•11h ago

LLM Inevitabilism

https://tomrenner.com/posts/llm-inevitabilism/
1534•SwoopsFromAbove•23h ago•1446 comments

OpenAI – vulnerability responsible disclosure

https://requilence.any.org/open-ai-vulnerability-responsible-disclosure
197•requilence•4h ago•56 comments

Petabit-class transmission over > 1000 km using standard 19-core optical fiber

https://www.nict.go.jp/en/press/2025/05/29-1.html
90•the_arun•3d ago•47 comments