Show HN: Distill and serve models with frontier quality for half the cost

https://github.com/experientiallabs/world-model-optimizer

41•SilenN•1h ago

Hi HN, we built world-model-optimizer, an open-source tool to continually improve models specialized to agents. Today we are launching `wmo serve`, a tool to route repetitive tasks to distilled smaller models.

Agent traces you already capture are opportunities to get signal on how to make your model cheaper, faster, better. We continuously improve

- your specialized model through distillation from open source models

- model routing to frontier + custom models

- token compaction to remove noise and save tokens

Demo: https://www.youtube.com/watch?v=2_m4Ze6mdko

Pass in traces and an OpenRouter key, and wmo starts an endpoint to run with your model. Behind the scenes a router decides which tasks should go to the frontier versus your model. Tinker continually trains as new traces arrive.

We also offer a hosted solution for anyone that just wants a frontier quality endpoint with self improvement over time at a 40%+ lower cost.

We're https://experientiallabs.ai!

Comments

rglover•45m ago

Excited to play with this.

SilenN•18m ago

Let me know if you have any questions!

jack_pp•43m ago

Not sure I get it. The model you're improving is local? If so how do you even calculate cost compared to an API

SilenN•28m ago

Open source models.

wmo routes requests between frontier models and open source models that continuously train using Tinker. As the smaller models improve, more traffic gets routed to them.

Calculating cost is just tokens in/out.

yiyingzhang•41m ago

Cool idea! How do you guarantee privacy?

SilenN•27m ago

It's open source!

We do have a platform we'll be launching as well to manage training + serving for you which will require more diligent privacy guarantees.

digitaltrees•41m ago

Cool project

SilenN•18m ago

Thanks :)

adrianco•40m ago

Local models need to be tuned to work well so this looks useful. Seems to be for general purpose model serving. I’ve been using https://github.com/adrianco/retort to run experiments for coding models across 13 different programming languages to see which frontier and local models work.

SilenN•34m ago

That's cool, thanks for sharing!

Art9681•33m ago

The absolute best way to prove this works is by releasing a model that was fine-tuned with this method and then showing benchmarks depicting the improvement delta between the base model and the fine tuned one.

The work is not done. Then release it to the masses and wait a few days for the actual real world anecdotes.

Until then, this is noise.

Reubend•30m ago

Yeah, this is just slop. No benchmarks, no concrete case studies, just some vibecoded "platform" to finetune models on your own traces.

Which is an idea that has some value, but also some weaknesses. And this implementation of it isn't forthcoming with that concept. You have to really dig in to understand what they're even talking about.

SilenN•24m ago

Happy to answer any qs.

irishcoffee•29m ago

Benchmarks are the ultimate consolidation of halnons razor.

teravor•27m ago

[flagged]

dang•27m ago

"Please don't post shallow dismissals, especially of other people's work. A good critical comment teaches us something."

https://news.ycombinator.com/newsguidelines.html

surround•22m ago

The title is misleading. This is model routing, not distillation.

SilenN•17m ago

Fixed formatting which will help with readability. We do routing, distillation, and token compaction.

Decker, a platform that builds on the legacy of Hypercard and classic macOS

I wanted a clock that never needed setting. Things escalated

French firefighters face 'pyrocumulonimbus' for first time

Teaching Kids Forth

We have proof automation now

Introduction to Data-Oriented Design [pdf]

Simulate cassette tape audio profiles using FFmpeg

Design is compromise

Plasma Tunnels Reveal How Dying Satellites Fall to Earth

Htmx 4.0, the first JavaScript library to release exclusively on the Game Boy

Show HN: CheapSecurity – Lightweight, Self-Hosted CCTV for Linux SBCs

How to Block Some of the Bots

How to Write English Prose

How AST-grep Rewrote Tree-sitter in Rust and Made It 30% Faster

History of John Backus's functional programming project [draft]

Go Analysis Framework: modular static analysis by go team

The Usefulness of Useless Knowledge (1939) [pdf]

The New AI Superpowers: Focus and Followthrough

Fonts In Use – Find out where a font is used

GrapheneOS protections against data extraction from locked devices

The relay market powering token resellers and fraud

US citizen charged after GrapheneOS phone wipes during airport search

I learned PCB design, 3D printing and C just to listen to music

Kill The Cookie Banner

Jimothy the raccoon has a rare spinal condition. Here's what that means

Wattage: A token-spend profiler and cost-regression gate for AI agents

Show HN: Reverse Minesweeper

Multiway Turing Machines (2021 pre-ai)

Using sed to make indexes for books (1997)

It's not empowering to hand off the details