frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: Zeus – Claude Code for AI voice agents

https://thunderphone.com/blog/introducing-zeus
2•kolchinski•1h ago
Hi everyone, Alex here - I’m one of the founders of ThunderPhone. We’re excited to announce the launch of Zeus, a platform that makes AI phone calls actually work without extensive hand-tuning!

You can see a head-to-head I made of the last version of ThunderPhone vs this one here: https://www.youtube.com/watch?v=YlkIc3L29lo

A (somewhat long) summary:

When we started building business phone agents in 2024, we kept running into technical problems that ruined calls, caused by the limits of existing architectures. The two biggest issues were that phone agents misheard callers, and disobeyed scripts or responded in weird ways.

Both stemmed from the prevailing voice agent architecture - a “three-step” or “cascaded” pipeline: one transcription model turning caller audio into text, one LLM generating a response (and sometimes tool calls) from that text, and a TTS model turning response text into audio.

Transcription models aren’t perfect, especially in noisy environments, with unclear callers, in languages other than English, and on short utterances like “yeah”. With the pipeline approach, when caller audio is boiled down to a single “best guess” text transcript, mistakes are often unrecoverable: there’s typically no “top n” best guesses or other audio signal for the LLM to use if the transcript was wrong. That leads the LLM to respond to what the transcription model thought it heard instead of what the caller actually said.

The pipeline approach also caused weird responses and poor instruction-following due to the tradeoff between LLM speed and intelligence. Phone calls demand fast responses to feel natural, which is in tension with an LLM’s need to “think” and run inference - often for several seconds - to answer many prompts correctly. With a single LLM in the pipeline, the obvious choice is picking one fast enough to feel responsive, but that comes with an unavoidably high error rate on real calls, frustrating callers and sending calls off the rails.

More recently, end-to-end “speech-to-speech” models have won usage alongside three-step pipelines. They’re better at hearing callers correctly (though still not perfect), but they’re even worse at following instructions reliably, which is typically disastrous for business phone calls.

Once we understood these problems, we built our own stack to address them. Over the past year and a half, the ThunderPhone stack has largely solved mishearing and misbehaving by combining numerous models on each call.

For audio misunderstandings, we run multiple, even numerous, transcription models on most calls, giving more “shots on goal” from the original audio. Even if none gets it exactly right, multiple almost-correct answers let us triangulate on a correct transcript, using one or more LLMs to decide what the caller actually said. In challenging situations, we even pipe caller audio directly to one or more audio-input LLMs to further improve comprehension.

For instruction following, we run a mix of fast and slow LLMs on conversation turns to combine snappy responses with deeper thinking behind the scenes. In practice, this is a multi-staged classification problem: after 50ms, 500ms, 1s, etc., we simultaneously generate responses with increasing inference while classifying whether we need to “think harder” to generate a definitive correct answer.

Together with other smaller optimizations, these two approaches have been very effective. Qualitatively, customer calls go much more smoothly and reach successful outcomes far more frequently than on three-step or speech-to-speech pipelines. Quantitatively, we’ve set a record of 99.4% on the Big Bench Audio benchmark, smarter than any other model fast enough for real calls. (We’re also benchmarking ThunderPhone on more public benchmarks - stay tuned.)

The downside is configuration complexity. Every agent benefits from a different setup on the ThunderPhone stack, and even individual call turns on the same call often benefit from different stacks. Configuring this manually worked for enterprise customers, but made it prohibitive to give smaller self-serve customers the full benefits without giving their agents our full attention.

That’s how Zeus came about. Our enterprise configurations were repetitive enough that an AI could do them once we taught it how and gave it the right tools. We’re big fans of Claude Code and Codex for software development, but they fall short at configuring voice agents for a few reasons.

First, unlike software development, where you can compile code and run tests to verify things work, you can’t run live calls inside a computer right after configuring a voice agent - and coding agents don’t know how to run simulated calls out of the box, or “listen” to a call to spot real problems. We built both capabilities into Zeus, giving it a “closed loop” experience building, testing, and improving voice agents just like coding agents have with regular software.

Second, coding agents are pretty gullible about marketing claims. Companies building AI and voice infrastructure commonly post the most favorable possible interpretation of their capabilities online. Claude and Codex read those claims, believe them uncritically, and pick tools based on marketing rather than real performance. At best, that leads to suboptimal architectural choices; at worst, to voice agents that don’t really work at all.

We’ve sidestepped this with continuous evals feeding an internal knowledge base. For everything that matters for voice agents - accurate audio understanding, instruction following, noise cancelling, turn-taking, and more - we maintain internal benchmarks built on real call data. Every time a new AI model comes out, we (now mostly automatically) feed it through our evals for performance, speed, cost, and reliability/consistency. That feeds our internal knowledge base, which Zeus uses to pick the right stack for every agent, call, and conversation turn.

This all happens behind the scenes to keep the ThunderPhone experience seamless. A user just describes their use case and goals, and Zeus helps fill in ambiguities, connect VoIP and software integrations, and optimize the voice agent(s) on simulated and live calls until they hit the highest performance on business goals (conversions, unit economics, etc.) possible with today’s models.

Zeus is also differentiated on cost. Zeus itself is free to use for now, though we expect to move to subscription or token-based pricing later. For calls, we’ve become the first voice AI vendor to our knowledge to charge on a cost-plus basis: ThunderPhone customers pay exactly what we pay our vendors, plus a 17% margin on calls costing 2c/min or less, scaling linearly up to 25% for calls costing us 15c/min or more, and 25% from there on up.

However, we find that simple phone agents do well on a stack that costs about 2c/min, and more complex cases typically land around 5-10c/min - significantly cheaper than most alternatives.

Zeus is brand-new, so we’re eager to get feedback on how it works for customers, and any areas we could improve it. Give it a try and see what you think - let me know if you have any feedback or questions.

Alex

Show HN: Cornhole News – A Hacker News inspired site for news across the Midwest

https://cornholenews.news
191•cornholemedia•10h ago•91 comments

Show HN: Zeus – Claude Code for AI voice agents

https://thunderphone.com/blog/introducing-zeus
2•kolchinski•1h ago•0 comments

Show HN: Mastra Factory, the open-source software factory we use to build Mastra

140•codekarate•1d ago•42 comments

Show HN: Watch weight-space programming in action with WebGPU

https://tabbyml.github.io/weight-space-playground/
33•wsxiaoys•10h ago•3 comments

Show HN: erXos – a microkernel OS in Erlang based on Genera/Plan 9/QNX ideas

https://stass.github.io/erXos/
3•stass•2h ago•3 comments

Show HN: Tools4U – 54 file tools that run in the browser

https://tools4u.org
3•emberloop•3h ago•0 comments

Show HN: 15MB transcription model that runs in the browser/device

https://starbright.quickthoughts.ca/
3•quickthoughts•3h ago•1 comments

Show HN: Open-source, real-time object tracking for live video feeds

https://github.com/aryamandarda/tamserve
119•aryaman_darda•3d ago•13 comments

Show HN: Type Fighter 2

https://typefighter2.com/
140•torumitch•1d ago•69 comments

Show HN: Take Voyager 1 apart, down to a single memory chip

https://rshekhar.com/voyager/
234•raj-shekhar•1d ago•57 comments

Show HN: Neoma P-CAM – Sub-millisecond physical equilibrium and 64-spin Ising

https://github.com/neoma-pcam/pcam-live
14•neoma001•3d ago•3 comments

Show HN: Foolscap – a writing app that reads your book and never writes for you

https://foolscap.works/
103•atugard•12h ago•84 comments

Show HN: ExitPath – Open-source ways out of Slack, Notion and Microsoft 365

https://exitpath-ruddy.vercel.app/
248•zerocool0101•1d ago•93 comments

Show HN: TIE Fighter co-op in 11 days, built from 11 years of Wing Commander

https://fireflyk64.github.io/makingtf/
3•daniel_rh•6h ago•1 comments

Show HN: IT Thinks – Build a GPU from a Single NAND Gate

https://store.steampowered.com/app/5196330/IT_THINKS_Build_Your_Own_GPU/
12•benbenhere•6h ago•0 comments

Show HN: An API for word timestamps from speech, 75% within 20ms

https://quebec.yarn.so
37•jasperstory•2d ago•5 comments

Show HN: Zpup – Zdog style 3D scenes in JSON, SVG from any angle

https://github.com/rxolve/zpup
15•select1dev•20h ago•0 comments

Show HN: Alloy CSS, dialogs, menus and tabs that work with JavaScript off

https://alloyhtml.com/example.html
210•prafandy•2d ago•38 comments

Show HN: ADE Index – a sourced and ranked index of 975 agentic coding tools

https://adeindex.com
25•jonnyasmar•1d ago•5 comments

Show HN: Robotics needs better CAD, so I wrote a B-rep kernel and 3,487 tests

https://springcraft-ai.github.io/springrep/
33•atomarch•1d ago•9 comments

Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium

https://github.com/RunanywhereAI/trnrt
54•sanchitmonga22•2d ago•8 comments

Show HN: Unref – A Python dead code finder built on Ruff's parser

https://github.com/Apakottur/unref
62•McAvey•3d ago•18 comments

Show HN: PadSpan – Room-level Bluetooth tracking for Home Assistant

https://padspan.traks.ca/demo/
3•gbroeckling•10h ago•0 comments

Show HN: Openspot – macOS launcher for disposable tools

https://github.com/celishq/openspot
5•tniich•11h ago•2 comments

Show HN: Zigzag, a native Mac browser for people leaving Arc

https://github.com/ZigaoWang/zigzag
121•ZigaoWang•5d ago•74 comments

Show HN: Purple Flow – AI-first n8n alternative, 10k+ workflows on 512MB

https://github.com/leetheguy/purple_flow
5•leetheguy•12h ago•2 comments

Show HN: PocketOps for SigNoz: The Open Source Datadog Alternative

https://github.com/avens19/pocketops
10•avens19•1d ago•0 comments

Show HN: Detect and mask PII, payment data and secrets in logs for Go

https://github.com/nao1215/embargo
2•nchika•12h ago•1 comments

Show HN: Math 2.0

https://math2.tamnd.com/areas/
23•tamnd•1d ago•7 comments

Show HN: Psudo – 47MB 2-bit coding model, Polish-prefix IR, and Rust transpiler

https://github.com/steveSujo/psudo
3•someProgramer•13h ago•0 comments