frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: An API for word timestamps from speech, 75% within 20ms

https://quebec.yarn.so
18•jasperstory•1d ago
Hey HN, we're Yarn (W24) and we make a video editing app for startups, and we built Quebec (https://quebec.yarn.so), an API that gives you accurate word timestamps from speech. We needed it because cutting a word even 50ms off from its true timing can ruin talking head footage (examples in the write up).

Accurate word timestamps usually come from a forced aligner, which takes the speech audio and a transcript and works out exactly when each word starts and ends. We weren't satisfied with the accuracy of Montreal Forced Aligner (MFA) or new models like ElevenLabs Cue (https://elevenlabs.io/blog/cue-aligner). Giving LLMs access to a waveform/spectrogram didn't help much either.

So we built our own. There are two particularly interesting parts: - We wrote our own decoder around MFA's acoustic model that only lets each word land within 200ms of the rough timings. That made search small enough to solve exactly, so we don't need to use MFA's beam search. - We added a small CNN, built on the first two layers of Whisper Tiny, that nudges each word boundary by up to 50ms. We couldn't find enough hand-labelled speech that allowed for commercial use, so we had Gemini label our own (17k word boundaries). It took a couple of hours and cost under $200. A net trained on Gemini's labels scored the same as one trained on human labels (73.9% vs. 74%).

One way to measure accuracy is % of word boundaries within 20ms of hand labels. Here are the results on Buckeye (hand-labelled American speech that we didn't train on):

- Quebec 75%

- MFA 61%

- ElevenLabs Cue 30%

If you want to try it, it's free until tomorrow night. You can point your agent at our docs at https://quebec.yarn.so, and send audio on its own or with your own transcript. After that, it costs $0.32 per hour with no signup (minimum $10 top-up). We serve it at cost. Caveats: only tested in English and slower than ElevenLabs.

Let us know if Quebec works well for you, and send us any samples that work badly (you can email support at yarn dot so). Also let us know if you've built or found a better aligner. In theory we would just switch to a better aligner, although we would probably just push a bit harder to make ours better.

Thanks!

Jasper

Comments

totetsu•1h ago
Neat. I was just looking for something like this for auto gating etc, for mixing podcast audio. Also phoneme level accuracy from something like this would be useful for realtime lipsync animation, and tools support pronunciation learning.
londons_explore•35m ago
The example use case really feels like making fake news and misleading edits easier...

Show HN: An API for word timestamps from speech, 75% within 20ms

https://quebec.yarn.so
20•jasperstory•1d ago•3 comments

Show HN: ExitPath – Open-source ways out of Slack, Notion and Microsoft 365

https://exitpath-ruddy.vercel.app/
211•zerocool0101•17h ago•66 comments

Show HN: Take Voyager 1 apart, down to a single memory chip

https://rshekhar.com/voyager/
194•raj-shekhar•17h ago•49 comments

Show HN: Open-source, real-time object tracking for live video feeds

https://github.com/aryamandarda/tamserve
89•aryaman_darda•2d ago•7 comments

Show HN: Mastra Factory, the open-source software factory we use to build Mastra

93•codekarate•16h ago•33 comments

Show HN: Zpup – Zdog style 3D scenes in JSON, SVG from any angle

https://github.com/rxolve/zpup
5•select1dev•3h ago•0 comments

Show HN: Type Fighter 2

https://typefighter2.com/
134•torumitch•22h ago•59 comments

Show HN: ADE Index – a sourced and ranked index of 975 agentic coding tools

https://adeindex.com
16•jonnyasmar•7h ago•3 comments

Show HN: Robotics needs better CAD, so I wrote a B-rep kernel and 3,487 tests

https://springcraft-ai.github.io/springrep/
31•atomarch•12h ago•5 comments

Show HN: Snowchive – Snowden archive of all published documents

https://snowchive.org
4•libroot•4h ago•0 comments

Show HN: PocketOps for SigNoz: The Open Source Datadog Alternative

https://github.com/avens19/pocketops
9•avens19•12h ago•0 comments

Show HN: Alloy CSS, dialogs, menus and tabs that work with JavaScript off

https://alloyhtml.com/example.html
209•prafandy•1d ago•37 comments

Show HN: Nobody blocks a keyboard – Rooted Android as a physical USB Deck

https://github.com/mr-anjaneyam/Emittr
55•mr-anjaneyam•2d ago•51 comments

Show HN: Unref – A Python dead code finder built on Ruff's parser

https://github.com/Apakottur/unref
59•McAvey•2d ago•18 comments

Show HN: Beat – a to-do list that completes its own tasks

https://gobeat.ai/auth/login
15•brdo•13h ago•7 comments

Show HN: BPM – Baby Plus Music Visualizer

https://hberg.com/bpm/
10•hberg•15h ago•6 comments

Show HN: Poptato – App launcher, command runner, and fuzzy menu for Linux

https://github.com/skorotkiewicz/poptato
7•modinfo•14h ago•1 comments

Show HN: TrnRT – An open-source LLM inference engine for AWS Trainium

https://github.com/RunanywhereAI/trnrt
54•sanchitmonga22•1d ago•7 comments

Show HN: Math 2.0

https://math2.tamnd.com/areas/
21•tamnd•1d ago•4 comments

Show HN: Solid 2.0 + Lily Design System = seeking alpha testers

2•jph•7h ago•0 comments

Show HN: Sci-Fi Futures – Reverse-engineering tech from classic sci-fi novels

https://scififutures.vercel.app
5•ninajlu•14h ago•3 comments

Show HN: A quiet screen that keeps time with you

https://nonloop.github.io/funclock/
2•cflsdf•8h ago•0 comments

Show HN: Dancing Particle is an interactive app built for stress relief

https://apps.apple.com/cn/app/%E9%A3%9E%E8%88%9E%E7%B2%92%E5%AD%90-%E4%BA%94%E5%BD%A9%E6%96%91%E6...
2•cflsdf•8h ago•0 comments

Show HN: Zigzag, a native Mac browser for people leaving Arc

https://github.com/ZigaoWang/zigzag
120•ZigaoWang•4d ago•74 comments

Show HN: Generate Angular TestBed specs and Storybook stories locally, no LLM

https://sshyeri.github.io/ng-test-foundry-public/
3•sshyeri•8h ago•0 comments

Show HN: I built a harness that turns floor plans into 360° tours using AI

https://walkthisplan.com/
5•sidcraftscode•8h ago•1 comments

Show HN: Lazycow Studio – turns footage you never edited into reels, locally

https://github.com/kensaurus/lazycow-studio
2•kensaurus•9h ago•0 comments

Show HN: Agent Hive – cute Grokbot like agentic teams with queen and many bees

https://github.com/ericwang915/agent-hive
2•ericwang915•9h ago•0 comments

Show HN: Pitot – OpenTelemetry in One Binary, with Parquet, DuckDB, and MCP

https://github.com/labstack/pitot
3•matrika•9h ago•0 comments

Show HN: Solve hard jigsaw puzzles scanning with phone

https://puzzle.cloudish.app/
2•javierluraschi•9h ago•2 comments