frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Llasa: Llama-Based Speech Synthesis

https://llasatts.github.io/llasatts/
168•CalmStorm•1y ago

Comments

CalmStorm•1y ago
LLaSA is a simple framework for speech synthesis that employs a single-layer vector quantizer (VQ) codec and a single Transformer architecture to fully align with standard LLMs such as LLaMA.
WastedCucumber•1y ago
Probably the title should have the correct capitalization then. Cause I was fully expecting a speech synthesis tool that sounded like llamas talking human language and now I'm bummed out!
StevenNunez•1y ago
I can't wait see this integrated into Open WebUI! These sound amazing.
gapeleon•1y ago
You can run an openai-compatible endpoint and point open-webui at it if you want this. I had to add a function to filter out markdown lists, code, etc as the model was choking on them.
mring33621•1y ago
the long 'uuuuhhhhhhh' from some of the lesser models is killing me.
jszymborski•1y ago
based on the samples, it really seams like anything smaller than 3B is pretty useless.
hadlock•1y ago
If you're doing a home lab voice assistant 1B is nice, because on a 12gb gpu you can run a moderately competent 7b LLM and two 1b models; 1 for speech to text and also text to speech, plus some for the wake word monitor. Maybe in a couple of years we can combine all this into a single ~8b model that runs efficiently on 12gb gpu. Nvidia doesn't seem very incentivized right now to sell consumer GPUs that can run all this on a single consumer grade chip when they're making so much money selling commercial grade 48gb cards.
Dlemo•1y ago
Hui for the activation word?

Shouldn't there be some hardware module be available similar to how Alexa, Siri and Google do it?

Whith a ring buffer detection the word without recording everything?

gapeleon•1y ago
This finetune seems pretty stable (1b llasa) https://huggingface.co/spaces/HKUST-Audio/Llasa-1B-multi-spe...

1B is actually huge for a TTS model. Here's an 82m model with probably the most stable/coherent output of all the open weights tts models I've tested: https://huggingface.co/spaces/hexgrad/Kokoro-TTS

But if you mean zero-shot cloning, yeah they all seem to have those slurred speech artefacts from time to time.

dheera•1y ago
> employs a single-layer vector quantizer (VQ) codec and a single Transformer architecture to fully align

I really wish when new models were released that they would draw a diagram of all the layers and the tensor input and output sizes at each layer, with zoom in/out capabilities if needed using D3.js or whatever visualization framework if needed. Every single layer should be on there with its input and output sizes.

These one-sentence descriptions, and approximate block diagrams with arrows pointing at each other are never enough to understand how something is actually implemented.

exe34•1y ago
Sounds like a solid SaaS business plan!
dr_kiszonka•1y ago
That might be intentional.
imtringued•1y ago
This already exists in Transformer Lab and ONNX (not recommended for transformers).

You can also build a custom version of llama.cpp that writes out the ggml compute graph. What's irritating is that hugging face didn't add it to their GGUF file viewer.

dheera•1y ago
Oh, sure, for the well-known models that are already on there.

I just wish that new research would always spell it out in full instead of these silly block diagrams labelled with just e.g. "Cross Attention" and not the exact parameters, number of heads, layer sizes, etc.

Also some of these diagrams use a + for concatenation and some use it for addition, that's another headache to figure out, having layer sizes would make it clear.

ks2048•1y ago
Odd that the page doesn't seem to link to either,

paper: https://arxiv.org/abs/2502.04128

github: https://github.com/zhenye234/LLaSA_training

thot_experiment•1y ago
Interesting that there isn't a mention of Orpheus as prior art either since it's the exact same thing.

(https://github.com/canopyai/Orpheus-TTS)

gapeleon•1y ago
> Interesting that there isn't a mention of Orpheus as prior art either

Llasa-3b (https://huggingface.co/HKUSTAudio/Llasa-3B) came out before Orpheus (https://huggingface.co/canopylabs/orpheus-3b-0.1-ft).

> it's the exact same thing.

They're very similar, but they're not the exact same thing.

Llasa uses xcodec2, a much simpler, lossless 16khz wav codec. This makes it superior for one-shot voice cloning.

Orpheus' 24khz snac codec is lossy which makes it difficult to use for zero-shot cloning as the reference audio gets degraded during tokenization. You can test this here: https://huggingface.co/spaces/Gapeleon/snac_test

But when finetuned on 50+ audio samples, it produces much cleaner 24khz audio than Llasa, and the snac model is much easier to run on consumer hardware than xcodec2 (87t/s for realtime speech, which can be achieved on an RTX3080 for example)

nialv7•1y ago
the mispronunciation of 行 and 行 in the Chinese sample is killing me too XD
oezi•1y ago
Do you happen to know why Orpheus and Llasa use Finetuning for voice cloning?

Zonos uses 128-float embeddings for voices and it seems so much nicer. Because you can just mix and match voices without changing the model.

thot_experiment•1y ago
No, you just condition it with text-voice token pairs and then when conditioning further inference w/ text the voice tokens tend to match the pairs further up in the context.
oezi•1y ago
Isn't xcodec2 also lossy? I thought it is also just another neural codec (50 tok/s, single codebook).

What are people using to upsampling back to 44,1 or 48 khz? Anything fancy?

woodson•1y ago
They’re both lossy. They use a VAE-VQ type architecture trained with a combination of losses/discriminators. The differences are mainly the encoder/decoder architecture, the type of bottleneck quantization (RVQ, FSQ, etc.) and of course the training data.

Java4Shell: RCE in OpenJDK when processing Base64

https://calif.io/java4shell/
860•werrett•11h ago•221 comments

GPT‑6.2 Astra and Sol

https://openai.com/index/introducing-gpt-6-2-astra-sol/
1246•jasondavies•14h ago•770 comments

ID.me terms required for IRS sign-in

https://consumerrights.wiki/w/ID.me_terms_required_for_IRS_sign-in
332•DeepLogin•7h ago•145 comments

AI is killing All About Berlin

https://nicolasbouliane.com/blog/death-by-ai
183•grey-area•1h ago•121 comments

Quad9's withdrawal from France: A canary in the coal mine

https://blog.cloudflare.com/quad9-withdrawal-from-france/
528•subset•10h ago•162 comments

Google's AI answers reducing search traffic by 40%

https://revscope.co/blog/search-seo-geo-2026/
331•slashdev•8h ago•256 comments

Interviewed at a YC startup, found out they used my LinkedIn without permission

https://reddit.com/r/recruitinghell/comments/1xyr6ml/interviewed_at_a_yc_startup_spent_30_hours/
311•throwawaysleep•3h ago•63 comments

Nvidia stopped disclosing Singapore sales as revenues hit $104B

https://www.ft.com/content/dbde7a30-548c-4f9d-a4be-7898a0c24dcf
515•louiereederson•15h ago•233 comments

Microsoft's ONNX Runtime has disappeared from GitHub

https://github.com/microsoft/onnxruntime
293•nvader•9h ago•66 comments

Why is Gemini 4 Carbon taking so long?

https://kernel.dev/blog/why-is-gemini-4-carbon-taking-so-long/
67•deenadz•4h ago•37 comments

Australia's full national topographic library at your fingertips

https://www.ga.gov.au/news/australias-full-national-topographic-library-at-your-fingertips
8•bryanrasmussen•1h ago•3 comments

Archive Team is archiving the Apple Support Community (closes November 20, 2026)

https://wiki.archiveteam.org/index.php/Apple_Discussions
177•digitaldragon•8h ago•58 comments

Highly classified US national security communications network goes down

https://www.cnn.com/2026/11/17/politics/highly-classified-national-security-communications-networ...
562•monkeydust•16h ago•651 comments

Why Fibonacci?

https://www.evilgeniuslabs.org/why-fibonacci
25•_Microft•2h ago•2 comments

MAI Code 2 and Code 2 Flash

https://microsoft.ai/news/introducing-mai-code-2-and-mai-code-2-flash/
349•lemonish97•13h ago•152 comments

GoGoGrandparent (YC S16) Is a Front End JavaScript / TypeScript Engineer

https://www.ycombinator.com/companies/gogograndparent/jobs/05woouL-front-end-javascript-typescrip...
1•davidchl•4h ago

350 years ago, Ole Rømer discovered that light has a finite speed

https://www.sciencenorway.no/culture-history-history-of-science/350-years-ago-this-man-discovered...
322•dxs•12h ago•94 comments

jQuery 4.1.0

https://github.com/jquery/jquery/releases/tag/4.1.0
315•petecooper•12h ago•163 comments

Claude was trained on protein sequences at scale

http://xinmingtu.cn/blog/2026/claude-opus-5-5-protein-sequences/
39•gmays•4h ago•13 comments

Phrack 73 Released

https://phrack.org/issues/73/introduction_md
365•notmine1337•13h ago•52 comments

Harvard researchers find AI coding agents shifted the bottleneck to code review

https://complexdiscovery.com/harvard-researchers-find-ai-coding-agents-shifted-the-bottleneck-to-...
165•judahmeek•11h ago•223 comments

Solid 2.0

https://www.solidjs.com/blog/solid-2-0-the-long-hold/
297•pier25•13h ago•85 comments

Cerebras Disaggregated Inference

https://www.cerebras.ai/blog/cerebras-launches-disaggregated-inference
74•emschwartz•7h ago•17 comments

Fun with Constrained Programming

https://blog.cmpxchg8b.com/2012/09/fun-with-constrained-programming.html
63•colejohnson66•3d ago•2 comments

Show HN: Unref – A Python dead code finder built on Ruff's parser

https://github.com/Apakottur/unref
17•McAvey•1d ago•0 comments

What is the best harness for each model?

https://runta.com/blog/introducing-frontierharness-eval-v1-1/
368•Edward40•17h ago•125 comments

43k+ new periodic solutions to the three body problem found by volunteers

https://www.threebodyorbits.com/hunt
7•threebodyorbits•3d ago•1 comments

Tencent Hy4 Flash

https://hy.tencent.ai/research/hy4-flash
115•lyra1337•11h ago•16 comments

Web Browser Engineering (2021)

https://browser.engineering/
164•ibobev•12h ago•21 comments

Launch HN: StarSling (YC P25) – Self-improving CI for agent-volume repos

https://starsling.dev
66•yonasb•13h ago•37 comments