Omnilingual ASR: Advancing automatic speech recognition for 1600 languages

https://ai.meta.com/blog/omnilingual-asr-advancing-automatic-speech-recognition/?_fb_noscript=1

47•jean-•4h ago

HF Demo: https://huggingface.co/spaces/facebook/omniasr-transcription...

GitHub: https://github.com/facebookresearch/omnilingual-asr

Comments

meetpateltech•4h ago

HF Demo: https://huggingface.co/spaces/facebook/omniasr-transcription...

GitHub: https://github.com/facebookresearch/omnilingual-asr

dang•2h ago

Thanks! I've added those links to the toptext as well.

tschellenbach•2h ago

any insights on latency?

samat•1h ago

How hard is it to make TTS out of this? A few independent journalists from Belarus asked for TTS in their language, but I am no expert, was thinking about re-using Mozilla's work. What's the easiest way to get working TTS for a language?

kulahan•1h ago

From TFA, it says that it’s extremely easy to add new languages with just a few examples. I didn’t see specifics on how “few” it really is, though.

nl•20m ago

This is ASR not TTS though.

woodson•13m ago

You can use the OmniASR SSL models instead of their older MMS models to create TTS models: https://github.com/ylacombe/finetune-hf-vits

stuffoverflow•1h ago

This seems like a massive improvement for openly available local ASR. Even the 300M model outperforms whisper-large-v3 according to the paper's benchmarks.

lostmsu•4m ago

[delayed]

AIorNot•23m ago

the global language explorer is fascinating -great work guys

https://aidemos.atmeta.com/omnilingualasr/language-globe

- we are getting closer to BabelFish.. at least for the Earth!

cadamsdotcom•23m ago

Only a few gb of weights will recognize speech in 1600+ languages.

Freely downloadable and usable by anyone for almost anything.

We truly live in the future.

Fei Fei Li: Spatial Intelligence is AI’s Next Frontier

Unexpected things that are people

Writing your own BEAM

The lazy Git UI you didn't know you need

TTS Still Sucks

High-performance 2D graphics rendering on the CPU using sparse strips [pdf]

Zeroing in on Zero-Point Motion Inside a Crystal

Using Generative AI in Content Production

Error ABI

Memory Safety for Skeptics

Registered OAuth Parameters

Linux in a Pixel Shader – A RISC-V Emulator for VRChat

Omnilingual ASR: Advancing automatic speech recognition for 1600 languages

Unix v4 Tape Found

Head in the Zed Cloud

Benchmarking leading AI agents against Google reCAPTCHA v2

Building a high-performance ticketing system with TigerBeetle

Launch HN: Hypercubic (YC F25) – AI for COBOL and Mainframes

Dependent Types and How to Get Rid of Them

Synesthesia helps me find four-leaf clovers (2023)

3D Heterogeneous Integration Powers New DARPA Fab

Canadian military will rely on public servants to boost its ranks by 300k

Redmond, WA, turns off Flock Safety cameras after ICE arrests

Pose Animator – An open source tool to bring SVG characters to life (2020)

Interesting SPI Routing with iCE40 FPGAs

LLMs are steroids for your Dunning-Kruger

Asus Ascent GX10

Cybersecurity breach at Congressional Budget Office remains a live threat

How cops can get your private online data

Sysgpu – Experimental descendant of WebGPU written in Zig

Omnilingual ASR: Advancing automatic speech recognition for 1600 languages

Comments

Fei Fei Li: Spatial Intelligence is AI’s Next Frontier

Unexpected things that are people

Writing your own BEAM

The lazy Git UI you didn't know you need

TTS Still Sucks

High-performance 2D graphics rendering on the CPU using sparse strips [pdf]

Zeroing in on Zero-Point Motion Inside a Crystal

Using Generative AI in Content Production

Error ABI

Memory Safety for Skeptics

Registered OAuth Parameters

Linux in a Pixel Shader – A RISC-V Emulator for VRChat

Omnilingual ASR: Advancing automatic speech recognition for 1600 languages

Unix v4 Tape Found

Head in the Zed Cloud

Benchmarking leading AI agents against Google reCAPTCHA v2

Building a high-performance ticketing system with TigerBeetle

Launch HN: Hypercubic (YC F25) – AI for COBOL and Mainframes

Dependent Types and How to Get Rid of Them

Synesthesia helps me find four-leaf clovers (2023)

3D Heterogeneous Integration Powers New DARPA Fab

Canadian military will rely on public servants to boost its ranks by 300k

Redmond, WA, turns off Flock Safety cameras after ICE arrests

Pose Animator – An open source tool to bring SVG characters to life (2020)

Interesting SPI Routing with iCE40 FPGAs

LLMs are steroids for your Dunning-Kruger

Asus Ascent GX10

Cybersecurity breach at Congressional Budget Office remains a live threat

How cops can get your private online data

Sysgpu – Experimental descendant of WebGPU written in Zig