Elevenlabs Conversational AI 2.0

https://elevenlabs.io/blog/conversational-ai-2-0

32•killion•8mo ago

Comments

miles•8mo ago

Given their excellent record, it's strange that ElevenLabs would make a basic transcription mistake in the embedded introduction video[1].

At around 30 seconds in[2], an AI agent types and says, "Hi! Welcome to our design studio." to which a customer responds「すみません、日本語で話してもいいですか？」(Sorry, may I speak Japanese?).

The AI agent then says 「もちろんです。日本語に切り替えましょう。」(Of course. Let's switch to Japanese.) but types「ご心配なく。数量は柔軟に対応できます。」which means "No worries. We can be flexible with the quantity."

[1] https://www.youtube.com/watch?v=TlclS4wLWgY

[2] https://imgur.com/18U9uUU

rolph•8mo ago

that could have serious consequences during a contract negotiation.

giaccoangelo•8mo ago

Yep that one's on me, we originally were doing an interpreter agent demo here, and then switched to the one in the video, but somehow this text from the interpreter agent was kept in the published video. something for us to learn from

giaccoangelo•8mo ago

a lot of awesome features in this ship, comment your feedback for me:)

piterrro•8mo ago

who are you?

frankvdwaal•8mo ago

He's a "Growth Engineer" from ElevenLabs. I'm not sure what that entails, but then I'm not familiar with that area of tech, so maybe someone else can explain it.

flyingspaceship•8mo ago

for elevenlabs in general, pricing too high. if we put the price to punch ratio of kokoro at 100, elevenlabs is probably a 35

mdrzn•8mo ago

Any demo so we can try it?

You should have learned something from the Sesame AI demo and the hype it generated for them.

ldenoue•8mo ago

How is the turn detection working? LLM prompting or a special AI audio plus text model?

gorgoiler•8mo ago

The play button widget will read the article aloud. Alas, it called the product “conversational AI two dot zero comma” and the company “vertical bar elevenlabs”.

Their TTS is good but unfortunately the exemplar widget is not nearly up to the same quality.

wild_egg•8mo ago

What does SOTA tool use with voice agents look like these days? Any providers have MCP support?

It'd be incredible to get to a point where we can have natural conversations and the AI is running tools in the background and keeping tabs on things.

OpenCiv3: Open-source, cross-platform reimagining of Civilization III

The Waymo World Model

How we made geo joins 400× faster with H3 indexes

What Is Ruliology?

Unseen Footage of Atari Battlezone Arcade Cabinet Production

Show HN: Look Ma, No Linux: Shell, App Installer, Vi, Cc on ESP32-S3 / BreezyBox

Monty: A minimal, secure Python interpreter written in Rust for use by AI

Show HN: I spent 4 years building a UI design tool with only the features I use

Microsoft open-sources LiteBox, a security-focused library OS

Sheldon Brown's Bicycle Technical Info

Delimited Continuations vs. Lwt for Threads

Hackers (1995) Animated Experience

Dark Alley Mathematics

PC Floppy Copy Protection: Vault Prolok

Show HN: If you lose your memory, how to regain access to your computer?

An Update on Heroku

Zlob.h 100% POSIX and glibc compatible globbing lib that is faste and better

How to effectively write quality code with AI

Show HN: R3forth, a ColorForth-inspired language with a tiny VM

Why I Joined OpenAI

I spent 5 years in DevOps – Solutions engineering gave me what I was missing

Introducing the Developer Knowledge API and MCP Server

Female Asian Elephant Calf Born at the Smithsonian National Zoo

Understanding Neural Network, Visually

I now assume that all ads on Apple news are scams

Learning from context is harder than we thought

FORTH? Really!?

Show HN: ARM64 Android Dev Kit

Show HN: Smooth CLI – Token-efficient browser for AI agents

WebView performance significantly slower than PWA