Elevenlabs Conversational AI 2.0

https://elevenlabs.io/blog/conversational-ai-2-0

32•killion•8mo ago

Comments

miles•8mo ago

Given their excellent record, it's strange that ElevenLabs would make a basic transcription mistake in the embedded introduction video[1].

At around 30 seconds in[2], an AI agent types and says, "Hi! Welcome to our design studio." to which a customer responds「すみません、日本語で話してもいいですか？」(Sorry, may I speak Japanese?).

The AI agent then says 「もちろんです。日本語に切り替えましょう。」(Of course. Let's switch to Japanese.) but types「ご心配なく。数量は柔軟に対応できます。」which means "No worries. We can be flexible with the quantity."

[1] https://www.youtube.com/watch?v=TlclS4wLWgY

[2] https://imgur.com/18U9uUU

rolph•8mo ago

that could have serious consequences during a contract negotiation.

giaccoangelo•8mo ago

Yep that one's on me, we originally were doing an interpreter agent demo here, and then switched to the one in the video, but somehow this text from the interpreter agent was kept in the published video. something for us to learn from

giaccoangelo•8mo ago

a lot of awesome features in this ship, comment your feedback for me:)

piterrro•8mo ago

who are you?

frankvdwaal•8mo ago

He's a "Growth Engineer" from ElevenLabs. I'm not sure what that entails, but then I'm not familiar with that area of tech, so maybe someone else can explain it.

flyingspaceship•8mo ago

for elevenlabs in general, pricing too high. if we put the price to punch ratio of kokoro at 100, elevenlabs is probably a 35

mdrzn•8mo ago

Any demo so we can try it?

You should have learned something from the Sesame AI demo and the hype it generated for them.

ldenoue•8mo ago

How is the turn detection working? LLM prompting or a special AI audio plus text model?

gorgoiler•8mo ago

The play button widget will read the article aloud. Alas, it called the product “conversational AI two dot zero comma” and the company “vertical bar elevenlabs”.

Their TTS is good but unfortunately the exemplar widget is not nearly up to the same quality.

wild_egg•8mo ago

What does SOTA tool use with voice agents look like these days? Any providers have MCP support?

It'd be incredible to get to a point where we can have natural conversations and the AI is running tools in the background and keeping tabs on things.

Los Alamos Primer

NewASM Virtual Machine

Terminal-Bench 2.0 Leaderboard

I vibe coded a BBS bank with a real working ledger

The Path to Mojo 1.0

Show HN: I'm 75, building an OSS Virtual Protest Protocol for digital activism

Show HN: I built Divvy to split restaurant bills from a photo

Hot Reloading in Rust? Subsecond and Dioxus to the Rescue

Skim – vibe review your PRs

Show HN: Open-source AI assistant for interview reasoning

Tech Edge: A Living Playbook for America's Technology Long Game

Golden Cross vs. Death Cross: Crypto Trading Guide

Hoot: Scheme on WebAssembly

What the longevity experts don't tell you

Monzo wrongly denied refunds to fraud and scam victims

They were drawn to Korea with dreams of K-pop stardom – but then let down

Show HN: AI-Powered Merchant Intelligence

Bash parallel tasks and error handling

Let's compile Quake like it's 1997

Reverse Engineering Medium.com's Editor: How Copy, Paste, and Images Work

Go 1.22, SQLite, and Next.js: The "Boring" Back End

Laibach the Whistleblowers [video]

Slop News - The Front Page right now but it's only Slop

Economists vs. Technologists on AI

Life at the Edge

RISC-V Vector Primer

Show HN: Invoxo – Invoicing with automatic EU VAT for cross-border services

A Tale of Two Standards, POSIX and Win32 (2005)

Ask HN: Is the Downfall of SaaS Started?

Flirt: The Native Backend