Elevenlabs Conversational AI 2.0

https://elevenlabs.io/blog/conversational-ai-2-0

32•killion•8mo ago

Comments

miles•8mo ago

Given their excellent record, it's strange that ElevenLabs would make a basic transcription mistake in the embedded introduction video[1].

At around 30 seconds in[2], an AI agent types and says, "Hi! Welcome to our design studio." to which a customer responds「すみません、日本語で話してもいいですか？」(Sorry, may I speak Japanese?).

The AI agent then says 「もちろんです。日本語に切り替えましょう。」(Of course. Let's switch to Japanese.) but types「ご心配なく。数量は柔軟に対応できます。」which means "No worries. We can be flexible with the quantity."

[1] https://www.youtube.com/watch?v=TlclS4wLWgY

[2] https://imgur.com/18U9uUU

rolph•8mo ago

that could have serious consequences during a contract negotiation.

giaccoangelo•8mo ago

Yep that one's on me, we originally were doing an interpreter agent demo here, and then switched to the one in the video, but somehow this text from the interpreter agent was kept in the published video. something for us to learn from

giaccoangelo•8mo ago

a lot of awesome features in this ship, comment your feedback for me:)

piterrro•8mo ago

who are you?

frankvdwaal•8mo ago

He's a "Growth Engineer" from ElevenLabs. I'm not sure what that entails, but then I'm not familiar with that area of tech, so maybe someone else can explain it.

flyingspaceship•8mo ago

for elevenlabs in general, pricing too high. if we put the price to punch ratio of kokoro at 100, elevenlabs is probably a 35

mdrzn•8mo ago

Any demo so we can try it?

You should have learned something from the Sesame AI demo and the hype it generated for them.

ldenoue•8mo ago

How is the turn detection working? LLM prompting or a special AI audio plus text model?

gorgoiler•8mo ago

The play button widget will read the article aloud. Alas, it called the product “conversational AI two dot zero comma” and the company “vertical bar elevenlabs”.

Their TTS is good but unfortunately the exemplar widget is not nearly up to the same quality.

wild_egg•8mo ago

What does SOTA tool use with voice agents look like these days? Any providers have MCP support?

It'd be incredible to get to a point where we can have natural conversations and the AI is running tools in the background and keeping tabs on things.

Why there is no official statement from Substack about the data leak

Effects of Zepbound on Stool Quality

Show HN: Seedance 2.0 – The Most Powerful AI Video Generator

Ask HN: Do we need "metadata in source code" syntax that LLMs will never delete?

Pentagon cutting ties w/ "woke" Harvard, ending military training & fellowships

Can Quantum-Mechanical Description of Physical Reality Be Considered Complete? [pdf]

Kessler Syndrome Has Started [video]

Complex Heterodynes Explained

EVs Are a Failed Experiment

MemAlign: Building Better LLM Judges from Human Feedback with Scalable Memory

CCC (Claude's C Compiler) on Compiler Explorer

Homeland Security Spying on Reddit Users

Actors with Tokio (2021)

Can graph neural networks for biology realistically run on edge devices?

Deeper into the shareing of one air conditioner for 2 rooms

Weatherman introduces fruit-based authentication system to combat deep fakes

Why Embedded Models Must Hallucinate: A Boundary Theory (RCC)

A Curated List of ML System Design Case Studies

Pony Alpha: New free 200K context model for coding, reasoning and roleplay

Show HN: Tunbot – Discord bot for temporary Cloudflare tunnels behind CGNAT

Open Problems in Mechanistic Interpretability

Bye Bye Humanity: The Potential AMOC Collapse

Dexter: Claude-Code-Style Agent for Financial Statements and Valuation

Digital Iris [video]

Essential CDN: The CDN that lets you do more than JavaScript

They Hijacked Our Tech [video]

Vouch

HRL Labs in Malibu laying off 1/3 of their workforce

Show HN: High-performance bidirectional list for React, React Native, and Vue

Show HN: I built a Mac screen recorder Recap.Studio