frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

Open in hackernews

Ztalk – Real-time voice-to-voice translation for Zoom, Gmeet, Teams

https://ztalk.ai/
12•kshitijzeoauto•1mo ago

Comments

kshitijzeoauto•1mo ago
We launched Ztalk (https://www.producthunt.com/products/ztalk-ai) on Product Hunt 10 days back and ended the day with the second highest upvotes (545). Here's a short demo video (https://www.youtube.com/watch?v=FYM9einhyAQ). Ztalk is a real-time voice-to-voice translation app for Zoom, Google Meet, and Teams. It adds live captions and translated voice — no extensions or plugins. Works on Mac & Windows. After launch, we were flooded with demo requests from individuals and companies — partly driven by AI newsletter coverage — across a surprisingly wide range of use cases: Candidates interviewing for roles in other countries NGOs working in conflict zones SaaS companies onboarding customers in different languages Online therapy/support groups Cross-border scrums, demos, and board meetings

We saw two dominant usage patterns: Passive listening: Large webinars where users want to hear translations without speaking Active participation: Small group conversations with real-time back-and-forth

In both cases, latency and accuracy are critical. Our internal benchmark: if we achieve <500ms latency with >95% accuracy, this could unlock a ~$10B+ market. As seen with Sanas and Krisp, companies are already building fast-growing businesses from accent translation alone. Tech Stack & Experiments Surprisingly, there’s no widely available API/SDK that converts streaming voice input → translated voice output in real-time. OpenAI’s real-time API (which supports voice-to-voice translation) often breaks out of its translation role and starts responding conversationally — even with strict prompting. It also has a hardwired “no interruption” behavior, meaning it won’t speak if someone else is talking — making it unusable in overlapping conversations, which are common in live meetings. So we built the standard 3-step pipeline: - ASR (Speech-to-Text) - Translation - TTS (Text-to-Speech)

Each step had challenges: 1. Speech-to-Text: - Most APIs (Azure, AWS, ElevenLabs) expect WAV/FLAC chunks — not true streaming. - We experimented with audio chunking over WebRTC/WebSocket — Silero was usable but often clipped mid-sentence. - Whisper lags behind newer models in speed, streaming, and accuracy. - GPT-4o’s streaming API had the best balance between latency and context, and supports true streaming input. 2. Translation: - Many providers do well here. - Smaller local models work for specific pairs (e.g., en↔es, en↔fr) with >95% accuracy. 3. TTS: - The Web Speech API is fast but robotic. - ElevenLabs and Cartesia produce expressive voices, but their pricing isn't viable for our target users. - We found good results with VITS (conditional variational autoencoder), offering diverse voice options per language.

With recent AI breakthroughs, I’d love to open a discussion on how real-time translation is evolving — and where it might realistically go: - Are there newer APIs or OSS projects that simplify the voice-to-voice stack? - Can on-device models realistically hit sub-400ms round-trips? - Any merged pipelines (ASR + translation + TTS) trained end-to-end? - Could forward-leaning models reduce latency in verb-final languages like Hindi/Japanese by predicting intent early? Also: What does good product design look like if 1.5–2.5s latency remains for the foreseeable future? We currently support full-duplex calls via audio routing and virtual mixing, with per-user toggles to choose original vs. translated voice. It works well, though we’re still refining UX for edge cases like overlapping speech and noisy input. Would love to hear your thoughts or stack choices if you've built anything similar.

aksinghal654•1mo ago
As someone on international calls daily, this solves a real pain point. Well done!
siddhant_mohan•1mo ago
This is a space I’ve been watching closely — what TTS voices did you find most natural across languages?
riteshs•1mo ago
Interesting take on real-time translation. How do you handle speech overlap when multiple people talk at once?
shivamitm•1mo ago
Would be interesting to experiment with forward-leaning translation + low-confidence overlays — e.g., show a "probable translation" immediately, then replace it once full intent is clearer. Might reduce perceived latency even if real latency stays ~2s.
SiddhantMalik•1mo ago
If you haven’t already, look at Deepgram’s streaming ASR for speaker turn detection — it handles overlap better than OpenAI’s strict no-interruption rule and might pair well with an async translation layer.
anuragdt•1mo ago
Interesting use case
brajendra01872•1mo ago
Really interesting approach with full-duplex routing and virtual drivers. Curious if you've looked into low-level WASAPI or CoreAudio hooks to reduce routing overhead on Windows/macOS — might help avoid the need for 3rd-party loopback tools entirely.
poorva•1mo ago
The hardest part of real-time translation isn’t translation — it’s audio synchronization, UX flow, and managing expectations under variable latency. Really curious how you're thinking about fallback modes (e.g., subtitle-only if TTS lags).
DhirajSingh•1mo ago
Have you considered training a small end-to-end voice2voice model using student-teacher distillation from the GPT-4o pipeline? Even a narrow domain (e.g., customer support) could benefit from a custom fast model that bypasses intermediate text.
abhayana2•1mo ago
VITS is a solid choice for quality, but have you benchmarked latency vs. Bark or XTTS for expressive TTS under 500ms? Some Bark variants offer decent emotion retention with faster output if model size is trimmed.

Search for Putnam [pdf]

https://static1.squarespace.com/static/602dc8c89c86880eb9bcdba1/t/6715adcb8c8d2c3bd887698e/1729474006167/PUTNAM+10_21_24+w+links+copy.pdf
1•jerlendds•4m ago•0 comments

Show HN: Clippingmini – A minimalist tool to organize and tag web clippings

https://www.clippingmini.com/
1•hadfamily•5m ago•1 comments

Scientists tracking 'interstellar' object that's come from another solar system

https://www.independent.co.uk/space/interstellar-object-solar-system-science-b2781329.html
1•zzzeek•7m ago•0 comments

Numerical Electromagnics Code (NEM)

https://www.nec2.org/
1•hyperific•11m ago•0 comments

I Can't Sleep (2023)

https://blog.paulbiggar.com/i-cant-sleep/
1•ciconia•13m ago•0 comments

Ask HN: What's the last non-obvious skill that made you better at your job?

2•rajkumarsekar•16m ago•2 comments

G/O Media Sells Kotaku as It Winds Down Operations

https://www.nytimes.com/2025/07/02/business/media/kotaku-go-media-sale.html
1•reaperducer•22m ago•0 comments

Kamishibai

https://en.wikipedia.org/wiki/Kamishibai
1•benbreen•28m ago•0 comments

Data Ecofeminism

https://dl.acm.org/doi/10.1145/3715275.3732027
2•slater•33m ago•0 comments

Show HN: DeepMarketScan: Counter Trade Retail Traders

https://www.deepmarketscan.com/landing
1•retroviber•33m ago•0 comments

Foxconn mysteriously tells Chinese workers to quit India and return to China

https://appleinsider.com/articles/25/07/02/foxconn-mysteriously-tells-chinese-workers-to-quit-india-and-return-to-china
2•signa11•35m ago•0 comments

Maxell MXCP-P100 Cassette Tape Player Offers a Retro Look with Modern Features

https://hypebeast.com/2025/7/maxell-mxcp-p100-cassette-player-release-info
1•Bluestein•36m ago•0 comments

Foxconn Pulls Chinese Staff from India in Hurdle for Apple

https://www.bloomberg.com/news/articles/2025-07-02/foxconn-pulls-chinese-staff-from-india-in-hurdle-for-apple-aapl
7•mgh2•39m ago•0 comments

The world of Voronoi diagrams (2021)

https://fbellelli.com/posts/2021-07-08-the-fascinating-world-of-voronoi-diagrams/
2•nickcotter•45m ago•0 comments

How I Built a P2P Texas Hold'em Game (Part 1: Protocol and Encryption)

https://medium.com/@predator.ray/how-i-built-a-p2p-texas-holdem-game-part-1-protocol-encryption-d043edb93288
1•zetaplusae•48m ago•0 comments

Denial vs. OpenAI, Inc. (ND Cal 2025) [pdf]

https://archive.org/download/gov.uscourts.cand.452129/gov.uscourts.cand.452129.1.0.pdf
1•1vuio0pswjnm7•52m ago•0 comments

Kilmar Abrego Garcia describes beatings and psychological torture in CECOT

https://www.politico.com/news/2025/07/02/kilmar-abrego-garcia-salvadoran-prison-account-00438153
6•wk_end•57m ago•0 comments

Dalai Lama vows he won't be the last leader of Tibetan Buddhism

https://www.cnn.com/2025/07/02/asia/dalai-lama-reincarnation-announcement-intl-hnk
2•Tomte•1h ago•0 comments

OfflineInstallers – Download browser and .NET Framework offline installers

https://offlineinstallers.com/
1•louizo79•1h ago•0 comments

Colossus: The Forbin Project (1970) [video]

https://archive.org/details/colossus-the-forbin-project-1970
1•petethomas•1h ago•0 comments

What's wrong with AAA games? The development of the next Battlefield has answers

https://arstechnica.com/gaming/2025/07/behind-the-next-battlefield-game-culture-clash-crunch-and-colossal-stakes/
3•Tomte•1h ago•1 comments

Options for Handling Form Submissions Without a Back End

https://devmatter.app/blog/how-to-handle-form-submissions-without-a-backend
1•adityavinodh•1h ago•1 comments

AetherScript: AI-Assisted Development That You Can Trust

1•papabili•1h ago•0 comments

NIH Scientists Link Air Pollution and Lung Cancer Mutations in Non-Smokers

https://insideclimatenews.org/news/02072025/air-pollution-linked-to-lung-cancer-mutations/
10•OutOfHere•1h ago•0 comments

Demonstration of Algorithmic Quantum Speedup for an Abelian Hidden Subgroup

https://journals.aps.org/prx/abstract/10.1103/PhysRevX.15.021082
2•boilerupnc•1h ago•0 comments

Show HN: Track your favorite music, movies, shows, games, books and more

https://calendia-app.com
1•Andrew8581•1h ago•0 comments

Nothing's Untestable

https://antithesis.com/blog/2025/bugbash_2025/mitchell_hashimoto/
3•zdw•1h ago•0 comments

Show HN: I made a social media platform

https://onelined.tech/
3•sahil423•1h ago•1 comments

How to write Rust in the kernel part 1

https://lwn.net/Articles/1024202/
2•pkilgore•2h ago•0 comments

CEOs Start Saying the Quiet Part Out Loud: AI Will Wipe Out Jobs

https://www.wsj.com/tech/ai/ai-white-collar-job-loss-b9856259
11•planetjones•2h ago•7 comments