Ask HN: What 'AI feature' created negative ROI in production?

5•kajolshah_bt•2w ago

Not demos, real usage. What broke first: data quality, evals, cost/latency, user trust, or support load?”

Comments

rtbruhan00•2w ago

We implemented an AI-powered customer support triage system that initially looked promising in testing. In production, it actually increased our support costs by ~30% because:

The AI would confidently misroute 15-20% of tickets, requiring human review of ALL AI decisions and the Customers lost trust after a few bad experiences and started explicitly requesting human agents also Support agents spent more time correcting AI mistakes than they saved

The breaking point was data quality - our training data was too clean compared to real customer queries. We ended up rolling back to rule-based routing with AI as an optional suggestion tool instead.

kajolshah_bt•2w ago

This is such a classic failure mode: even a 15–20% confident misroute is brutal because it forces “review everything,” kills trust, and increases repeats/reopens.

When you rolled back, did you keep AI as suggestions only + rules-based routing? And what metric exposed it fastest for you: recontact rate, handle time, or escalation to humans?

Yiin•2w ago

did you generate this reply with chatgpt or do you just naturally like to construct sentences like AI?

LEDThereBeLight•1w ago

Even the OP was ChatGPT - he couldn’t even be bothered to remove the quote at the end.

Ask HN: Non AI-obsessed tech forums

Ask HN: Anyone Using a Mac Studio for Local AI/LLM?

Ask HN: Ideas for small ways to make the world a better place

Ask HN: 10 months since the Llama-4 release: what happened to Meta AI?

AI Regex Scientist: A self-improving regex solver

Ask HN: Who wants to be hired? (February 2026)

Ask HN: Any International Job Boards for International Workers?

Ask HN: Who is hiring? (February 2026)

Ask HN: Why LLM providers sell access instead of consulting services?

Tell HN: Another round of Zendesk email spam

Ask HN: What is the most complicated Algorithm you came up with yourself?

Ask HN: Is Connecting via SSH Risky?

Ask HN: Has your whole engineering team gone big into AI coding? How's it going?

Ask HN: How does ChatGPT decide which websites to recommend?

Ask HN: Is it just me or are most businesses insane?

Ask HN: Mem0 stores memories, but doesn't learn user patterns

Ask HN: Anyone Seeing YT ads related to chats on ChatGPT?

Ask HN: Does global decoupling from the USA signal comeback of the desktop app?

Ask HN: Is there anyone here who still uses slide rules?

Kernighan on Programming

We built a serverless GPU inference platform with predictable latency

Ask HN: How Did You Validate?

Ask HN: Cheap laptop for Linux without GUI (for writing)

Test management tools for automation heavy teams

Ask HN: Have you been fired because of AI?

Ask HN: Does a good "read it later" app exist?

Ask HN: OpenClaw users, what is your token spend?

Ask HN: Anyone have a "sovereign" solution for phone calls?

How do you deal with SEO nowadays?

Ask HN: Has anybody moved their local community off of Facebook groups?