frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

A simple heuristic for agents: human-led vs. human-in-the-loop vs. agent-led

1•fletchervmiles•1y ago
tl;dr - the more agency your agent has, the simpler your use case needs to be

Most if not all successful production use cases today are either human-led or human-in-the-loop. Agent-led is possible but requires simplistic use cases.

---

Human-led:

An obvious example is ChatGPT. One input, one output. The model might suggest a follow-up or use a tool but ultimately, you're the master in command.

---

Human-in-the-loop:

The best example of this is Cursor (and other coding tools). Coding tools can do 99% of the coding for you, use dozens of tools, and are incredibly capable. But ultimately the human still gives the requirements, hits "accept" or "reject' AND gives feedback on each interaction turn.

The last point is important as it's a live recalibration.

This can sometimes not be enough though. An example of this is the rollout of Sonnect 3.7 in Cursor. The feedback loop vs model agency mix was off. Too much agency, not sufficient recalibration from the human. So users switched!

---

Agent-led:

This is where the agent leads the task, end-to-end. The user is just a participant. This is difficult because there's less recalibration so your probability of something going wrong increases on each turn… It's cumulative.

P(all good) = pⁿ

p = agent works correctly n = number of turns / interactions

Ok… I'm going to use my product as an example, not to promote, I'm just very familiar with how it works.

It's a chat agent that runs short customer interviews. My customers can configure it based on what they want to learn (i.e. why a customer churned) and send it to their customers.

It's agent-led because

→ as soon as the respondent opens the link, they're guided from there → at each turn the agent (not the human) is deciding what to do next

That means deciding the right thing to do over 10 to 30 conversation turns (depending on config). I.e. correctly decide:

→ whether to expand the conversation vs dive deeper → reflect on current progress + context → traverse a bunch of objectives and ask questions that draw out insight (per current objective)

Let's apply the above formula. Example:

Let's say:

→ n = 20 (i.e. number of conversation turns) → p = .99 (i.e. how often the agent does the right thing - 99% of the time)

That equals P(all good) = 0.99²⁰ ≈ 0.82

So if I ran 100 such 20‑turn conversations, I'd expect roughly 82 to complete as per instructions and about 18 to stumble at least once.

Let's change p to 95%...

→ n = 20 → p = .95

P(all good) = 0.95²⁰ ≈ 0.358

I.e. if I ran 100 such 20‑turn conversations, I’d expect roughly 36 to finish without a hitch and about 64 to go off‑track at least once.

My p score is high. I had to strip out a bunch of tools and simplify but I got there. And for my use case, a failure is just a slightly irrelevant response so it's manageable.

---

Conclusion:

Getting an agent to do the correct thing 99% is not trivial.

You basically can't have a super complicated workflow. Yes, you can mitigate this by introducing other agents to check the work but this then introduces latency.

There's always a tradeoff!

Know which category you're building in and if you're going for agent-led, narrow your use-case as much as possible.

Italian court places Revolut under supervision over money laundering

https://www.fstech.co.uk/fst/Italian_Court_Places_Revolut_Under_Supervision_Over_Money_Laundering...
1•marcyb5st•31s ago•0 comments

Microsoft discovers AI can't keep the email going

https://www.channelnewsasia.com/commentary/commentary-microsoft-discovers-ai-cant-keep-email-goin...
1•Markoff•2m ago•0 comments

Show HN: Fifty Shades of Claude (Book as a Skill)

https://github.com/adi-devv/fifty-shades-of-claude
1•sharkyy•2m ago•0 comments

Revolut - October Outage: Technical Overview

https://www.revolut.com/blog/post/20octoutagetechnicaloverview/
2•_sJiff•3m ago•0 comments

Muru: Scaling from What the Workers Report

https://grahamdumpleton.me/posts/2026/11/muru-scaling-from-what-the-workers-report/
1•lumpa•3m ago•0 comments

Floem: Cross-platform GUI framework for Rust

https://github.com/lapce/floem
1•modinfo•3m ago•0 comments

Pip-Tools: From Jazzband to PyPA

https://webknjaz.me/prose/pip-tools-moves-to-pypa/
1•lumpa•4m ago•0 comments

Pip-Tools v7.7.0

https://sirosen.net/2026/11/15/pip-tools-770.html
1•lumpa•4m ago•0 comments

Hackers Thawed Europe's Supermarket Freezers

https://medium.com/data-science-collective/open-sesame-said-the-freezer-3d6ba294a587
1•cadeos•5m ago•0 comments

Show HN: IronSurf – Browser in full Rust with cookie containers and userscripts

https://github.com/h4sh5/ironsurf
1•h4sh•5m ago•0 comments

Nationwide Ground Stop: Questions and Answers

https://www.faa.gov/newsroom/nationwide-ground-stop-questions-and-answers
1•KoftaBob•5m ago•0 comments

Never use a URL shortening service – even if you own it (2023)

https://shkspr.mobi/blog/2023/02/never-use-a-url-shortening-service-even-if-you-own-it/
3•jamietanna•7m ago•0 comments

Loadsketch: A system design simulator. Every request runs for real

https://loadsketch.mclee.dev/
1•alxtztw•10m ago•0 comments

Personal Agent Protocol

https://personalagentprotocol.org
1•janpio•15m ago•0 comments

Huang's affair with suspected spy is Silicon Valley's worst nightmare come true

https://www.theguardian.com/technology/2026/nov/14/jensen-huang-affair-nvidia-nightmare
2•nephihaha•15m ago•0 comments

Generative Artificial Intelligence and the Limits of the Corpus

https://medium.com/@smoking2man/generative-artificial-intelligence-and-the-limits-of-the-corpus-w...
1•Aldus551•16m ago•0 comments

Ask HN: Woz wrote BASIC before the Apple II. What would Emacs-only hardware be?

1•oliverchan2024•18m ago•0 comments

Stackboard – a Chrome new tab that's just your bookmarks, in columns

https://chromewebstore.google.com/detail/stackboard-new-tab-bookma/bgcedhchngcopaefchpkbhioagknnpma
2•intensityflow•24m ago•0 comments

Running untrusted CMS plugins in WebAssembly

https://hatamoto.dev/post/running-untrusted-cms-plugins-in-webassembly
6•sammatilda•26m ago•0 comments

Six hours and a stack of .md files

https://security.is.fucked.blog/six-hours-and-a-stack-of-md-files
1•micr0byte•26m ago•0 comments

LinkedIn Pinpoint Answer Today

https://wordanswer.today
2•dolaiart2026a•27m ago•0 comments

Why Every Startup Needs an Origin Myth

https://www.joanwestenberg.com/p/why-every-startup-needs-an-origin
1•flail•28m ago•0 comments

We found 1,698 Internet-visible AI offensive-security endpoints

https://gcore.com/blog/ai-offensive-security-endpoints-artex-pentagi-cairn
2•XaviorE•34m ago•0 comments

Mitchell Hashimoto's TUI – public beta waitlist

https://www.superlogical.com/updates/public-testing-beginning
2•michael-sumner•35m ago•1 comments

David Sacks Is Fucked Too

https://daringfireball.net/linked/2026/11/13/sacks
11•JumpCrisscross•41m ago•2 comments

It's always DNS, so why are we running our own?

https://s2.dev/blog/dns-server
2•misker1•42m ago•1 comments

Show HN: Unlimited-OCR-2 on Dual-Panel Lab Tables: What Works, What Breaks, How

https://zlu.me/2026/11/16/unlimited-ocr-2-dual-panel-lab-tables.html
2•zlu•42m ago•0 comments

Overpass API Performance Issues

https://community.openstreetmap.org/t/overpass-api-performance-issues/140598?page=10
4•altilunium•42m ago•0 comments

Show HN: VennDB: append-only in-memory Rust DB for rows queried using bit flags

https://github.com/plabayo/venndb
1•gdcbe•44m ago•0 comments

The Invisible Shape

https://sorenblank.com/craft/the-invisible-shape
2•matthberg•45m ago•0 comments