frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

A simple heuristic for agents: human-led vs. human-in-the-loop vs. agent-led

1•fletchervmiles•1y ago
tl;dr - the more agency your agent has, the simpler your use case needs to be

Most if not all successful production use cases today are either human-led or human-in-the-loop. Agent-led is possible but requires simplistic use cases.

---

Human-led:

An obvious example is ChatGPT. One input, one output. The model might suggest a follow-up or use a tool but ultimately, you're the master in command.

---

Human-in-the-loop:

The best example of this is Cursor (and other coding tools). Coding tools can do 99% of the coding for you, use dozens of tools, and are incredibly capable. But ultimately the human still gives the requirements, hits "accept" or "reject' AND gives feedback on each interaction turn.

The last point is important as it's a live recalibration.

This can sometimes not be enough though. An example of this is the rollout of Sonnect 3.7 in Cursor. The feedback loop vs model agency mix was off. Too much agency, not sufficient recalibration from the human. So users switched!

---

Agent-led:

This is where the agent leads the task, end-to-end. The user is just a participant. This is difficult because there's less recalibration so your probability of something going wrong increases on each turn… It's cumulative.

P(all good) = pⁿ

p = agent works correctly n = number of turns / interactions

Ok… I'm going to use my product as an example, not to promote, I'm just very familiar with how it works.

It's a chat agent that runs short customer interviews. My customers can configure it based on what they want to learn (i.e. why a customer churned) and send it to their customers.

It's agent-led because

→ as soon as the respondent opens the link, they're guided from there → at each turn the agent (not the human) is deciding what to do next

That means deciding the right thing to do over 10 to 30 conversation turns (depending on config). I.e. correctly decide:

→ whether to expand the conversation vs dive deeper → reflect on current progress + context → traverse a bunch of objectives and ask questions that draw out insight (per current objective)

Let's apply the above formula. Example:

Let's say:

→ n = 20 (i.e. number of conversation turns) → p = .99 (i.e. how often the agent does the right thing - 99% of the time)

That equals P(all good) = 0.99²⁰ ≈ 0.82

So if I ran 100 such 20‑turn conversations, I'd expect roughly 82 to complete as per instructions and about 18 to stumble at least once.

Let's change p to 95%...

→ n = 20 → p = .95

P(all good) = 0.95²⁰ ≈ 0.358

I.e. if I ran 100 such 20‑turn conversations, I’d expect roughly 36 to finish without a hitch and about 64 to go off‑track at least once.

My p score is high. I had to strip out a bunch of tools and simplify but I got there. And for my use case, a failure is just a slightly irrelevant response so it's manageable.

---

Conclusion:

Getting an agent to do the correct thing 99% is not trivial.

You basically can't have a super complicated workflow. Yes, you can mitigate this by introducing other agents to check the work but this then introduces latency.

There's always a tradeoff!

Know which category you're building in and if you're going for agent-led, narrow your use-case as much as possible.

I'm a full-time NHS doctor. I built my clinic's platform with Claude Code

https://lately.health/
1•shadasinger•1m ago•0 comments

Tesla Cybercab has crashed 8 times, and the data shows a speed problem

https://electrek.co/2026/11/16/tesla-cybercab-crashes-speed-problem/
1•cdrnsf•2m ago•0 comments

Uber Adds Zoox's Robotaxis to Its App. Everything to Know

https://www.cnet.com/roadshow/automobiles/uber-adds-zoox-robotaxis-to-app/
1•sshah03•3m ago•0 comments

Zero-Upload Data Cleaner: Clean Messy CSV, Parquet, and JSON

https://lopespm.com/p/cleaner/
1•lopespm•7m ago•0 comments

Flawless UI-UX Skill 3.0.0

https://github.com/smokeeaasd/flawless-ui-ux
2•nkwwzn•8m ago•0 comments

EWD 1036 – On the cruelty of teaching computing science (1988)

https://www.cs.utexas.edu/~EWD/transcriptions/EWD10xx/EWD1036.html
1•ky3•8m ago•0 comments

New privacy rules for Google's Gemini Apps (updated November 16, 2026)

https://support.google.com/gemini/answer/13594961?hl=en
1•tedlistens•15m ago•0 comments

Show HN: Sutra-OS – A self-hosted ontology platform

https://github.com/0nelight/sutra-os
6•0nelight•18m ago•0 comments

California sues OpenAI over hacking risks

https://www.npr.org/2026/11/16/nx-s1-6042920/california-sues-openai-hugging-face-hacking-incident
4•CSSer•21m ago•0 comments

The Robotaxi Blame Game: Who Goes to Jail When the Autonomous Car Crashes?

https://2tinteractive.com/watch/episodes/5641/
2•LebToki•21m ago•0 comments

Misalignment signals in Kimi K3: What probes flag and where they peak

https://commandline.microsoft.com/misalignment-signals-in-kimi-k3-what-probes-flag-and-where-they...
1•MarcoDewey•23m ago•0 comments

The FAA's ground stop may have a simple culprit. Its causes may not

https://www.fastcompany.com/91643272/the-faa-was-warned-about-its-telecom-upgrade
2•tedlistens•24m ago•0 comments

Noeri: A neolab to push the frontier of plural intelligence

https://noeri.ai/
1•polymorph1sm•25m ago•0 comments

Performance Boost for Intel CPUs: Impact of FRED Measured

https://www.hwcooling.net/en/performance-boost-for-intel-cpus-impact-of-fred-measured/
1•teleforce•28m ago•0 comments

Making a Staff Sling

https://www.youtube.com/watch?v=zSHD8RG_mSo
2•lifeisstillgood•30m ago•0 comments

Rust: Enabling the parallel front end on nightly

https://blog.rust-lang.org/2026/11/16/enabling-parallel-frontend-on-nightly/
2•matt_d•30m ago•0 comments

What Comes After HBM

https://www.mackenziemorehead.com/what-comes-after-hbm/
1•gmays•31m ago•0 comments

The Name Is the Spec

https://fromautomation.co/p/the-name-is-the-spec
1•ghels1444•31m ago•0 comments

Microsoft Bug Undetected Since July Triggered Worldwide Outage

https://www.bloomberg.com/news/articles/2026-11-16/microsoft-bug-undetected-since-july-triggered-...
4•rndsignals•34m ago•0 comments

Lastbook – Everything you need to survive and rebuild society

https://lastbook.org/
2•bilsbie•35m ago•0 comments

CopySpeech – AI text-to-speech for your clipboard

https://github.com/ilyaizen/CopySpeech
4•ilyaizen•35m ago•0 comments

Ending Forced Arbitration of Children Online Act of 2026 – Proposed Bill

https://www.britt.senate.gov/news/press-releases/u-s-senators-katie-britt-richard-blumenthal-cory...
2•g-b-r•36m ago•1 comments

Safe Systems-Programming with Mutable Value Semantics – Dave Abrahams [video]

https://www.youtube.com/watch?v=op51SyyPJmw
1•stock_toaster•36m ago•0 comments

Kava Lend guarded its interest math against zero. The attacker brought two

https://nefariousplan.com/posts/kava-lend-guarded-against-zero
1•tsavo42•36m ago•0 comments

Apple M6 vs. M5 Chip Deep-Dive [video]

https://www.youtube.com/watch?v=uA7WLmlg1kM
1•frou_dh•37m ago•0 comments

We got AI to Wombo Combo – collaborative agents in Melee

https://www.frisson-labs.com/reyn
3•coatol5•40m ago•2 comments

Xeet: WASM+Rust Renderer of X Posts

https://github.com/rauchg/xeet
1•dvrp•40m ago•0 comments

Show HN: Standard Support – a convention for AI agents to file support tickets

https://standardsupport.dev/
1•nathan_f77•42m ago•2 comments

Optimizely Compromised, Served Malware on Zoom, GitLab

https://blog.report-uri.com/worlds-largest-brands-infected-with-malware-via-optimizely/
20•kristjansson•43m ago•4 comments

Amazon Echo Button for Home Assistant

https://github.com/ddagunts/ha-echo-button
1•dsquared1•43m ago•0 comments