frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

A simple heuristic for agents: human-led vs. human-in-the-loop vs. agent-led

1•fletchervmiles•1y ago
tl;dr - the more agency your agent has, the simpler your use case needs to be

Most if not all successful production use cases today are either human-led or human-in-the-loop. Agent-led is possible but requires simplistic use cases.

---

Human-led:

An obvious example is ChatGPT. One input, one output. The model might suggest a follow-up or use a tool but ultimately, you're the master in command.

---

Human-in-the-loop:

The best example of this is Cursor (and other coding tools). Coding tools can do 99% of the coding for you, use dozens of tools, and are incredibly capable. But ultimately the human still gives the requirements, hits "accept" or "reject' AND gives feedback on each interaction turn.

The last point is important as it's a live recalibration.

This can sometimes not be enough though. An example of this is the rollout of Sonnect 3.7 in Cursor. The feedback loop vs model agency mix was off. Too much agency, not sufficient recalibration from the human. So users switched!

---

Agent-led:

This is where the agent leads the task, end-to-end. The user is just a participant. This is difficult because there's less recalibration so your probability of something going wrong increases on each turn… It's cumulative.

P(all good) = pⁿ

p = agent works correctly n = number of turns / interactions

Ok… I'm going to use my product as an example, not to promote, I'm just very familiar with how it works.

It's a chat agent that runs short customer interviews. My customers can configure it based on what they want to learn (i.e. why a customer churned) and send it to their customers.

It's agent-led because

→ as soon as the respondent opens the link, they're guided from there → at each turn the agent (not the human) is deciding what to do next

That means deciding the right thing to do over 10 to 30 conversation turns (depending on config). I.e. correctly decide:

→ whether to expand the conversation vs dive deeper → reflect on current progress + context → traverse a bunch of objectives and ask questions that draw out insight (per current objective)

Let's apply the above formula. Example:

Let's say:

→ n = 20 (i.e. number of conversation turns) → p = .99 (i.e. how often the agent does the right thing - 99% of the time)

That equals P(all good) = 0.99²⁰ ≈ 0.82

So if I ran 100 such 20‑turn conversations, I'd expect roughly 82 to complete as per instructions and about 18 to stumble at least once.

Let's change p to 95%...

→ n = 20 → p = .95

P(all good) = 0.95²⁰ ≈ 0.358

I.e. if I ran 100 such 20‑turn conversations, I’d expect roughly 36 to finish without a hitch and about 64 to go off‑track at least once.

My p score is high. I had to strip out a bunch of tools and simplify but I got there. And for my use case, a failure is just a slightly irrelevant response so it's manageable.

---

Conclusion:

Getting an agent to do the correct thing 99% is not trivial.

You basically can't have a super complicated workflow. Yes, you can mitigate this by introducing other agents to check the work but this then introduces latency.

There's always a tradeoff!

Know which category you're building in and if you're going for agent-led, narrow your use-case as much as possible.

Japan's Fugaku supercomputer has decidedly un-super security

https://www.theregister.com/security/2026/11/17/japans-fugaku-supercomputer-has-decidedly-un-supe...
1•tosti•46m ago•0 comments

How Many people are taking the day off tomorrow

2•AlissonBland•47m ago•0 comments

macOS 27.3 includes new privacy controls for Full Disk Access and more

https://9to5mac.com/2026/11/16/macos-27-3-includes-new-privacy-controls-for-full-disk-access-and-...
2•tosh•49m ago•0 comments

Redict Is Deprecated

https://redict.io/posts/2026-11-17-redict-deprecated/
2•birdculture•50m ago•0 comments

I had AI read my entire field, Theoretical Astrophysics

https://science.caseyhandmer.com/physics/
3•Anon84•51m ago•0 comments

Nvidia and the World Without Jensen

https://newsletter.semianalysis.com/p/nvidia-and-the-world-without-jensen
1•rbanffy•52m ago•0 comments

How to find meaning in large tech companies

https://www.seangoedecke.com/how-to-find-meaning-in-large-tech-companies/
1•eigenBasis•55m ago•0 comments

US data centers are burning through as much electricity as entire states

https://newatlas.com/technology/data-centers-using-electricity-entire-states/
2•robtherobber•58m ago•0 comments

External Sandboxes for Coding Agents

https://simonwillison.net/2026/Nov/17/external-sandboxes-for-coding-agents/
2•lumpa•1h ago•1 comments

Decker: A HyperCard-like platform / game engine

https://internet-janitor.itch.io/decker
1•sph•1h ago•0 comments

Show HN: Korean company registry for AI agents – free MCP server and CSV batch

https://comepass.xyz/?lang=en
1•charles_park•1h ago•0 comments

Nvidia Announces Rubin HPC: Science-Focused Server GPU to Arrive in 2028

https://www.servethehome.com/nvidia-announces-rubin-hpc-science-focused-server-gpu-to-arrive-in-2...
3•rbanffy•1h ago•0 comments

Show HN: CRX8 – Check Manifest Permissions, Unpack CRX to Zip

https://crx8.com
1•gybin02•1h ago•0 comments

Show HN: JSON Processing Library – Benchmarked Against simdjson and Glaze

https://nihilai-collective.net/jsonifier
4•realtimechris•1h ago•2 comments

Can a formally-verified C compiler be as performant as GCC -O2?

https://ut-infraai.github.io/2026/11/13/trying-to-make-compcert-as-fast-as-gcc-o2/
2•signa11•1h ago•0 comments

Show HN: Distroguess – guess the shape of real data distributions

https://distroguess.nodolabs.co.uk/
1•orbis-tertius•1h ago•0 comments

New Study Shows How Young People Feel About AI Companions

https://www.404media.co/gallup-study-friendship-ai-companions/
1•waximabbax•1h ago•0 comments

Anamnesis – Local archive of your AI chats, searchable by any agent

https://github.com/devHaitham481/anamnesis
1•devHaitham481•1h ago•0 comments

Show HN: Type Fighter 2

https://typefighter2.com/
3•torumitch•1h ago•1 comments

Anki xiě hànzì: Learn, read, write and pronounce Mandarin

https://github.com/krmanik/Anki-xiehanzi
2•rahimnathwani•1h ago•0 comments

The 10x Overemployed Engineer

https://newsletter.pragmaticengineer.com/p/the-10x-overlemployed-engineer
1•jacquesm•1h ago•0 comments

GTA 6 launches with a Metacritic score of 99

https://www.metacritic.com/game/grand-theft-auto-vi/
3•ieie3366•1h ago•9 comments

Rune: A native Mac Kubernetes client, no account or telemetry

https://viktornyberg.com/rune.html
2•compilererrors•1h ago•1 comments

Show HN: Cocktail/Mocktail recipe page that's easy to use

https://mydrinkguide.com/
1•jmiseikis•1h ago•0 comments

iOS 26's Liquid Glass widgets in Flutter

https://github.com/mohamedalsamrai/liquidum
2•usmanmehmood55•1h ago•0 comments

Kioku: The Anki desktop app on your phone

https://github.com/krmanik/kioku/
1•rahimnathwani•1h ago•0 comments

Mozilla AI launches Otari, one API key for every model

https://otari.ai/
1•flaburgan•1h ago•0 comments

Show HN: Blobbies – Cute little avatars with your initials

https://blobbies.souravinsights.com/
2•SouravInsights•1h ago•0 comments

Show HN: A living archive told by an AI, in your language, ending sealed

https://satoshi-interface.com/
1•sebklaey•1h ago•0 comments

Show HN: Paste a Link. See the Bias

https://aethelgard.news/
1•Tryvrsakjo10•1h ago•0 comments