Libretto (https://libretto.sh) is a Skill+CLI that makes it easy for your coding agent to generate deterministic browser automations and debug existing ones. Key shift is going from “give an agent a prompt at runtime and hope it figures things out” to: “Use coding agents to generate real scripts you can inspect, run, and debug”.

Here’s a demo: https://www.youtube.com/watch?v=0cDpIntmHAM. Docs start at https://libretto.sh/docs/get-started/introduction.

We spent a year building and maintaining browser automations for EHR and payer portal integrations at our healthcare startup. Building these automations and debugging failed ones was incredibly time-consuming.

There’s lots of tools that use runtime AI like Browseruse and Stagehand which we tried, but (1) they’re reliant on custom DOM parsing that's unreliable on older and complicated websites (including all of healthcare). Using a website’s internal network calls is faster and more reliable when possible. (2) They can be expensive since they rely on lots of AI calls and for workflows with complicated logic you can’t always rely on caching actions to make sure it will work. (3) They’re at runtime so it’s not interpretable what the agent is going to do. You kind of hope you prompted it correctly to do the right thing, but legacy workflows are often unintuitive and inconsistent across sites so you can’t trust an agent to just figure it out at runtime. (4) They don’t really help you generate new automations or help you debug automation failures.

We wanted a way to reliably generate and maintain browser automations in messy, high-stakes environments, without relying on fragile runtime agents.

Libretto is different because instead of runtime agents it uses “development-time AI”: scripts are generated ahead of time as actual code you can read and control, not opaque agent behavior at runtime. Instead of a black box, you own the code and can inspect, modify, version, and debug everything.

Rather than relying on runtime DOM parsing, Libretto takes a hybrid approach combining Playwright UI automation with direct network/API requests within the browser session for better reliability and bot detection evasion.

It records manual user actions to help agents generate and update scripts, supports step-through debugging, has an optional read-only mode to prevent agents from accidentally submitting or modifying data, and generates code that follows all the abstractions and conventions you have already in your coding repo.

Would love to hear how others are building and maintaining browser automations in practice, and any feedback on the approach we’ve taken here.

Does Gas Town 'steal' usage from users' LLM credits to improve itself?

The buns in McDonald's Japan's burger photos are all slightly askew

Cybersecurity looks like proof of work now

Ask HN: Who is using OpenClaw?

Google broke its promise to me – now ICE has my data

PiCore - Raspberry Pi Port of Tiny Core Linux

Cal.com is going closed source

Live Nation illegally monopolized ticketing market, jury finds

God sleeps in the minerals

Fix monitor that goes black, off or blinks due to static electricity in chair

Want to write a compiler? Just read these two papers (2008)

Golden eagles' return to English skies

Good sleep, good learning, good life (2012)

Do you even need a database?

Anna's Archive loses $322M Spotify piracy case without a fight

Adaptional (YC S25) is hiring AI engineers

How can I keep from singing?

Show HN: Libretto – Making AI browser automations deterministic

Show HN: GNU grep as a PHP extension

The Gemini app is now on Mac

Kalshi CEO expects US DOJ to prosecute insider trading cases

Costasiella kuroshimae

Forcing an inversion of control on the SaaS stack

Why are Flock employees watching our children?

Show HN: I rebuilt a 2000s browser strategy game on Cloudflare's edge

Wacli – WhatsApp CLI

How Wake-On-LAN works (2020)

Pretty Fish: A better mermaid diagram editor

One Interface, Every Protocol

Gemini Robotics-ER 1.6

Show HN: Jeeves – TUI for browsing and resuming AI agent sessions

Comments