frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: Reverse-engineering web apps into agent tools

16•pancomplex•2h ago
Hey HN! We built a browser-based agent that runs inside an authenticated web app, watches how the app calls its own APIs, and automatically turns those into agent tools. You can think of it as an auto-generated MCP server that self-updates as the host app changes.

The result is a skilled AI assistant that actually integrates deeply with any product (not just chat and RAG) with minimal effort.

Check out these short demos below that show the agent in software you're probably familiar with:

- Jira: https://demo.frigade.com/hn?skill=jira

- Spotify: https://demo.frigade.com/hn?skill=spotify

- Hacker News (lol): https://demo.frigade.com/hn?skill=hackernews

- Full Demo: https://demo.frigade.com/hn?skill=full-demo

As you can see in the examples, you can do way more (and faster) than what you normally would be able to via point and click. And we never even touched the source code of these products!

Why do this?

In an ideal world, every application has an MCP server or an easily-digestible API available for AI agents to feed from. In practice, we found that even very modern software tends to have a spider web of confusing APIs and services that AI agents simply cannot use out of the box. Security also becomes a huge issue as applications have different (often homebrewed) standards for how endpoints are secured (JWTs/cookies/mix of both). Finally, having an actual browser agent go in and use the application on behalf of the user (i.e. computer-use), is simply too brittle, slow, and burns a lot of tokens.

We took our existing browser agent that’s already trained to use and learn authenticated applications, and added an extra step that automatically turns the app’s authenticated APIs into "recipes". A recipe is a mix of the following:

- API endpoint + method

- Authentication method (and how to retrieve refresh auth tokens/cookies)

- Response schema

- Input schema (for POST/PUT)

- Human readable description of what the tool does

Putting it all together, these become reusable tools for LLMs, all without writing or maintaining any code. Even if the APIs change our agent figures this out and replaces the recipe for the tool with the updated version.

Adding tools to an AI agent becomes super simple this way:

- Our agent trains on the app and builds the recipes

- The app owner enables discovered tools from our dashboard

- The agent can now take actions on the user’s behalf directly inside the application. For instance, saying something like "invite my teammate to my workspace" would securely call the existing API endpoint for inviting users without proxying or relaying through a third party.

Of course, there's a ton of edge cases you run into when you try to do this - every application is intrinsically different despite how many "standards" exist. Fun fact: graphql was by far the worst API to work with in standardizing the recipes.

Looking forward to your feedback/comments!

Comments

reaganhsu•1h ago
so cool!
pancomplex•43m ago
thank you!
robszumski•13m ago
Really cool. It would be interesting to see a demo of an app that is clearly more bespoke, like your Tesla account, online banking, movie theatre ticketing, etc.

Show HN: 18 Words

https://18words.com/
574•pompomsheep•5h ago•225 comments

Show HN: Analog Watch

https://analog.watch
54•ezekg•3h ago•53 comments

Show HN: I mapped 8.5M research papers into an interactive atlas

https://tomesphere.com/atlas
12•leonickson•15h ago•0 comments

Show HN: Devthropology – Better Insights for GitHub Repos

https://devthropology.com/demo
14•dpc94•1h ago•6 comments

Show HN: Reverse-engineering web apps into agent tools

16•pancomplex•2h ago•3 comments

Show HN: FableCut – A browser video editor AI agents can drive (zero deps)

https://github.com/ronak-create/FableCut
77•ronak_parmar•4h ago•47 comments

Show HN: LastShelf – an emergency map of your family's documents bills& contacts

https://www.lastshelf.ai/
29•sbrown12•2h ago•20 comments

Show HN: Embersent – Document Tracking and Analytics

https://embersent.com/
2•21oq•1h ago•0 comments

Show HN: GodUI – Open-source React components with a shared motion system

https://godui.design
2•lucasbassetti•1h ago•1 comments

Show HN: FormGrid – Forms that can look like CLIs, pixel art, GeoCities and more

https://www.formgrid.com/
5•bjoernm•2h ago•2 comments

Show HN: Obsidian Aside

https://community.obsidian.md/plugins/aside
2•wl1973•2h ago•0 comments

Show HN: Subagentmaxxing – Orchestrate GPT and Cursor Models with Claude Code

https://github.com/Kuberwastaken/subagentmaxxing
2•kuberwastaken•2h ago•0 comments

Show HN: Rubber Duck

https://rubberduck.greg.technology/
6•gregsadetsky•3h ago•2 comments

Show HN: A zero-dependency auditor for decision records in AI-touched systems

https://github.com/forgedculture/legibility-field-kit
4•forgesignals•4h ago•0 comments

Show HN: Papercrane-CLI – a BI tool built for Claude Code

https://papercrane.ai/blog/today-im-launching-papercrane-cli-a-bi-tool-built-for-claude-code
6•timliu9•2h ago•0 comments

Show HN: Strata – guess the city from its real 3D terrain and bathymetry

https://flightq.app/strata
5•skyq•2h ago•0 comments

Show HN: ADarkTerminal

https://adarkterminal.electricsheep.games
4•rrotaru•2h ago•0 comments

Show HN: Blocks.ai – control plane and network layer for agents

https://blocks.ai
2•BlocksAI•2h ago•1 comments

Show HN: I wrote a Libc-free AOT systems language in JavaScript with no VM

https://github.com/DO-SAY-GO/freelang
3•keepamovin•2h ago•1 comments

Show HN: Sticky notes that disappear from screen sharing

https://www.noticky.app/en
2•leotryhard•2h ago•0 comments

Show HN: CashFlow

https://cashflow-phi-amber.vercel.app/
3•SanishKumar•2h ago•2 comments

Show HN: 0-A.D. A free, open-source game of ancient warfare

https://play0ad.com/
2•smalltorch•3h ago•0 comments

Show HN: Android Developer Verification Package blacklisted in Aurora Store

4•bewilderbeast•5h ago•0 comments

Show HN: Microsoft releases Flint, a visualization language for AI agents

https://microsoft.github.io/flint-chart/#/
336•chenglong-hn•1d ago•133 comments

Show HN: Snowscroll – remove reels, shorts, short-form

https://snowscroll.com/
3•junnam586•3h ago•1 comments

Show HN: Latex Diff Viewer

https://github.com/marketplace/actions/latex-diff-viewer
2•alpaylan•3h ago•0 comments

Show HN: LinguaGuessr – GeoGuessr for the Ear

https://lingua.levelbrook.com
2•entaroadun123•3h ago•0 comments

Show HN: Estimania – Estimation Game

https://estimania.app/
2•vlaad•3h ago•0 comments

Show HN: Follow London Trains in 3D

https://ride.nexttrain.london/
148•mgranados•5d ago•59 comments

Show HN: TensorRT-LLM running natively on Windows (no WSL)

https://baremetalrt.ai/app?mode=1gpu
2•brianhabana123•3h ago•0 comments