Ask HN: How would you use an AI-powered browser agent?

3•hamzamairaj•4mo ago

I’m exploring the idea of AI powered browser agents tools that can navigate the web like a human: clicking, typing, scraping, filling forms, or even completing multi step workflows. All you do is prompt the task.

If you had such an agent, what would you use it for?

- Automating repetitive tasks? - Gathering and cleaning data? - Handling customer or internal workflows? - Something else entirely?

I’d love to hear how the HN community imagines using this.

Comments

ttoinou•4mo ago

All of this and more. A lot of what I'm doing with the browser could be automated.

I don't understand why this isn't a solved problem already, I tried a few options but none could control the browser properly. For example, I asked Claude Code Chrome extension to look for bookings at specific dates, it would never be able to use the calendar UI widgets to select dates automatically.

hamzamairaj•4mo ago

Thanks for sharing your experience. I've built most parts of the agent already though I haven't tested it with any calendar apps yet. One option I'm working on is enabling vision so the agent can see the browser state via screenshots and interact with visual elements like date pickers.

It also has an orchestrator that can split a larger task into multiple sub agents running in parallel. Browser profiles are supported too. I'm using OpenAI models (gpt-4.1-mini works really well so far) and the project is written in node js.

I plan to open source it once it's more polished but right now I'm especially curious about how people from different backgrounds would want to use such a tool.

ttoinou•4mo ago

Couldn't it rather know the HTML source and JS state ? Like if it was plugged into Chrome DevTools. It might be more straightforward and better inputs for AI to interact with

hamzamairaj•4mo ago

That's already there, by default the agent can see the HTML elements in the current viewport and interact with them properly. It works quite well for most cases but in some special scenarios (Like your calendar app example) we still need vision as a fallback.

Reverse Engineering Medium.com's Editor: How Copy, Paste, and Images Work

Go 1.22, SQLite, and Next.js: The "Boring" Back End

Laibach the Whistleblowers [video]

I replaced the front page with AI slop and honestly it's an improvement

Economists vs. Technologists on AI

Life at the Edge

RISC-V Vector Primer

Show HN: Invoxo – Invoicing with automatic EU VAT for cross-border services

A Tale of Two Standards, POSIX and Win32 (2005)

Ask HN: Is the Downfall of SaaS Started?

Flirt: The Native Backend

OpenAI's Latest Platform Targets Enterprise Customers

Goldman Sachs taps Anthropic's Claude to automate accounting, compliance roles

Ai.com bought by Crypto.com founder for $70M in biggest-ever website name deal

Big Tech's AI Push Is Costing More Than the Moon Landing

The AI boom is causing shortages everywhere else

Suno, AI Music, and the Bad Future [video]

Ask HN: How are researchers using AlphaFold in 2026?

Running the "Reflections on Trusting Trust" Compiler

Watermark API – $0.01/image, 10x cheaper than Cloudinary

Now send your marketing campaigns directly from ChatGPT

Queueing Theory v2: DORA metrics, queue-of-queues, chi-alpha-beta-sigma notation

Show HN: Hibana – choreography-first protocol safety for Rust

Haniri: A live autonomous world where AI agents survive or collapse

GPT-5.3-Codex System Card [pdf]

Atlas: Manage your database schema as code

Geist Pixel

Show HN: MCP to get latest dependency package and tool versions

The better you get at something, the harder it becomes to do

Show HN: WP Float – Archive WordPress blogs to free static hosting