frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ScrapeCopilot – Notebook Code Interface + Puppeteer + AI Copilot

3•erichi•1y ago
Hi HN, I’m Eric, and I’m building ScrapeCopilot, an AI assistant designed to eliminate friction in browser automation development.

Here is the link to VS Code extension - https://marketplace.visualstudio.com/items?itemName=scrapeco...

I've built browser automations for more than 5 years, and the constant frustration was always the sheer friction involved in getting working code – especially when debugging in headless mode or connecting to remote browsers.

When I started using LLMs to generate automation code, I found myself stuck in a repetitive loop: navigate to the desired page state, copy-paste HTML into the AI chat, and ask it to generate code. The worst part is that there was no easy way to run that generated code without losing the page state, forcing me to restart the browser session constantly. This wasted large amounts of time and mental energy. I built ScrapeCopilot to make this workflow seamless.

How it works:

ScrapeCopilot combines the power of a Jupyter-style notebook with a live Puppeteer browser session and integrated AI.

- Live Interactive Development: When you create an automation notebook, it initiates a fresh Puppeteer browser session. The page object is exposed directly to your notebook cells, allowing you to run any Puppeteer code against the live browser state and see the results instantly.

- AI-Powered Assistance: It integrates with GitHub Copilot (via the @scrapecopilot chat participant). The AI automatically sees the current page HTML, allowing it to generate highly relevant Puppeteer code based on your instructions directly within the chat.

- LLM Code Export: Once you've developed your automation logic, you can easily export the final, complete Puppeteer script based on your instructions.

This tool saves me hours daily, but even more importantly, it improves the developer experience in browser automation which is frustrating area.

I believe ScrapeCopilot can complement existing browser automation tools and frameworks by providing an interactive AI-assisted development experience.

Current Status & Future Plans:

- The extension currently works within VS Code. It will work in Cursor, but without chat support initially. I'm actively working on integrating a backend server to enable full chat functionality with Cursor.

- Currently the key workflow assumes that you create a new browser automation step by step, using code cells. But in my work I spend half of the time fixing existing automations, so my focus now is trying to adapt extension for debugging and fixing existing code.

- Playwright support is also on the list.

Check out short videos: - Demo: Headless False - https://scrapecopilot.ai/assets/demo-headless-false-Dhc_jeNR... - Demo: Headless True - https://scrapecopilot.ai/assets/demo-headless-true-PRQndDxP....

I'd love to hear your thoughts, feedback, and any suggestions!

SMAL

1•commoner_•31s ago•0 comments

NoEnigma – 15 Years of Independent Science and Technology Writing

https://www.noenigma.com/
1•jchacim•1m ago•0 comments

Longshore: A 36 GB/S Zero-Allocation I/O and Object Storage Layer in Rust

https://serviceradar.cloud/blog/ring-per-core-io-in-longshore
1•marvin-hansen•7m ago•0 comments

What Shaped Anthropic CEO Dario Amodei's Thinking on AI

https://www.nytimes.com/2026/11/05/technology/dario-amodei-anthropic-ai.html
1•andsoitis•9m ago•0 comments

Is it still worth building Coding Harness?

1•deepcover•9m ago•0 comments

Austria launches public consultation for its national AI agenda

https://www.kipppunkt.gv.at/
2•GranularRecipe•10m ago•0 comments

Who are Anthropic's seven co-founders, now worth $180B?

https://www.theguardian.com/technology/2026/nov/19/who-are-anthropic-founders
1•andsoitis•10m ago•0 comments

Implementing a tag-based restoration system for the Scalar docs sites

https://medium.com/scalar-engineering/implementing-a-tag-based-restoration-system-for-the-scalar-...
1•josh-scalar•11m ago•0 comments

Shift + 1234567890

https://koenvangilst.nl/lab/shift-1234567890
1•vnglst•11m ago•0 comments

Hostile Inference: Exploiting Docker Model Runner for Container Escapes

https://www.thezdi.com/blog/2026/11/17/hostile-inference-exploiting-docker-model-runner-for-conta...
1•ersinesen•13m ago•0 comments

Drone Hacking Part 2: Authorized ~_~ by Potensic ~_

https://neodyme.io/en/blog/drone_hacking_part_2/
2•ersinesen•14m ago•0 comments

Show HN: Xinproof – Restore-test your database backups, get a signed receipt

https://github.com/praxin/xinproof
1•krishsg•14m ago•0 comments

NASA's new Moon plans have a problem: Orion wasn't designed to fly this way

https://arstechnica.com/space/2026/11/to-make-moon-landings-easier-nasa-is-making-life-harder-for...
1•rbanffy•21m ago•0 comments

Show HN: Synapse Shield (v0.11) – Self-hosted behavioral alternative to CAPTCHAs

https://github.com/0xStoic-bit/Synapse_Shield
1•0xStoic_bit•24m ago•0 comments

Microsoft's outage should terrify every enterprise – InfoWorld

https://www.infoworld.com/article/4249394/microsofts-outage-should-terrify-every-enterprise.html
2•rbanffy•25m ago•0 comments

Almost all of Anthropic's employees are now millionaires

https://www.cnn.com/2026/11/19/tech/anthropic-employees-now-millionaires
3•andsoitis•29m ago•4 comments

Database Consistency Models

https://jepsen.io/consistency/models
1•gurjeet•31m ago•0 comments

V2: Quantum information spreading via higher-order operator correlators

https://arxiv.org/abs/2609.05472
2•northlondoner•38m ago•2 comments

The U.S. Army is about to blow up a cache of dangerous lead azide in Iowa–here's

https://www.scientificamerican.com/article/the-u-s-army-is-about-to-blow-up-a-cache-of-dangerous-...
2•bookmtn•38m ago•4 comments

AlphaXiv opens a public preprint server for AI-authored research papers

https://www.alphaxiv.org/
1•pirafrank•40m ago•0 comments

"I can tell you wrote this yourself"

https://em-online.bearblog.dev/i-can-tell-you-wrote-this-yourself/
5•BrunoBernardino•42m ago•2 comments

Testing an AM/FM radio PCB designed by Claude [video]

https://www.youtube.com/watch?v=vyClHoyzAL8
1•ez_mmk•44m ago•2 comments

Show HN: Linear Algebra in a Week

https://linear-algebra-in-a-week.vercel.app/#m1
1•tamnd•46m ago•0 comments

US Approved AI Chip Sales to China's Tencent, Alibaba, Data Show

https://www.bloomberg.com/news/articles/2026-11-19/us-approved-ai-chip-sales-to-china-s-tencent-a...
4•Teever•47m ago•0 comments

Hardcoded Ignorance

https://notes.erlend.sh/3n2ojo3n5yc2m
1•erlend_sh•49m ago•0 comments

Show HN: Bulchimbeon, night watch that keeps your Mac awake while AI agents work

https://github.com/s3onghyun/bulchimbeon
1•s3onghyun•53m ago•0 comments

How Many Books Will You Read Before You Die?

https://lithub.com/how-many-books-will-you-read-before-you-die/
1•austinallegro•58m ago•1 comments

Show HN: Vemlora – Edit text in images while preserving the original design

https://vemlora.io
1•abelce•1h ago•0 comments

Nudeps: Bundler-like imports, none of the baggage

https://lea.verou.me/blog/2026/nudeps/
1•codedrift_•1h ago•0 comments

Is Building in Public Dead?

https://pudlog.substack.com/p/is-building-in-public-dead
5•sarreph•1h ago•1 comments