frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ScrapeCopilot – Notebook Code Interface + Puppeteer + AI Copilot

3•erichi•1y ago
Hi HN, I’m Eric, and I’m building ScrapeCopilot, an AI assistant designed to eliminate friction in browser automation development.

Here is the link to VS Code extension - https://marketplace.visualstudio.com/items?itemName=scrapeco...

I've built browser automations for more than 5 years, and the constant frustration was always the sheer friction involved in getting working code – especially when debugging in headless mode or connecting to remote browsers.

When I started using LLMs to generate automation code, I found myself stuck in a repetitive loop: navigate to the desired page state, copy-paste HTML into the AI chat, and ask it to generate code. The worst part is that there was no easy way to run that generated code without losing the page state, forcing me to restart the browser session constantly. This wasted large amounts of time and mental energy. I built ScrapeCopilot to make this workflow seamless.

How it works:

ScrapeCopilot combines the power of a Jupyter-style notebook with a live Puppeteer browser session and integrated AI.

- Live Interactive Development: When you create an automation notebook, it initiates a fresh Puppeteer browser session. The page object is exposed directly to your notebook cells, allowing you to run any Puppeteer code against the live browser state and see the results instantly.

- AI-Powered Assistance: It integrates with GitHub Copilot (via the @scrapecopilot chat participant). The AI automatically sees the current page HTML, allowing it to generate highly relevant Puppeteer code based on your instructions directly within the chat.

- LLM Code Export: Once you've developed your automation logic, you can easily export the final, complete Puppeteer script based on your instructions.

This tool saves me hours daily, but even more importantly, it improves the developer experience in browser automation which is frustrating area.

I believe ScrapeCopilot can complement existing browser automation tools and frameworks by providing an interactive AI-assisted development experience.

Current Status & Future Plans:

- The extension currently works within VS Code. It will work in Cursor, but without chat support initially. I'm actively working on integrating a backend server to enable full chat functionality with Cursor.

- Currently the key workflow assumes that you create a new browser automation step by step, using code cells. But in my work I spend half of the time fixing existing automations, so my focus now is trying to adapt extension for debugging and fixing existing code.

- Playwright support is also on the list.

Check out short videos: - Demo: Headless False - https://scrapecopilot.ai/assets/demo-headless-false-Dhc_jeNR... - Demo: Headless True - https://scrapecopilot.ai/assets/demo-headless-true-PRQndDxP....

I'd love to hear your thoughts, feedback, and any suggestions!

Inventing Your Own Math as a Computer Programmer

https://leetarxiv.substack.com/p/inventing-your-own-math-as-a-computer-programmer
1•theanonymousone•3m ago•0 comments

Google: 'The era of autonomous attacks has arrived'

https://thehill.com/policy/technology/6224604-autonomous-ai-threats-google-report/
1•theanonymousone•4m ago•0 comments

Fastest Soft Robot Ever Built Doesn't Need Electronics to Function [video]

https://www.youtube.com/watch?v=uNPwgYMA0Js
1•gumby•7m ago•1 comments

Tech Outages Are Only the Beginning. A.I. Will Bring More Disruptions

https://www.nytimes.com/2026/11/21/us/politics/tech-outages-ai-disruptions.html
1•doener•7m ago•0 comments

Conditional Subexponential Attacks on Structured Learning with Errors [pdf]

https://nigelsmart.github.io/Sub-Exp-LWE/main.pdf
1•madars•8m ago•0 comments

The Universal Declaration on AI – The Promethean Covenant

https://tenarticles.org/
2•peterpaulis•10m ago•0 comments

Show HN: CVPebble – Free CV builder that runs in the browser, no account needed

https://cvpebble.com/
1•CVPebble•15m ago•1 comments

Revised Estimates for the Number of Human and Bacteria Cells in the Body

https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.1002533
1•gradus_ad•16m ago•0 comments

FBI's criminal information database hacked, CNN reports

https://www.cnbc.com/2026/11/21/fbis-criminal-information-database-hacked-cnn-reports.html
2•shinryudbz•21m ago•1 comments

iTerm2 vulnerability via Kitty Image Protocol

https://ii4gsp.github.io/iterm2-rce/
3•rvz•21m ago•0 comments

The Polarizing Practice of Eating Horses (2013)

https://www.theatlantic.com/health/archive/2013/02/the-polarizing-practice-of-eating-horses/273388/
2•Eridanus2•23m ago•0 comments

Compromise Test

2•kbdev•24m ago•0 comments

Send Files Anywhere – Encrypted P2P file relay with zero disk storage

https://maizor.org/en/send
3•mtananyan•30m ago•0 comments

Varieties of Discourseposting

https://www.astralcodexten.com/p/varieties-of-discourseposting
2•paulpauper•30m ago•0 comments

Gemini 4 Neon solves Bitcoin puzzle from 2024

https://echo.ls/zden-level-halv/
4•maplet•30m ago•0 comments

Notes on Differentiated Social Awareness

https://www.jenn.site/notes-on-differentiated-social-awareness/
2•paulpauper•30m ago•0 comments

We ARE sending them our best

https://hotfemoid.substack.com/p/we-are-sending-them-our-best
2•paulpauper•31m ago•0 comments

GnuPG Patch Gpgme Flaw CVE-2026-129975 Malicious OpenPGP Keys Can Trigger

https://kylesinvestigation.com/2026/11/21/gnupg-patches-critical-gpgme-flaw-cve-2026-129975-that-...
2•MadrasThorn•34m ago•0 comments

A PyPI cache for your Forgejo runners

https://stokeci.dev/blog/pypi-cache-for-forgejo-runners
2•Aelthorim•36m ago•0 comments

Alice v0.6.0

https://www.alicecaml.org/blog/alice-v0-6-0/
2•birdculture•37m ago•0 comments

Quantum resistance paradox of low-dimensional superfluids

https://www.nature.com/articles/s41586-026-11294-w
2•bookofjoe•39m ago•0 comments

AI's Favourite Myth: Taste Is the Last Human Advantage

https://www.youtube.com/watch?v=JK5QY7rIpR8
2•adhi01•40m ago•0 comments

A quantization compiler that delivers 12× lower KL than Q4_K_M at the same size

https://lookatmyquant.pages.dev/
2•Anon84•42m ago•0 comments

The Taxi Sessions: Live jazz performances driven by Singapore's taxis

https://sangsara.net/2026/11/21/the-taxi-sessions/
2•wmchen•43m ago•0 comments

Noticing the Machines That Stand Still

https://www.chrbutler.com/noticing-the-machines-that-stand-still
4•delaugust•45m ago•0 comments

Rex-on-Exe – Exe.dev Blog

https://blog.exe.dev/rex
2•tortilla•45m ago•0 comments

Data Minimization for AI Agents (Brett Frischmann and Bruce Schneier)

https://www.techpolicy.press/data-minimization-is-imperative-for-the-age-of-ai-agents/
2•datascientist•46m ago•0 comments

GTA VI is building behavioral profiles of those who play

https://twitter.com/make_claude/status/2123908856145232060
13•tabith•50m ago•5 comments

Launching a Free file converter APP

https://play.google.com/store/apps/details?id=com.konvert.fileconverter&hl=en_US
2•uzairhussainsm•51m ago•1 comments

The secret maths problems hidden throughout Japan

https://www.newscientist.com/article/2599802-the-secret-maths-problems-hidden-throughout-japan/
2•Breadmaker•51m ago•0 comments