frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ScrapeCopilot – Notebook Code Interface + Puppeteer + AI Copilot

3•erichi•1y ago
Hi HN, I’m Eric, and I’m building ScrapeCopilot, an AI assistant designed to eliminate friction in browser automation development.

Here is the link to VS Code extension - https://marketplace.visualstudio.com/items?itemName=scrapeco...

I've built browser automations for more than 5 years, and the constant frustration was always the sheer friction involved in getting working code – especially when debugging in headless mode or connecting to remote browsers.

When I started using LLMs to generate automation code, I found myself stuck in a repetitive loop: navigate to the desired page state, copy-paste HTML into the AI chat, and ask it to generate code. The worst part is that there was no easy way to run that generated code without losing the page state, forcing me to restart the browser session constantly. This wasted large amounts of time and mental energy. I built ScrapeCopilot to make this workflow seamless.

How it works:

ScrapeCopilot combines the power of a Jupyter-style notebook with a live Puppeteer browser session and integrated AI.

- Live Interactive Development: When you create an automation notebook, it initiates a fresh Puppeteer browser session. The page object is exposed directly to your notebook cells, allowing you to run any Puppeteer code against the live browser state and see the results instantly.

- AI-Powered Assistance: It integrates with GitHub Copilot (via the @scrapecopilot chat participant). The AI automatically sees the current page HTML, allowing it to generate highly relevant Puppeteer code based on your instructions directly within the chat.

- LLM Code Export: Once you've developed your automation logic, you can easily export the final, complete Puppeteer script based on your instructions.

This tool saves me hours daily, but even more importantly, it improves the developer experience in browser automation which is frustrating area.

I believe ScrapeCopilot can complement existing browser automation tools and frameworks by providing an interactive AI-assisted development experience.

Current Status & Future Plans:

- The extension currently works within VS Code. It will work in Cursor, but without chat support initially. I'm actively working on integrating a backend server to enable full chat functionality with Cursor.

- Currently the key workflow assumes that you create a new browser automation step by step, using code cells. But in my work I spend half of the time fixing existing automations, so my focus now is trying to adapt extension for debugging and fixing existing code.

- Playwright support is also on the list.

Check out short videos: - Demo: Headless False - https://scrapecopilot.ai/assets/demo-headless-false-Dhc_jeNR... - Demo: Headless True - https://scrapecopilot.ai/assets/demo-headless-true-PRQndDxP....

I'd love to hear your thoughts, feedback, and any suggestions!

Merck and Isomorphic Labs Enter Strategic Research Collaboration

https://www.merck.com/news/merck-and-isomorphic-labs-enter-strategic-research-collaboration/
1•hentrep•54s ago•0 comments

Anatomy of an AI-driven attack: Bitrise security incident report

https://bitrise.io/artex-incident-report
1•jampa•1m ago•0 comments

Show HN: Orbital – Everything (known) in Earth orbit, live in 3D, in the browser

https://jerredcook.github.io/orbital/
1•gifford89•1m ago•0 comments

Ratio Tracking, Intuitively

https://lisyarus.github.io/blog/posts/ratio-tracking-intuitively.html
1•ibobev•2m ago•0 comments

A list of 1000 smart home deals for Amazon black Friday

https://smarthomescene.com/blog/best-amazon-black-friday-and-cyber-monday-smart-home-deals/
1•kiselio•2m ago•0 comments

High Stakes Are Strongly Typed

https://www.motivenotes.ai/p/high-stakes-are-strongly-typed
1•supo•3m ago•0 comments

Why New Outlook Can't Drag Files to Other Apps

https://magicdragin.app/blog/why-new-outlook-drag-and-drop-fails
1•jeremy_spiegel•3m ago•1 comments

Ask AI the same question twice and 64% of answers name different brands

https://supercite.ai/blog/why-ai-recommends-different-brands
1•avatar99•3m ago•0 comments

To Catch a Ransomware Scammer, FBI Posed as Both Victim and Attacker

https://www.404media.co/ransomware-fraud-attack-fbi-indictment/
2•cdrnsf•3m ago•0 comments

Show HN: Unsworn – Polyglot API Router

https://github.com/j4crev/unsworn
1•j4w8n•4m ago•0 comments

New law 'maybe needed' after Google rejects call to remove Brand's YouTube video

https://www.theguardian.com/news/2026/nov/19/google-youtube-russell-brand-youtube-prison-message-...
1•Jigsy•5m ago•1 comments

RDMA over USB4 on Windows: run larger local AI models across PCs

https://techcommunity.microsoft.com/blog/microsoftusbblog/introducing-rdma-over-usb4%c2%ae-on-win...
1•akshayt•5m ago•0 comments

Apps such as Adobe/Battle.net won't run if your PC fails MS's new security check

https://www.windowslatest.com/2026/11/18/apps-could-soon-refuse-to-run-on-your-windows-11-pc-if-i...
1•josephcsible•6m ago•0 comments

Ignore the Code: Oberon (2009)

https://ignorethecode.net/blog/2009/04/22/oberon/
1•ibn_khaldun•6m ago•0 comments

Chile: UFO Sightings by 18th Century Jesuits

https://inexplicata.blogspot.com/2026/08/chile-ufo-sightings-by-18th-century.html
2•bookofjoe•6m ago•0 comments

Biogen's anti-tau Alzheimer's drug slows decline 38% by year 2

https://www.reuters.com/business/healthcare-pharmaceuticals/biogens-anti-tau-alzheimers-drug-bene...
1•Vaslo•6m ago•0 comments

Show HN: Count Macula menu bar app that counts highlighted words and characters

https://countmacula.app/?via=hackernews
1•sajomes•7m ago•0 comments

Balcony solar: two panels, some zip ties, and an outlet

https://gregable.com/2026/11/balcony-solar.html
1•gregable•9m ago•0 comments

Live stock ticker theme for Claude Code desktop

https://github.com/cktang88/claude-ticker-theme
1•kt01•9m ago•0 comments

A linked history of the AI stack

https://foundationindex.ustunozgur.com/
1•arbayi•10m ago•0 comments

How does medical inflation compare to inflation in the rest of the economy?

https://www.healthsystemtracker.org/brief/how-does-medical-inflation-compare-to-inflation-in-the-...
1•elffjs•10m ago•0 comments

Lustro – a tree of deterministic random streams (Rust, Python, C)

https://github.com/Ligatum/Lustro
1•atomU235•12m ago•0 comments

Show HN: Modern HN – a userscript that restyles Hacker News

https://github.com/FallDownTheSystem/modern-hn
1•FallDownTS•13m ago•0 comments

Show HN: Forbear is a immediate mode GUI library that looks like the web

https://github.com/gabrielmfern/forbear
1•Gabrielmfern•13m ago•0 comments

On Drawing Icons

https://pierre.computer/writing/on-drawing-icons
2•bpierre•14m ago•0 comments

Quickly, There's No Time

https://thezvi.substack.com/p/quickly-theres-no-time
1•gmays•14m ago•0 comments

Detecting Empty Abstractions and Pruning Dead Paths in the Linux eBPF Verifier

https://arxiv.org/abs/2611.23584
1•titusblair•17m ago•0 comments

If tiny "primordial" black holes exist

https://news.mit.edu/2026/if-tiny-primordial-black-holes-exist-heres-how-we-might-find-them-1119
1•titusblair•17m ago•0 comments

EU Council has completely gutted the EU Inc proposal

https://www.eu-inc.org/position-paper
1•matesz•18m ago•0 comments

Agents don't need a new UI language. They need to reuse their knowledge

https://geastack.com/blog-typescript-is-enough
1•arbayi•19m ago•0 comments