frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ScrapeCopilot – Notebook Code Interface + Puppeteer + AI Copilot

3•erichi•1y ago
Hi HN, I’m Eric, and I’m building ScrapeCopilot, an AI assistant designed to eliminate friction in browser automation development.

Here is the link to VS Code extension - https://marketplace.visualstudio.com/items?itemName=scrapeco...

I've built browser automations for more than 5 years, and the constant frustration was always the sheer friction involved in getting working code – especially when debugging in headless mode or connecting to remote browsers.

When I started using LLMs to generate automation code, I found myself stuck in a repetitive loop: navigate to the desired page state, copy-paste HTML into the AI chat, and ask it to generate code. The worst part is that there was no easy way to run that generated code without losing the page state, forcing me to restart the browser session constantly. This wasted large amounts of time and mental energy. I built ScrapeCopilot to make this workflow seamless.

How it works:

ScrapeCopilot combines the power of a Jupyter-style notebook with a live Puppeteer browser session and integrated AI.

- Live Interactive Development: When you create an automation notebook, it initiates a fresh Puppeteer browser session. The page object is exposed directly to your notebook cells, allowing you to run any Puppeteer code against the live browser state and see the results instantly.

- AI-Powered Assistance: It integrates with GitHub Copilot (via the @scrapecopilot chat participant). The AI automatically sees the current page HTML, allowing it to generate highly relevant Puppeteer code based on your instructions directly within the chat.

- LLM Code Export: Once you've developed your automation logic, you can easily export the final, complete Puppeteer script based on your instructions.

This tool saves me hours daily, but even more importantly, it improves the developer experience in browser automation which is frustrating area.

I believe ScrapeCopilot can complement existing browser automation tools and frameworks by providing an interactive AI-assisted development experience.

Current Status & Future Plans:

- The extension currently works within VS Code. It will work in Cursor, but without chat support initially. I'm actively working on integrating a backend server to enable full chat functionality with Cursor.

- Currently the key workflow assumes that you create a new browser automation step by step, using code cells. But in my work I spend half of the time fixing existing automations, so my focus now is trying to adapt extension for debugging and fixing existing code.

- Playwright support is also on the list.

Check out short videos: - Demo: Headless False - https://scrapecopilot.ai/assets/demo-headless-false-Dhc_jeNR... - Demo: Headless True - https://scrapecopilot.ai/assets/demo-headless-true-PRQndDxP....

I'd love to hear your thoughts, feedback, and any suggestions!

How to package your ideas using the Winston star

http://muratbuffalo.blogspot.com/2016/06/how-to-package-your-ideas-using-winston.html
1•Bluestein•44s ago•0 comments

Parents Are Up in Arms over School Photos That Look Like Mug Shots

https://www.wsj.com/lifestyle/parents-school-pictures-kids-don-t-smile-67b68f20
1•bookofjoe•3m ago•1 comments

Allianz Warns AI Insurance Losses Are "Tip of the Iceberg"

https://epyhia.com/allianz-warns-ai-insurance-losses-are-tip-of-the-iceberg-as-incidents
1•arbuge•4m ago•0 comments

Show HN: Crisis Rehearsal – Offline T-72h crisis simulation, 30-event backtest

https://github.com/yepinggu66/crisis-rehearsal
1•pingguye•4m ago•0 comments

The Simulation We Are Living In

https://ploum.net/2026-11-19-capitalist_roleplay.html
1•latexr•5m ago•0 comments

Jensen Huang's 'Lying' Alarmed Nvidia Board Ahead of His Resignation

https://www.wired.com/story/jensen-huangs-lying-alarmed-nvidia-board-ahead-of-his-resignation/
1•flowerlad•7m ago•1 comments

Show HN: Nuvo – an open-source music player that turns lyrics into a live video

https://github.com/Ziuziuk-Denys/Nuvo
1•Eveluxy•7m ago•0 comments

Post mortem effects of SaaS provider incident on your setup

https://www.probablybrokeit.com/import/github?id=2zfqmghmg3s3
1•chetanketh•9m ago•0 comments

Medicine Wheel

https://en.wikipedia.org/wiki/Medicine_wheel
1•tosh•12m ago•0 comments

Show HN: Ember, a journal that keeps a page for each person you write about

https://ember.mov/
2•nandhak0318•13m ago•1 comments

Recompiling Game Boy Games for the Sega Master System

https://www.dmcmillan.co.uk/blog/recompiling-game-boy-games-for-the-sega-master-system
1•frostbyte7•14m ago•0 comments

cgo's pointer check is all over the place

https://theconsensus.dev/p/2026/11/15/cgos-pointer-check.html?focus=1
1•eatonphil•15m ago•0 comments

A BLAS and LAPACK written in Julia. No Fortran, no C, no assembly

https://github.com/el-oso/PureBLAS.jl
1•leephillips•17m ago•0 comments

CodeLearn Pro is a free programming learning app designed for beginners

https://play.google.com/store/apps/details?id=com.abinet.codelearnpro&hl=en_US
1•abihacker•18m ago•0 comments

Anthropic's IPO bank closed position meant to stabilize stock

https://www.reuters.com/markets/us/anthropics-ipo-bank-closed-position-meant-stabilize-stock-remo...
4•anon373839•22m ago•0 comments

Show HN: Why HTTP 200 is lying to your AI agents (and what Postgres did)

https://github.com/deedglass/deedglass
1•ajuxarjun•30m ago•0 comments

Blop, your team's shared memory

https://www.npmjs.com/package/@blopai/cli
1•Laurlund449•39m ago•0 comments

GL.iNet Security Notice

https://www.gl-inet.com/en-us/blogs/blog/glinet-security-notice-2026-11-20
4•TechTechTech•41m ago•0 comments

GL.iNet Security Notice 2026-11-20

https://www.gl-inet.com/en-gb/blogs/blog/glinet-security-notice-2026-11-20
3•seasicksteve•44m ago•0 comments

The Blame Game Has Begun over Anthropic's Turbulent Trading Debut

https://www.wsj.com/finance/stocks/the-blame-game-has-begun-over-anthropics-turbulent-trading-deb...
4•doener•46m ago•0 comments

Earthship in Germany's cold climate [video]

https://www.youtube.com/watch?v=N2VNJM9wyDQ
1•tosh•47m ago•0 comments

Microsoft to Do Is Retiring

https://support.microsoft.com/en-au/planner/to-do-to-planner
1•soheilpro•48m ago•3 comments

Adult-only households accounted for 55% of toy sales in the first half of 2026

https://www.bloomberg.com/news/articles/2026-11-18/jellycats-squishmallows-and-lego-sets-for-adul...
13•helsinkiandrew•50m ago•6 comments

Explore Alpöge's Riemann proof source

https://riemann.world
1•lheck•50m ago•0 comments

Move Fast and Fix Things (2015)

https://githubengineering.com/move-fast/
1•sammatilda•52m ago•0 comments

Show HN: An interactive architecture diagram of your codebase and infra

https://github.com/mrzdevcore/intent-graph
1•mmarotsaha•52m ago•0 comments

Anyone can easily use private, open weight models

https://micahflee.com/heres-how-anyone-can-easily-use-private-open-weight-models/
3•DeepLogin•54m ago•0 comments

Show HN: TodoMVC (CSS-Only)

https://codepen.io/editor/alowpoly/pen/01a1eee3-02d4-72fe-bffd-516510b29c32
1•rofko•55m ago•0 comments

'Legally, they don't exist': the hybrid crabs puzzling biologists and fishers

https://www.theguardian.com/environment/2026/nov/21/alaska-bering-sea-heatwave-snow-tanner-hybrid...
4•n1b0m•56m ago•0 comments

The Dark Reality of "Vibe Coded" Clone Apps [video]

https://www.youtube.com/watch?v=Bo-vESS4jt0
1•amelius•58m ago•0 comments