frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ScrapeCopilot – Notebook Code Interface + Puppeteer + AI Copilot

3•erichi•1y ago
Hi HN, I’m Eric, and I’m building ScrapeCopilot, an AI assistant designed to eliminate friction in browser automation development.

Here is the link to VS Code extension - https://marketplace.visualstudio.com/items?itemName=scrapeco...

I've built browser automations for more than 5 years, and the constant frustration was always the sheer friction involved in getting working code – especially when debugging in headless mode or connecting to remote browsers.

When I started using LLMs to generate automation code, I found myself stuck in a repetitive loop: navigate to the desired page state, copy-paste HTML into the AI chat, and ask it to generate code. The worst part is that there was no easy way to run that generated code without losing the page state, forcing me to restart the browser session constantly. This wasted large amounts of time and mental energy. I built ScrapeCopilot to make this workflow seamless.

How it works:

ScrapeCopilot combines the power of a Jupyter-style notebook with a live Puppeteer browser session and integrated AI.

- Live Interactive Development: When you create an automation notebook, it initiates a fresh Puppeteer browser session. The page object is exposed directly to your notebook cells, allowing you to run any Puppeteer code against the live browser state and see the results instantly.

- AI-Powered Assistance: It integrates with GitHub Copilot (via the @scrapecopilot chat participant). The AI automatically sees the current page HTML, allowing it to generate highly relevant Puppeteer code based on your instructions directly within the chat.

- LLM Code Export: Once you've developed your automation logic, you can easily export the final, complete Puppeteer script based on your instructions.

This tool saves me hours daily, but even more importantly, it improves the developer experience in browser automation which is frustrating area.

I believe ScrapeCopilot can complement existing browser automation tools and frameworks by providing an interactive AI-assisted development experience.

Current Status & Future Plans:

- The extension currently works within VS Code. It will work in Cursor, but without chat support initially. I'm actively working on integrating a backend server to enable full chat functionality with Cursor.

- Currently the key workflow assumes that you create a new browser automation step by step, using code cells. But in my work I spend half of the time fixing existing automations, so my focus now is trying to adapt extension for debugging and fixing existing code.

- Playwright support is also on the list.

Check out short videos: - Demo: Headless False - https://scrapecopilot.ai/assets/demo-headless-false-Dhc_jeNR... - Demo: Headless True - https://scrapecopilot.ai/assets/demo-headless-true-PRQndDxP....

I'd love to hear your thoughts, feedback, and any suggestions!

Stackboard – a Chrome new tab that's just your bookmarks, in columns

https://chromewebstore.google.com/detail/stackboard-new-tab-bookma/bgcedhchngcopaefchpkbhioagknnpma
1•intensityflow•38s ago•0 comments

Running untrusted CMS plugins in WebAssembly

https://hatamoto.dev/post/running-untrusted-cms-plugins-in-webassembly
1•sammatilda•2m ago•0 comments

Six hours and a stack of .md files

https://security.is.fucked.blog/six-hours-and-a-stack-of-md-files
1•micr0byte•2m ago•0 comments

LinkedIn Pinpoint Answer Today

https://wordanswer.today
1•dolaiart2026a•3m ago•0 comments

Why Every Startup Needs an Origin Myth

https://www.joanwestenberg.com/p/why-every-startup-needs-an-origin
1•flail•4m ago•0 comments

We found 1,698 Internet-visible AI offensive-security endpoints

https://gcore.com/blog/ai-offensive-security-endpoints-artex-pentagi-cairn
2•XaviorE•10m ago•0 comments

Mitchell Hashimoto's TUI – public beta waitlist

https://www.superlogical.com/updates/public-testing-beginning
1•michael-sumner•11m ago•1 comments

David Sacks Is Fucked Too

https://daringfireball.net/linked/2026/11/13/sacks
3•JumpCrisscross•17m ago•0 comments

It's always DNS, so why are we running our own?

https://s2.dev/blog/dns-server
1•misker1•17m ago•1 comments

Show HN: Unlimited-OCR-2 on Dual-Panel Lab Tables: What Works, What Breaks, How

https://zlu.me/2026/11/16/unlimited-ocr-2-dual-panel-lab-tables.html
1•zlu•17m ago•0 comments

Overpass API Performance Issues

https://community.openstreetmap.org/t/overpass-api-performance-issues/140598?page=10
2•altilunium•18m ago•0 comments

Show HN: VennDB: append-only in-memory Rust DB for rows queried using bit flags

https://github.com/plabayo/venndb
1•gdcbe•19m ago•0 comments

The Invisible Shape

https://sorenblank.com/craft/the-invisible-shape
1•matthberg•21m ago•0 comments

How to clean up the worktrees Claude Code, Cursor and Codex leave behind

https://mopup.online/guides/coding-agent-worktrees
1•sumaniosdv•22m ago•0 comments

The Invisible Anniversary

https://askthepilot.com/the-invisible-anniversary/
1•motionlessveloc•32m ago•0 comments

The Dogma of the Typical Case: Why Intelligent Systems Replace a Specific Task

https://medium.com/@smoking2man/the-dogma-of-the-typical-case-why-intelligent-systems-replace-a-s...
1•Aldus551•32m ago•0 comments

G7 Economic Optimism Plunges to Great Recession Levels

https://news.gallup.com/poll/716606/economic-optimism-plunges-great-recession-levels.aspx
2•giuliomagnifico•34m ago•0 comments

A Complexity Scientist's View of Antarctica

https://thefriendlyghost.nl/antarctica-through-complexity
1•cvanelteren•36m ago•0 comments

Show HN: A geometry puzzle from an Erdős problem, with every optimum proven

https://dhiraj-niural.github.io/few-distance-lab/
1•hanczvs•36m ago•0 comments

How to Make Something That Makes Almost Anything

https://fab.cba.mit.edu/classes/865.24/index.html
1•throwaway019254•41m ago•0 comments

How to keep servers from exiting load balancer pool

https://software.mihvoi.org/2026/11/how-to-keep-servers-from-exiting-load-balancer-pool-software-...
1•mihvoi•46m ago•1 comments

My Route to Hosting Videos for Websites, Apps and Subscription Services

https://tomj.pro/all-it-takes-hosting-videos-for-websites-apps-and-subscription-services/
1•TomJpro•48m ago•0 comments

Bandai Namco Just Landed a Critical Hit on Earnings

https://www.tradingview.com/chart/7832/dAU6ObRo-Bandai-Namco-The-IP-Empire-Is-Leveling-Up/
1•moonypto•48m ago•0 comments

Ask HN: Startups are spamming helpdesk chats now?

2•keiferski•48m ago•0 comments

HN Lists

https://news.ycombinator.com/lists
3•freakynit•49m ago•2 comments

ColoTycoon – build your own web hosting empire

https://colotycoon.com
1•hyperionultra•51m ago•1 comments

Elon Musk joins 165,000 others call for Nvidia to bring back Jensen Huang

https://www.theguardian.com/technology/2026/nov/16/elon-musk-tech-execs-open-letter-jensen-huang-...
5•beardyw•1h ago•2 comments

25 years of Xbox: How Microsoft's debut console defied the doubters

https://ravi64.com/25-years-of-xbox/
2•merlioncity•1h ago•0 comments

Show HN: A Postgres read-replica, but 10-50x faster for analytical queries

https://github.com/embeddable-hq/mason-data
3•tagspace•1h ago•0 comments

Show HN: Real-time collaborative KiCad

https://junctioneda.com
1•NotARoomba•1h ago•0 comments