frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ScrapeCopilot – Notebook Code Interface + Puppeteer + AI Copilot

3•erichi•1y ago
Hi HN, I’m Eric, and I’m building ScrapeCopilot, an AI assistant designed to eliminate friction in browser automation development.

Here is the link to VS Code extension - https://marketplace.visualstudio.com/items?itemName=scrapeco...

I've built browser automations for more than 5 years, and the constant frustration was always the sheer friction involved in getting working code – especially when debugging in headless mode or connecting to remote browsers.

When I started using LLMs to generate automation code, I found myself stuck in a repetitive loop: navigate to the desired page state, copy-paste HTML into the AI chat, and ask it to generate code. The worst part is that there was no easy way to run that generated code without losing the page state, forcing me to restart the browser session constantly. This wasted large amounts of time and mental energy. I built ScrapeCopilot to make this workflow seamless.

How it works:

ScrapeCopilot combines the power of a Jupyter-style notebook with a live Puppeteer browser session and integrated AI.

- Live Interactive Development: When you create an automation notebook, it initiates a fresh Puppeteer browser session. The page object is exposed directly to your notebook cells, allowing you to run any Puppeteer code against the live browser state and see the results instantly.

- AI-Powered Assistance: It integrates with GitHub Copilot (via the @scrapecopilot chat participant). The AI automatically sees the current page HTML, allowing it to generate highly relevant Puppeteer code based on your instructions directly within the chat.

- LLM Code Export: Once you've developed your automation logic, you can easily export the final, complete Puppeteer script based on your instructions.

This tool saves me hours daily, but even more importantly, it improves the developer experience in browser automation which is frustrating area.

I believe ScrapeCopilot can complement existing browser automation tools and frameworks by providing an interactive AI-assisted development experience.

Current Status & Future Plans:

- The extension currently works within VS Code. It will work in Cursor, but without chat support initially. I'm actively working on integrating a backend server to enable full chat functionality with Cursor.

- Currently the key workflow assumes that you create a new browser automation step by step, using code cells. But in my work I spend half of the time fixing existing automations, so my focus now is trying to adapt extension for debugging and fixing existing code.

- Playwright support is also on the list.

Check out short videos: - Demo: Headless False - https://scrapecopilot.ai/assets/demo-headless-false-Dhc_jeNR... - Demo: Headless True - https://scrapecopilot.ai/assets/demo-headless-true-PRQndDxP....

I'd love to hear your thoughts, feedback, and any suggestions!

Pocket and Profit – Manual net worth, and budget dashboard without bank linking

https://pocketandprofit.com/
1•joycetwenty20•26s ago•0 comments

Lead the AI Shift in Your Organization

https://age-of-product.com/ai4agile-online-course-v4/
1•swolpers•1m ago•0 comments

The Internet Broke Our Taste. Will A.I. Destroy It for Good?

https://www.nytimes.com/2026/11/20/magazine/ai-slop-taste-aesthetic-silicon-valley.html
1•thm•2m ago•0 comments

Owl OS – a free Debian-based security OS you can live-boot from USB

https://owlsec.org
1•owlsecx•2m ago•0 comments

Bypassing ADB: 0.32ms Android UI trees and A* routing for AI agents (Rust/Kotlin

https://github.com/V0val0x/DroidPath/blob/main/docs/benchmarks.md
1•Ak4shik•5m ago•0 comments

Backblaze customers worried of personal data sale/sharing after policy update

https://www.neowin.net/news/backblaze-customers-worried-of-personal-data-salesharing-after-policy...
2•cube00•8m ago•1 comments

How do you check that an AI agent finished a task?

https://medium.com/@csdn/two-days-at-the-top-soduwork-hits-no-1-1f32a3f89d85
2•Aki_ii•9m ago•0 comments

ZeroOps: A Hands-On Preview of the Most Exciting New Databricks Feature

https://medium.com/databrickscommunity/genie-zeroops-a-hands-on-preview-b8fc46138087
1•protmaks•9m ago•0 comments

Databricks World Tour Amsterdam 2026 photo report

https://medium.com/databrickscommunity/databricks-world-tour-amsterdam-2026-photo-report-43ef435a...
1•protmaks•10m ago•0 comments

Show HN: CurlGo – a 5 MB native API client for macOS and Windows

https://curlgo.echovic.com/en/
1•echovic•10m ago•0 comments

Port Scanning for Mojang

https://sipacid.com/blog/port-scanning-for-mojang/
1•phit_•10m ago•0 comments

App Store Connect Is Losing Localizations: How to Protect and Restore Them

https://aso.dev/blog/app-store-connect-localizations-recovery/
1•gorniv•13m ago•0 comments

So Much Tech News: The Week of 11/15/2026

https://somuchtechnews.substack.com/p/so-much-tech-news-the-week-of-11152026
1•amichae2•15m ago•0 comments

Why not run n8n itself inside a Docker Sandbox?

https://www.ajeetraina.com/why-not-run-n8n-itself-inside-a-docker-sandbox/
1•speckx•17m ago•0 comments

Local AI agents investigate an unknown machine attached to a serial port

https://github.com/podstawek/explorer-of-serial
1•bluepeter•18m ago•0 comments

Birthday Problem

https://en.wikipedia.org/wiki/Birthday_problem
1•doener•19m ago•0 comments

Show HN: Autostrum – Play along with guitar tabs at your own tempo

https://www.autostrum.com
1•michael_ongaro•23m ago•0 comments

"Race realism" isn't realistic–and it isn't good science

https://theconversation.com/race-realism-why-scientifically-flawed-approach-fails-to-present-a-re...
3•andrewl•23m ago•2 comments

CI bills are going wild, I tried some ways to fix it

https://useland.dev/notes
2•wild-king•23m ago•1 comments

State of the tech job market: late 2026

https://www.lennysnewsletter.com/p/state-of-the-tech-job-market-late
1•mgh2•24m ago•0 comments

Show HN: Relaticle, an open-source CRM that Claude and ChatGPT can work in

https://github.com/relaticle/relaticle
2•manukminasyan•24m ago•1 comments

Tips for writing ADRs by Martin Fowler (2026)

https://martinfowler.com/bliki/ArchitectureDecisionRecord.html
1•ghassenfaidi•26m ago•0 comments

Wingetix – Fast, open-source GUI for Microsoft WinGet with deep uninstaller

https://github.com/joselyky/Wingetix
1•joselyky•28m ago•0 comments

How to Formally Verify Everything

https://fi-le.net/verification/
1•fi-le•28m ago•0 comments

BenchmarkBench

https://benchmarkbench.pages.dev
1•ohlookcake•29m ago•0 comments

Show HN: SocketSweep – WizTree-style fast Android storage analyzer over ADB

https://github.com/VishnuSrivatsava/SocketSweep
1•mathcuber•30m ago•0 comments

AI as a Lifestyle Choice

https://grahamdumpleton.me/posts/2026/11/ai-as-a-lifestyle-choice/
1•skeledrew•30m ago•0 comments

Show HN: Elephant Walk – Local KVM for macOS, Windows, Linux (Wayland), Android

https://ew.4ier.icu/en/
1•4ier•30m ago•0 comments

Ask HN: Do you agree with Jeremie Harris's prepper guidance?

1•seahorseemoji•31m ago•3 comments

Power Is Not Telepathy

https://exogenous.bearblog.dev/power-is-not-telepathy/
1•nukular•32m ago•0 comments