frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ScrapeCopilot – Notebook Code Interface + Puppeteer + AI Copilot

3•erichi•1y ago
Hi HN, I’m Eric, and I’m building ScrapeCopilot, an AI assistant designed to eliminate friction in browser automation development.

Here is the link to VS Code extension - https://marketplace.visualstudio.com/items?itemName=scrapeco...

I've built browser automations for more than 5 years, and the constant frustration was always the sheer friction involved in getting working code – especially when debugging in headless mode or connecting to remote browsers.

When I started using LLMs to generate automation code, I found myself stuck in a repetitive loop: navigate to the desired page state, copy-paste HTML into the AI chat, and ask it to generate code. The worst part is that there was no easy way to run that generated code without losing the page state, forcing me to restart the browser session constantly. This wasted large amounts of time and mental energy. I built ScrapeCopilot to make this workflow seamless.

How it works:

ScrapeCopilot combines the power of a Jupyter-style notebook with a live Puppeteer browser session and integrated AI.

- Live Interactive Development: When you create an automation notebook, it initiates a fresh Puppeteer browser session. The page object is exposed directly to your notebook cells, allowing you to run any Puppeteer code against the live browser state and see the results instantly.

- AI-Powered Assistance: It integrates with GitHub Copilot (via the @scrapecopilot chat participant). The AI automatically sees the current page HTML, allowing it to generate highly relevant Puppeteer code based on your instructions directly within the chat.

- LLM Code Export: Once you've developed your automation logic, you can easily export the final, complete Puppeteer script based on your instructions.

This tool saves me hours daily, but even more importantly, it improves the developer experience in browser automation which is frustrating area.

I believe ScrapeCopilot can complement existing browser automation tools and frameworks by providing an interactive AI-assisted development experience.

Current Status & Future Plans:

- The extension currently works within VS Code. It will work in Cursor, but without chat support initially. I'm actively working on integrating a backend server to enable full chat functionality with Cursor.

- Currently the key workflow assumes that you create a new browser automation step by step, using code cells. But in my work I spend half of the time fixing existing automations, so my focus now is trying to adapt extension for debugging and fixing existing code.

- Playwright support is also on the list.

Check out short videos: - Demo: Headless False - https://scrapecopilot.ai/assets/demo-headless-false-Dhc_jeNR... - Demo: Headless True - https://scrapecopilot.ai/assets/demo-headless-true-PRQndDxP....

I'd love to hear your thoughts, feedback, and any suggestions!

Show HN: Skif – An ultra fast alternative to Knip, Sherif and Syncpack

https://github.com/polylint/skif
1•nhirschfeld•43s ago•0 comments

SpaceX Debt for AI Chips to Hit Market as Soon as This Week

https://www.bloomberg.com/news/articles/2026-11-17/spacex-debt-for-ai-chips-to-hit-market-as-soon...
1•petethomas•56s ago•0 comments

Show HN: Whiz.pub – An AI-native blogging platform, free and donation-supported

https://whiz.pub
1•xprilion•2m ago•0 comments

Apple faces French trial over alleged planned obsolescence of iPhones

https://us.afpnews.com/article/?apple-faces-french-trial-over-alleged-planned-obsolescence-of-iph...
2•sdeframond•2m ago•0 comments

Find Yourself in GTA VI

https://pew.studio
1•fatadel•3m ago•0 comments

Airbyte Is Down

https://status.airbyte.com
1•kaveet•4m ago•0 comments

Allow John Mulaney to explain the solution to all your eldercare needs

https://slate.com/culture/2026/11/snl-sister-skit-john-mulaney-elder-care-musical.html
1•mooreds•5m ago•0 comments

Unofficial Tangled CLI

https://tangled.org/aly.codes/tg
1•jcbhmr•5m ago•0 comments

Java Valhalla: Use of == on value types

https://humanoid-readable.claude-martin.ch/2026/11/17/value-types/
1•theanonymousone•6m ago•0 comments

Show HN: A self-hosted, open-source database IDE in the browser

https://github.com/libredb/libredb-studio
1•abdullahk0634•6m ago•0 comments

Automatic Checking of Compiler Correctness with E-Graphs

https://stng.substack.com/p/automatic-checking-of-compiler-correctness
1•g0xA52A2A•8m ago•0 comments

The Golden Age of Jazz Cartoon Soundtracks (Part 1)

https://www.honest-broker.com/p/the-golden-age-of-jazz-cartoon-soundtracks
2•paulpauper•8m ago•0 comments

Israel Is Attacking Wikipedia

https://techforpalestine.org/wikipedia-report-2026
25•pauldelany•9m ago•2 comments

Psychiatry's Syphilis Problem

https://freddiedeboer.substack.com/p/psychiatrys-syphilis-problem
1•paulpauper•9m ago•0 comments

Tyler Cowen: How Much Is a CEO Worth? Ask Nvidia

https://www.thefp.com/p/tyler-cowen-how-much-is-a-ceo-worth-jensen-huang-nvidia
1•paulpauper•10m ago•0 comments

Coworkers started a sign language class to communicate with deaf employee

https://coloradosun.com/2026/11/16/longmont-city-workers-sign-language-class-deaf-employee/
2•mooreds•11m ago•0 comments

EU targets subscription traps, addictive design and hidden fees with new rules

https://www.euronews.com/2026/11/11/eu-targets-subscription-traps-addictive-design-and-hidden-fee...
4•nonethewiser•12m ago•1 comments

What systemd.time(7) leaves out

https://www.allddd.onl/blog/what-systemd-time-leaves-out/
1•allddd•13m ago•0 comments

Alldokus – logic puzzles graded by the reasoning they need, not the clues

https://alldokus.com/en
2•bcledev•13m ago•0 comments

Upside can now make a million pounds of chicken and year (Lab grown meat)

https://techcrunch.com/2026/11/17/upside-foods-can-now-make-one-million-pounds-of-chicken-each-ye...
2•internet-390•14m ago•0 comments

How the Internet's Predecessor ARPANET Changed the World

https://www.nytimes.com/interactive/2026/11/16/magazine/arpanet-internet-computers-network.html
2•ChrisArchitect•14m ago•1 comments

GPT-6.2 Astra and Sol deliver most of the AA Cost per Task Pareto frontier

https://artificialanalysis.ai/articles/openai-has-the-2-model-in-the-intelligence-index-with-the-...
2•theanonymousone•15m ago•0 comments

Why learn web dev skills in 2026

https://minireference.com/blog/web-dev-in-2026/
2•speckx•16m ago•0 comments

Seven Years at Facebook

https://ilakli.com/posts/seven-years-at-facebook/
2•irakli_p•17m ago•1 comments

Web Browser Engineering

https://browser.engineering/
11•ibobev•19m ago•0 comments

Far from home, Voyager 1 will soon be a 'light-day' from Earth

https://www.npr.org/2026/11/15/nx-s1-6041716/a-long-long-ways-from-home-voyager-1-is-now-farther-...
3•blinding-streak•20m ago•1 comments

Ask HN: Anyone else blurting?

2•l33tbro•20m ago•0 comments

Deploying an Open Weights LLM as an API in Kubernetes

https://www.pablols.com/posts/057_deploy_open_weights_llm_api/
2•wanderdust•25m ago•0 comments

I hate GPT-6.2 Astra

https://x.com/i/article/2122760447103484410
4•privacyishuman•25m ago•1 comments

Ask HN: Are We in a Cyberwar?

7•bhartzer•25m ago•7 comments