frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ScrapeCopilot – Notebook Code Interface + Puppeteer + AI Copilot

3•erichi•1y ago
Hi HN, I’m Eric, and I’m building ScrapeCopilot, an AI assistant designed to eliminate friction in browser automation development.

Here is the link to VS Code extension - https://marketplace.visualstudio.com/items?itemName=scrapeco...

I've built browser automations for more than 5 years, and the constant frustration was always the sheer friction involved in getting working code – especially when debugging in headless mode or connecting to remote browsers.

When I started using LLMs to generate automation code, I found myself stuck in a repetitive loop: navigate to the desired page state, copy-paste HTML into the AI chat, and ask it to generate code. The worst part is that there was no easy way to run that generated code without losing the page state, forcing me to restart the browser session constantly. This wasted large amounts of time and mental energy. I built ScrapeCopilot to make this workflow seamless.

How it works:

ScrapeCopilot combines the power of a Jupyter-style notebook with a live Puppeteer browser session and integrated AI.

- Live Interactive Development: When you create an automation notebook, it initiates a fresh Puppeteer browser session. The page object is exposed directly to your notebook cells, allowing you to run any Puppeteer code against the live browser state and see the results instantly.

- AI-Powered Assistance: It integrates with GitHub Copilot (via the @scrapecopilot chat participant). The AI automatically sees the current page HTML, allowing it to generate highly relevant Puppeteer code based on your instructions directly within the chat.

- LLM Code Export: Once you've developed your automation logic, you can easily export the final, complete Puppeteer script based on your instructions.

This tool saves me hours daily, but even more importantly, it improves the developer experience in browser automation which is frustrating area.

I believe ScrapeCopilot can complement existing browser automation tools and frameworks by providing an interactive AI-assisted development experience.

Current Status & Future Plans:

- The extension currently works within VS Code. It will work in Cursor, but without chat support initially. I'm actively working on integrating a backend server to enable full chat functionality with Cursor.

- Currently the key workflow assumes that you create a new browser automation step by step, using code cells. But in my work I spend half of the time fixing existing automations, so my focus now is trying to adapt extension for debugging and fixing existing code.

- Playwright support is also on the list.

Check out short videos: - Demo: Headless False - https://scrapecopilot.ai/assets/demo-headless-false-Dhc_jeNR... - Demo: Headless True - https://scrapecopilot.ai/assets/demo-headless-true-PRQndDxP....

I'd love to hear your thoughts, feedback, and any suggestions!

A paste-y journey – finding a pastebin candidate to use

https://savyasacheejha.com/posts/a-paste-y-journey/
1•genghizkhan•36s ago•0 comments

Arduino App Lab

https://docs.arduino.cc/software/app-lab/
1•teleforce•2m ago•0 comments

Anti-Photoshop: A Mega-Combine Without a Technical Specification

https://medium.com/@smoking2man/anti-photoshop-a-mega-combine-without-a-technical-specification-f...
1•Aldus551•4m ago•0 comments

Harsher on Male? Evaluating LLMs on Gender-Asymmetric Moral Framing in Conflicts

https://arxiv.org/abs/2606.14068
1•rzk•5m ago•0 comments

Rejoining EU 'on the table' as UK makes deals on trade and young people

https://www.theguardian.com/politics/2026/nov/21/rejoining-eu-uk-trade-youth-deals-ed-miliband
1•vrganj•5m ago•0 comments

Sphere

https://en.wikipedia.org/wiki/Sphere_(venue)
2•tosh•9m ago•0 comments

ChatGPT shrunk down to run on a Super Nintendo

https://www.theregister.com/offbeat/2026/11/21/chatgpt-shrunk-down-to-run-on-a-super-nintendo/531...
1•nephihaha•11m ago•0 comments

Roast My UI

https://heltweg.org/posts/roast-my-ui/
1•rhazn•12m ago•0 comments

TI Embedded AI

https://www.ti.com/en-us/technologies/edge-ai
1•teleforce•14m ago•0 comments

Lean Should Be Ashamed

1•LTaoist•15m ago•0 comments

Show HN: Tartelette – an RP2040 emulator and breakout simulator

https://pferreir.github.io/tartelette/
1•_pferreir_•19m ago•0 comments

Kvrocks

https://www.percona.com/blog/inside-kvrocks/
4•bashhq_r•19m ago•0 comments

87% of the Anthropic power will come from gas and 11% from coal in 2028

https://betterdatacenterproject.com/2026/11/16/how-ai-is-powered-a-breakdown-of-byop-and-grid-power/
4•happosai•26m ago•1 comments

Is AI plagiarizing human research?

https://twitter.com/Robert_E_Grant_/status/2124338413662847228
2•doener•26m ago•0 comments

Scientists build whole-Earth simulation to help find life on other planets

https://www.washington.edu/news/2026/11/02/whole-earth-simulation-exoplanets-alien-life/
1•giuliomagnifico•26m ago•0 comments

Scientists sequenced a whale's entire genome using drones and whale snot

https://www.npr.org/2026/11/21/nx-s1-6044816/scientists-sequenced-a-whales-entire-genome-using-dr...
2•Brajeshwar•28m ago•0 comments

Derivative flipping: another way of thinking about automatic differentiation

http://blog.sigfpe.com/2026/11/derivative-flipping.html
2•matt_d•29m ago•0 comments

Your personal TV

https://github.com/joonfjp/yoltapp
1•joonfjp•30m ago•1 comments

The day the Riemann hypothesis fell to AI, I took my son for a walk

https://www.theintrinsicperspective.com/p/on-the-day-the-riemann-hypothesis
1•porsager•33m ago•0 comments

Intruder swaps DeepSeek at Prime Intellect. The copy almost never refuses

https://maccus.fr/en/prime-intellect-deepseek-swap/
1•theanonymousone•33m ago•0 comments

Bypassing iOS Safari's 60 FPS Limit

https://rida.dev/blog/bypassing-ios-safari-60-fps-limit
1•HatchedLake721•35m ago•0 comments

How to Be an Expert in a Changing World (2014)

https://paulgraham.com/ecw.html
1•sammatilda•39m ago•0 comments

Volta-Forever Brings CUDA 13 Support to Nvidia V100

https://www.gizmoweek.com/cuda-13-support-nvidia-v100/
1•loog5566•40m ago•0 comments

An app for M1 Macs that plays the sound of a fan as CPU usage goes up (2021)

https://fanfan.rambo.codes
2•sammatilda•40m ago•1 comments

Show HN: Built an Android app that lets you control your TV on local network

https://www.useroom.app
1•AkshayS96•41m ago•0 comments

Power harvesting from living solar panels

https://nph.onlinelibrary.wiley.com/doi/10.1002/ppp3.70295
1•fodmap•50m ago•0 comments

German unions are fighting to defend the 35-hour week

https://www.economist.com/business/2026/09/24/german-unions-are-fighting-to-defend-the-35-hour-week
3•teleforce•53m ago•0 comments

First Concrete Evidence for String Theory

https://www.math.columbia.edu/~woit/wordpress/?p=16009
1•untoxicness•54m ago•0 comments

Comcast: At peak, GTA 6 accounted for nearly a quarter of all internet traffic

https://www.pcgamer.com/games/grand-theft-auto/comcast-at-peak-gta6-accounted-for-nearly-a-quarte...
3•Brajeshwar•1h ago•0 comments

AI Riemann hypothesis proof is true, independent mathematicians confirm

https://www.scientificamerican.com/article/the-ai-riemann-hypothesis-proof-is-almost-certainly-tr...
1•cybermango•1h ago•0 comments