frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ScrapeCopilot – Notebook Code Interface + Puppeteer + AI Copilot

3•erichi•1y ago
Hi HN, I’m Eric, and I’m building ScrapeCopilot, an AI assistant designed to eliminate friction in browser automation development.

Here is the link to VS Code extension - https://marketplace.visualstudio.com/items?itemName=scrapeco...

I've built browser automations for more than 5 years, and the constant frustration was always the sheer friction involved in getting working code – especially when debugging in headless mode or connecting to remote browsers.

When I started using LLMs to generate automation code, I found myself stuck in a repetitive loop: navigate to the desired page state, copy-paste HTML into the AI chat, and ask it to generate code. The worst part is that there was no easy way to run that generated code without losing the page state, forcing me to restart the browser session constantly. This wasted large amounts of time and mental energy. I built ScrapeCopilot to make this workflow seamless.

How it works:

ScrapeCopilot combines the power of a Jupyter-style notebook with a live Puppeteer browser session and integrated AI.

- Live Interactive Development: When you create an automation notebook, it initiates a fresh Puppeteer browser session. The page object is exposed directly to your notebook cells, allowing you to run any Puppeteer code against the live browser state and see the results instantly.

- AI-Powered Assistance: It integrates with GitHub Copilot (via the @scrapecopilot chat participant). The AI automatically sees the current page HTML, allowing it to generate highly relevant Puppeteer code based on your instructions directly within the chat.

- LLM Code Export: Once you've developed your automation logic, you can easily export the final, complete Puppeteer script based on your instructions.

This tool saves me hours daily, but even more importantly, it improves the developer experience in browser automation which is frustrating area.

I believe ScrapeCopilot can complement existing browser automation tools and frameworks by providing an interactive AI-assisted development experience.

Current Status & Future Plans:

- The extension currently works within VS Code. It will work in Cursor, but without chat support initially. I'm actively working on integrating a backend server to enable full chat functionality with Cursor.

- Currently the key workflow assumes that you create a new browser automation step by step, using code cells. But in my work I spend half of the time fixing existing automations, so my focus now is trying to adapt extension for debugging and fixing existing code.

- Playwright support is also on the list.

Check out short videos: - Demo: Headless False - https://scrapecopilot.ai/assets/demo-headless-false-Dhc_jeNR... - Demo: Headless True - https://scrapecopilot.ai/assets/demo-headless-true-PRQndDxP....

I'd love to hear your thoughts, feedback, and any suggestions!

Is AI a bicycle for the mind, or a car?

https://twitter.com/kouhxp/status/2123096768996892959
1•mrkn1•55s ago•0 comments

Show HN: TypingCompiler – Practice typing with real code snippets

https://www.typingcompiler.com/test?title=Rust%3A%20Custom%20Fibonacci%20Iterator
1•girouetten21•1m ago•0 comments

Show HN: Mastra Factory, the open-source software factory we use to build Mastra

1•codekarate•1m ago•0 comments

Building collaborative editing in EmDash CMS

https://emdashcms.com/blog/how-we-built-collaborative-editing
1•noah_pham•1m ago•0 comments

Shwcs – A reviewed catalog of B2B software, agencies and services

https://shwcs.site/en
1•andrevallee•2m ago•0 comments

Pikuma: Fundamentals of Computer Science and Mathematics

https://pikuma.com/
1•gurjeet•2m ago•0 comments

William Shatner "Sings" 'Rocket Man' (1978) [video]

https://www.youtube.com/watch?v=8wI4jMxveyI
1•Anon84•3m ago•0 comments

Julia 1.13 brings REPL improvements and more

https://lwn.net/Articles/1108153/
1•leephillips•4m ago•0 comments

Tuios

https://tuios.dev
1•vnzvrt•4m ago•0 comments

PyBot message board – the largest open dataset of swarm dynamics

https://huggingface.co/spaces/HuggingFaceSwarms/pybot-msgboard
1•lewtun•5m ago•0 comments

Cyber Attacks/ Network Outages have become a norm now

https://www.csis.org/programs/strategic-technologies-program/significant-cyber-incidents
1•mastaanshaik•6m ago•2 comments

Historical sociology of neural network research (1991)

https://era.ed.ac.uk/items/db7c1acb-a8a5-4b14-8874-f1138e6751b8
1•theanonymousone•6m ago•0 comments

Evening Atlas

https://willjobs.com/evening-atlas/
2•NickDouglas•7m ago•0 comments

The Cognitive Case for Play in Technical Work

https://www.joekarlsson.com/blog/cognitive-case-for-play-in-technical-work/
1•joekarlsson•7m ago•0 comments

Everything After Code, as Code

https://www.pulumi.com/blog/everything-after-code-as-code/
1•cnunciato•8m ago•0 comments

Wayfinder: Frontier-Level Code Search at a Fraction of the Cost

https://blog.voyageai.com/2026/11/18/wayfinder-code-search/
2•emschwartz•9m ago•0 comments

Principles of good design (Dieter Rams)

https://designmanifestos.org/dieter-rams-ten-principles-for-good-design/
3•mrkn1•12m ago•2 comments

M.C. Escher's Art Creates Mathematical Worlds

https://www.quantamagazine.org/how-m-c-eschers-art-creates-bizarre-mathematical-worlds-20261118/
3•baruchel•13m ago•0 comments

"Anthropic Is Not a Safe AI Company" – Coalition Challenges Anthropic Safety

https://www.businesswire.com/news/home/20261118974464/en/Anthropic-is-Not-a-Safe-AI-Company---Bro...
3•sshah03•13m ago•1 comments

Show HN: Can an AI Agent Bypass Your Website Security?

https://assess.poh.org/
3•timshell•14m ago•0 comments

Cerebras Systems Inc. (CBRS): Hot Garbage [pdf]

https://culperresearch.com/wp-content/uploads/2026/10/Culper_CBRS_10-28-2026.pdf
2•Betelbuddy•15m ago•0 comments

Jensen Huang Tweets

https://daringfireball.net/linked/2026/11/18/huang-tweets
2•chmaynard•15m ago•0 comments

We're Giving AI Agents the Keys to Our Computers. That's a Security Nightmare

https://soargram.io/content/273880860
2•levicanskij•17m ago•0 comments

Microsoft rejected Rockstar's pitch to put GTA3 on the original Xbox (2021)

https://www.eurogamer.net/microsoft-recalls-time-it-rejected-rockstars-pitch-to-put-gta3-on-the-o...
2•TMWNN•18m ago•1 comments

Dealing with LLMs in IETF Discussions

https://datatracker.ietf.org/doc/draft-fengfar-led/
2•mooreds•19m ago•0 comments

Contexting vs. Context

https://cutlefish.substack.com/p/tbm-452-contexting-vs-context
1•mooreds•19m ago•0 comments

High school disables AI detector after it kept mistaking everyday items for guns

https://www.techspot.com/news/114607-pennsylvania-high-school-disables-ai-weapons-detector-after....
1•healsdata•20m ago•0 comments

Why a "stable" labor market feels so bad [video]

https://www.youtube.com/watch?v=rY9s0tMzfM8
1•mooreds•20m ago•0 comments

SetShot macOS app – snapshot and diff macOS settings changes

https://github.com/adamengst/setshot-app
2•amichail•20m ago•0 comments

ElevenLabs Down

https://status.elevenlabs.io/united-states
2•cheapcheerful•22m ago•0 comments