frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ScrapeCopilot – Notebook Code Interface + Puppeteer + AI Copilot

3•erichi•1y ago
Hi HN, I’m Eric, and I’m building ScrapeCopilot, an AI assistant designed to eliminate friction in browser automation development.

Here is the link to VS Code extension - https://marketplace.visualstudio.com/items?itemName=scrapeco...

I've built browser automations for more than 5 years, and the constant frustration was always the sheer friction involved in getting working code – especially when debugging in headless mode or connecting to remote browsers.

When I started using LLMs to generate automation code, I found myself stuck in a repetitive loop: navigate to the desired page state, copy-paste HTML into the AI chat, and ask it to generate code. The worst part is that there was no easy way to run that generated code without losing the page state, forcing me to restart the browser session constantly. This wasted large amounts of time and mental energy. I built ScrapeCopilot to make this workflow seamless.

How it works:

ScrapeCopilot combines the power of a Jupyter-style notebook with a live Puppeteer browser session and integrated AI.

- Live Interactive Development: When you create an automation notebook, it initiates a fresh Puppeteer browser session. The page object is exposed directly to your notebook cells, allowing you to run any Puppeteer code against the live browser state and see the results instantly.

- AI-Powered Assistance: It integrates with GitHub Copilot (via the @scrapecopilot chat participant). The AI automatically sees the current page HTML, allowing it to generate highly relevant Puppeteer code based on your instructions directly within the chat.

- LLM Code Export: Once you've developed your automation logic, you can easily export the final, complete Puppeteer script based on your instructions.

This tool saves me hours daily, but even more importantly, it improves the developer experience in browser automation which is frustrating area.

I believe ScrapeCopilot can complement existing browser automation tools and frameworks by providing an interactive AI-assisted development experience.

Current Status & Future Plans:

- The extension currently works within VS Code. It will work in Cursor, but without chat support initially. I'm actively working on integrating a backend server to enable full chat functionality with Cursor.

- Currently the key workflow assumes that you create a new browser automation step by step, using code cells. But in my work I spend half of the time fixing existing automations, so my focus now is trying to adapt extension for debugging and fixing existing code.

- Playwright support is also on the list.

Check out short videos: - Demo: Headless False - https://scrapecopilot.ai/assets/demo-headless-false-Dhc_jeNR... - Demo: Headless True - https://scrapecopilot.ai/assets/demo-headless-true-PRQndDxP....

I'd love to hear your thoughts, feedback, and any suggestions!

Dealing with AI Depression and Meaninglessness [video]

https://www.youtube.com/watch?v=oycBOHeu760
1•marvinborner•1m ago•0 comments

California sues OpenAI over hacking risks

https://www.npr.org/2026/11/16/nx-s1-6042920/california-sues-openai-hugging-face-hacking-incident
1•pseudolus•1m ago•0 comments

Green Threads for Node.js

http://www.jasnell.me/posts/green-threads-in-node
1•mariuz•7m ago•0 comments

An 8-bit CPU designed from scratch using mostly 74xx ICs in Logisim Evolution

https://github.com/hoetzenofer/Limbo-8
1•hoetzenofer•8m ago•0 comments

Regulatory Capture by Anthropic Through METR

https://nitter.cf/kevinnbass/status/2099621874279817638
3•agnosticmantis•11m ago•0 comments

Show HN: Aquasand – A pixel-art aquarium everyone shares, with 346 real species

https://aquasand.ru/en
1•valdiszhvaginsh•12m ago•0 comments

Stop using encrypted email (2020)

https://www.latacora.com/blog/2020/02/19/stop-using-encrypted-email/
1•stared•12m ago•0 comments

Inverlair Lodge

http://secretscotland.org.uk/index.php/Secrets/InverlairLodge
1•bryanrasmussen•13m ago•0 comments

Police Raid on Nvidia Partner Megaspeed Finds Empty Frames and Missing GPUs

https://respawnfirst.com/they-never-even-unpacked-the-racks-police-raid-on-nvidia-partner-megaspe...
2•windexh8er•13m ago•0 comments

I'm a human doctor with human intelligence. But I sure do like my AI notetaker

https://www.npr.org/2026/11/17/nx-s1-6037556/medicine-ai-doctor-notetaker-scribe
1•colinprince•14m ago•0 comments

Making Art with QR Codes, and the Fine Line Between Inspiration and Idea Theft

https://www.gorillasun.de/blog/making-art-with-qr-codes-and-the-fine-line-between-inspiration-and...
1•gorillasun•14m ago•0 comments

Show HN: AI Data Brokerage

https://mainstreetwealth.ai/ai-data-brokerage
5•novateg•14m ago•0 comments

Make your LLM accept only signed prompts

https://discounttimu.substack.com/p/make-your-llm-only-accept-signed
2•guardiangod•14m ago•1 comments

Live ranking CVEs based on vibes, not CVSS

https://cves.io/
1•patrikgrobs•15m ago•0 comments

Show HN: CofreAdmin Wallet – Self-Custodial Web3 Personal Finance

https://github.com/cofreadminwallet/app
1•erissonmarques•15m ago•0 comments

Can Solar Murals Make Clean Energy More Attractive?

https://triplepundit.com/2026/solar-murals-artwork-renewable-energy-aesthetics/
1•rdmuser•15m ago•0 comments

Laptop/Phone can hear you without a mic. Proof

https://twitter.com/whyvanamali/status/2122276417031585879
1•mrkn1•17m ago•0 comments

We Logged 183,291 MCP and A2A Requests. Only 2.2% Were Task-Shaped

https://wagerx.io/news/agentic-web-observatory-november-17-2026
1•wagerx•17m ago•0 comments

Framefields v3

https://framefields.dev/v3/
2•oknaslnkn•17m ago•0 comments

California sues OpenAI over safety concerns after rogue agent hacking

https://www.theguardian.com/technology/2026/nov/16/california-openai-rogue-agent-hacking-lawsuit
2•richardbarosky•19m ago•0 comments

Modern LLMs hate Python the most

https://blog.jetbrains.com/ai/2026/11/ai-models-hate-python-and-love-php-we-asked-12-of-them-1-20...
1•neuraldenis•21m ago•0 comments

Amazon Eyes 20k Pairs of Smart Glasses for Delivery Drivers by 2027

https://wwd.com/sourcing-journal/logistics/amazon-smart-glasses-delivery-riders-privacy-1239404883/
1•bookofjoe•22m ago•1 comments

WigglyPaint – Free Animated Drawing Tool

https://wigglypaint.com
1•RomellHenry•23m ago•0 comments

Beyond Ballmer Peak: LLM and ethanol assisted coding [pdf]

https://github.com/meawoppl/katz-peak/blob/main/katz_peak.pdf
1•alexmolas•25m ago•0 comments

The polar vortex just set a new record

https://www.bbc.com/weather/articles/cwdd8dl7830go
1•amelius•27m ago•0 comments

Did an AI or a human write that paper? New detector decides by examining ideas

https://www.science.org/content/article/did-ai-or-human-write-paper-new-detector-decides-examinin...
1•pluc•28m ago•0 comments

Show HN: OpenMarkdown Editor – edits Markdown source, not a document tree

https://github.com/OpenMarkdown-dev/OpenMarkdown-editor
2•XUEYANZ•28m ago•0 comments

WSO2 is now Choreo Labs

https://choreolabs.com/
3•sathindu•29m ago•1 comments

Show HN: Pipbreak – find what a Python dependency update breaks before merging

https://github.com/youssef-elaasri/pipbreak
1•fisher_sun•29m ago•0 comments

How Do You Evaluate Candidates When Hiring for a Small Startup?

https://lobox.com/articles/98
1•LoboxPlatform•30m ago•0 comments