frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ScrapeCopilot – Notebook Code Interface + Puppeteer + AI Copilot

3•erichi•1y ago
Hi HN, I’m Eric, and I’m building ScrapeCopilot, an AI assistant designed to eliminate friction in browser automation development.

Here is the link to VS Code extension - https://marketplace.visualstudio.com/items?itemName=scrapeco...

I've built browser automations for more than 5 years, and the constant frustration was always the sheer friction involved in getting working code – especially when debugging in headless mode or connecting to remote browsers.

When I started using LLMs to generate automation code, I found myself stuck in a repetitive loop: navigate to the desired page state, copy-paste HTML into the AI chat, and ask it to generate code. The worst part is that there was no easy way to run that generated code without losing the page state, forcing me to restart the browser session constantly. This wasted large amounts of time and mental energy. I built ScrapeCopilot to make this workflow seamless.

How it works:

ScrapeCopilot combines the power of a Jupyter-style notebook with a live Puppeteer browser session and integrated AI.

- Live Interactive Development: When you create an automation notebook, it initiates a fresh Puppeteer browser session. The page object is exposed directly to your notebook cells, allowing you to run any Puppeteer code against the live browser state and see the results instantly.

- AI-Powered Assistance: It integrates with GitHub Copilot (via the @scrapecopilot chat participant). The AI automatically sees the current page HTML, allowing it to generate highly relevant Puppeteer code based on your instructions directly within the chat.

- LLM Code Export: Once you've developed your automation logic, you can easily export the final, complete Puppeteer script based on your instructions.

This tool saves me hours daily, but even more importantly, it improves the developer experience in browser automation which is frustrating area.

I believe ScrapeCopilot can complement existing browser automation tools and frameworks by providing an interactive AI-assisted development experience.

Current Status & Future Plans:

- The extension currently works within VS Code. It will work in Cursor, but without chat support initially. I'm actively working on integrating a backend server to enable full chat functionality with Cursor.

- Currently the key workflow assumes that you create a new browser automation step by step, using code cells. But in my work I spend half of the time fixing existing automations, so my focus now is trying to adapt extension for debugging and fixing existing code.

- Playwright support is also on the list.

Check out short videos: - Demo: Headless False - https://scrapecopilot.ai/assets/demo-headless-false-Dhc_jeNR... - Demo: Headless True - https://scrapecopilot.ai/assets/demo-headless-true-PRQndDxP....

I'd love to hear your thoughts, feedback, and any suggestions!

Wait for pull request events with GitHub CLI

https://github.blog/changelog/2026-11-18-wait-for-pull-request-events-with-github-cli/
1•axis_official•4m ago•0 comments

Show HN: Git Hook for Model Identifation

https://github.com/orsenthil/git-hook-model-identification
1•orsenthil•4m ago•0 comments

Will Wright's next simulation will use AI to mine content from your memories

https://arstechnica.com/gaming/2026/11/will-wrights-next-simulation-will-use-ai-to-mine-content-f...
2•vok•5m ago•0 comments

Project Gryffindor: Meta's plan to get more school kids using Instagram

https://www.npr.org/2026/11/18/nx-s1-6037808/meta-instagram-schools-teens-safety
3•gfaddy•6m ago•0 comments

Scaling Durable Execution Workflows with CitusDB and NATS

https://www.bytefish.de/blog/sqlflow_distributed.html
1•bytefish•7m ago•1 comments

Ukraine blew up Putin's bridge using relay drones to bypass Starlink limits

https://arstechnica.com/gadgets/2026/11/ukraine-blew-up-putins-bridge-using-relay-drones-to-bypas...
4•hackthemack•11m ago•0 comments

Show HN: Snowchive – Snowden archive of all published documents

https://snowchive.org
4•libroot•11m ago•0 comments

Readycode.ai – Multi AI Platform

https://readycode.ai/
1•readycodeai•12m ago•0 comments

Another critical PHP flaw to be revealed tomorrow

https://www.aikido.dev/blog/php-security-release-19-november-2026-cve-2026-115560
2•EGreg•12m ago•0 comments

Ruby2ßhell: Pre-authentication RCE on stock Rails

https://verialabs.com/ruby2shell/
5•jdns•13m ago•0 comments

45-Year-Old Commodore Program Recovered from a Paper Printout

https://handheldhideout.neocities.org/articles/a-45-year-old-commodore-program-recovered-from-pap...
1•hackthemack•19m ago•0 comments

Internal tools are more useful half finished

https://12gramsofcarbon.com/p/agentics-mushy-software
2•theahura•20m ago•0 comments

Alfred 6

https://www.alfredapp.com
1•microflash•24m ago•1 comments

Research Acceleration: The Jagged Frontier

https://openai.com/index/research-acceleration-jagged-frontier/
1•saguntum•25m ago•0 comments

Traffic Mix Matters

https://brooker.co.za/blog/2026/11/18/workload-mix.html
1•ot•25m ago•0 comments

Confidential Cloud Public Beta

https://confidential.ai/blog/confidential-cloud-beta
2•ameanasad•26m ago•0 comments

Anthropic raises record $81B in IPO at $1.5T valuation

https://www.reuters.com/legal/transactional/anthropic-prices-blockbuster-ipo-83-share-source-says...
1•JumpCrisscross•27m ago•0 comments

Anthropic IPO raises record $81.3B on strong AI demand

https://www.npr.org/2026/11/18/nx-s1-6046212/anthropic-record-ipo-price
2•madihaa•30m ago•0 comments

Intel signs first external customer for advanced 18A chips

https://www.cnbc.com/2026/11/18/intel-first-18a-foundry-customer.html
2•snikolaev•34m ago•0 comments

CobaltC vs. Rust (compiled with overflow checks)

https://github.com/strawberry9/CobaltC/tree/main/bench
1•SilentLambda•36m ago•0 comments

Show HN: Satelital – How I made a custom game engine for my indie game

https://spectralorbit.com/blog/satelital_game_engine
1•ellipticaldoor•36m ago•0 comments

Steve Yegge on AI Agents and the Future of Software Engineering

https://newsletter.pragmaticengineer.com/p/steve-yegge-on-ai-agents-and-the
3•duck•38m ago•0 comments

Madras School System and AI Learning Share Similarity

2•tesnorindian•44m ago•0 comments

Show HN: Pip – Your Git history puts you on a Performance Improvement Plan

https://github.com/littlestjames82-sys/pip-pip
1•ghostdevstudio•46m ago•0 comments

Ask HN: What positive impact has AI had in the past 5 years?

2•meredithbloom•49m ago•3 comments

Official Microsoft agent-framework PyPI package compromised

https://opensourcemalware.com/blog/agent-framework-pypi-compromised
3•jruohonen•53m ago•0 comments

Rust doubled on GitHub in the year agents started 40% PRs

https://hyscaler.com/insights/the-internet-is-getting-rusty/
2•royraghav28•55m ago•2 comments

Danish researchers find efficient solution to the four colour problem

https://via.ritzau.dk/pressemeddelelse/15284557/breakthrough-danish-researchers-find-efficient-so...
1•theanonymousone•56m ago•0 comments

Stickers on Buttons: Why South Korea's Suneung AI cheating patch won't hold

https://siwoo.lol/note/stickers-on-buttons/
1•siwoo•56m ago•0 comments

Microsoft's official Python agent framework hijacked to distribute malware

https://www.theregister.com/security/2026/11/18/microsofts-official-python-agent-framework-hijack...
1•MadrasTh0rn•58m ago•0 comments