frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ScrapeCopilot – Notebook Code Interface + Puppeteer + AI Copilot

3•erichi•1y ago
Hi HN, I’m Eric, and I’m building ScrapeCopilot, an AI assistant designed to eliminate friction in browser automation development.

Here is the link to VS Code extension - https://marketplace.visualstudio.com/items?itemName=scrapeco...

I've built browser automations for more than 5 years, and the constant frustration was always the sheer friction involved in getting working code – especially when debugging in headless mode or connecting to remote browsers.

When I started using LLMs to generate automation code, I found myself stuck in a repetitive loop: navigate to the desired page state, copy-paste HTML into the AI chat, and ask it to generate code. The worst part is that there was no easy way to run that generated code without losing the page state, forcing me to restart the browser session constantly. This wasted large amounts of time and mental energy. I built ScrapeCopilot to make this workflow seamless.

How it works:

ScrapeCopilot combines the power of a Jupyter-style notebook with a live Puppeteer browser session and integrated AI.

- Live Interactive Development: When you create an automation notebook, it initiates a fresh Puppeteer browser session. The page object is exposed directly to your notebook cells, allowing you to run any Puppeteer code against the live browser state and see the results instantly.

- AI-Powered Assistance: It integrates with GitHub Copilot (via the @scrapecopilot chat participant). The AI automatically sees the current page HTML, allowing it to generate highly relevant Puppeteer code based on your instructions directly within the chat.

- LLM Code Export: Once you've developed your automation logic, you can easily export the final, complete Puppeteer script based on your instructions.

This tool saves me hours daily, but even more importantly, it improves the developer experience in browser automation which is frustrating area.

I believe ScrapeCopilot can complement existing browser automation tools and frameworks by providing an interactive AI-assisted development experience.

Current Status & Future Plans:

- The extension currently works within VS Code. It will work in Cursor, but without chat support initially. I'm actively working on integrating a backend server to enable full chat functionality with Cursor.

- Currently the key workflow assumes that you create a new browser automation step by step, using code cells. But in my work I spend half of the time fixing existing automations, so my focus now is trying to adapt extension for debugging and fixing existing code.

- Playwright support is also on the list.

Check out short videos: - Demo: Headless False - https://scrapecopilot.ai/assets/demo-headless-false-Dhc_jeNR... - Demo: Headless True - https://scrapecopilot.ai/assets/demo-headless-true-PRQndDxP....

I'd love to hear your thoughts, feedback, and any suggestions!

Anthropic Founders Who Just Became Multibillionaires

https://www.nytimes.com/2026/10/26/technology/anthropic-founders.html
1•doener•1m ago•0 comments

IRCv3 server implemented using Erlang/OTP with optional voices, files, and E2EE

https://github.com/egorsmkv/irc-server
1•yehors•1m ago•0 comments

Chitrakavya: The Picture-Poems of Sanskrit

https://www.youtube.com/watch?v=JDuUZW05lNA
1•zuj•2m ago•1 comments

Show HN: SSH OS – an SSH-only operating system for the 1987 Macintosh SE

https://github.com/naruse/SSH-OS
1•naruse•7m ago•0 comments

Computer Networks from Scratch

https://www.networksfromscratch.com/
1•ibobev•9m ago•1 comments

Thousands of UK fridges secured in secret nationwide operation

https://www.bbc.co.uk/news/articles/c6eq49zyx7p4o
1•netrem•14m ago•0 comments

'Companies don't care about you' is a parse error

https://blog.oliverbalfour.com/2026/11/20/companies-dont-care-about-you.html
1•OliverBalfour•20m ago•1 comments

Top White House Cybersecurity Official Steps Down

https://www.nytimes.com/2026/11/19/us/politics/white-house-cyber-director-departs.html
2•shevis•24m ago•2 comments

Serial: The Port That Won't Die

https://hackaday.com/2026/11/18/serial-the-port-that-wont-die/
1•lucaslazarus•25m ago•0 comments

WebTape – Record browser demos to GIF/MP4 from a plain-text script

https://github.com/zhushen12580/webtape
1•zane12580•28m ago•0 comments

Show HN: Tyche, An intelligent interface that clicks, books, and shops on iPhone

https://apps.apple.com/us/app/tyche-intelligent-interface/id6835683787
1•iop030290•30m ago•0 comments

Hyperscale. Play as a Frontier AI Lab and try cash out before society collapses

https://hyperscale.serinstudios.com/
2•ownbaggy•31m ago•0 comments

OpenSSL heap buffer overflow in EVP_EncodeBlock() output sizing

https://cve.now/CVE-2026-121481
2•choult•36m ago•0 comments

Grand Theft Auto Used to Satirize American Life. Now We've Caught Up with It

https://www.nytimes.com/2026/11/19/magazine/grand-theft-auto-six.html
1•elffjs•38m ago•0 comments

Fiction Machines – Léon Bottou [video]

https://www.youtube.com/watch?v=B64cnPA36Dc
1•matt_d•39m ago•0 comments

'Anthropic was supposed to save the AI trade. What went wrong?' – CNBC

https://www.cnbc.com/2026/11/19/anthropic-ipo-ai-stocks-selloff.html
1•MilnerRoute•41m ago•0 comments

Ex MS researcher publishes claimed Windows lock-screen bypass through Narrator

https://runtimewire.com/article/former-microsoft-researcher-publishes-claimed-windows-lock-screen...
3•thunderbong•43m ago•0 comments

Looking like nothing: surviving deep packet inspection with VLESS and REALITY

https://undef.dev/writing/learn/vless-reality/
1•zenincognito•45m ago•0 comments

Vint Cerf on why TCP/IP was never patented

https://seremot.com/p/vint-cerf-on-why-tcpip-was-never
2•emot•46m ago•2 comments

Ihash : the fastest high-quality non-cryptographic hash

https://crates.io/crates/ihash
1•i18n•47m ago•0 comments

The fastest double-to-string algorithm you've never heard of

https://vitaut.net/posts/2026/yy-dtoa/
1•fagnerbrack•51m ago•0 comments

Writing Python like it's Rust (2023)

https://kobzol.github.io/rust/python/2023/05/20/writing-python-like-its-rust.html
1•kaycebasques•51m ago•0 comments

FreeBSD Is What Unix Was Supposed to Be

https://milkcrunch.com/freebsd-unix-philosophy/
3•zenincognito•59m ago•2 comments

Show HN: Zeus – Claude Code for AI voice agents

https://thunderphone.com/blog/introducing-zeus
1•kolchinski•1h ago•0 comments

Palo Alto Networks CEO on the network outages through major companies

https://finance.yahoo.com/technology/article/palo-alto-networks-ceo-just-dropped-a-truth-bomb-on-...
3•thunderbong•1h ago•1 comments

Top BOF Repositories for Red Teamers

https://medium.com/@nukeratframework/top-3-bof-repositories-for-red-teamers-ba67b3c5e2d7
2•JohnTheTitor•1h ago•0 comments

UK government forced to disclose secret Apple backdoor order

https://techcrunch.com/2026/11/19/u-k-government-forced-to-disclose-secret-apple-backdoor-order/
3•Coeur•1h ago•1 comments

Perfecting Terminal Character Width Using Correction Tables

https://www.jeffquast.com/post/perfecting-terminal-character-width-using-correction-tables/
2•birdculture•1h ago•0 comments

Postgres 19 is out, and it's available on Neon and Databricks Lakebase

https://www.databricks.com/blog/postgresql-19-available-lakebase
3•sp_from_db•1h ago•3 comments

Perceptle

https://perceptle.com/
3•soheilpro•1h ago•0 comments