frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: ScrapeCopilot – Notebook Code Interface + Puppeteer + AI Copilot

3•erichi•1y ago
Hi HN, I’m Eric, and I’m building ScrapeCopilot, an AI assistant designed to eliminate friction in browser automation development.

Here is the link to VS Code extension - https://marketplace.visualstudio.com/items?itemName=scrapeco...

I've built browser automations for more than 5 years, and the constant frustration was always the sheer friction involved in getting working code – especially when debugging in headless mode or connecting to remote browsers.

When I started using LLMs to generate automation code, I found myself stuck in a repetitive loop: navigate to the desired page state, copy-paste HTML into the AI chat, and ask it to generate code. The worst part is that there was no easy way to run that generated code without losing the page state, forcing me to restart the browser session constantly. This wasted large amounts of time and mental energy. I built ScrapeCopilot to make this workflow seamless.

How it works:

ScrapeCopilot combines the power of a Jupyter-style notebook with a live Puppeteer browser session and integrated AI.

- Live Interactive Development: When you create an automation notebook, it initiates a fresh Puppeteer browser session. The page object is exposed directly to your notebook cells, allowing you to run any Puppeteer code against the live browser state and see the results instantly.

- AI-Powered Assistance: It integrates with GitHub Copilot (via the @scrapecopilot chat participant). The AI automatically sees the current page HTML, allowing it to generate highly relevant Puppeteer code based on your instructions directly within the chat.

- LLM Code Export: Once you've developed your automation logic, you can easily export the final, complete Puppeteer script based on your instructions.

This tool saves me hours daily, but even more importantly, it improves the developer experience in browser automation which is frustrating area.

I believe ScrapeCopilot can complement existing browser automation tools and frameworks by providing an interactive AI-assisted development experience.

Current Status & Future Plans:

- The extension currently works within VS Code. It will work in Cursor, but without chat support initially. I'm actively working on integrating a backend server to enable full chat functionality with Cursor.

- Currently the key workflow assumes that you create a new browser automation step by step, using code cells. But in my work I spend half of the time fixing existing automations, so my focus now is trying to adapt extension for debugging and fixing existing code.

- Playwright support is also on the list.

Check out short videos: - Demo: Headless False - https://scrapecopilot.ai/assets/demo-headless-false-Dhc_jeNR... - Demo: Headless True - https://scrapecopilot.ai/assets/demo-headless-true-PRQndDxP....

I'd love to hear your thoughts, feedback, and any suggestions!

Pimco Says AI Bond Spreads May Tighten as Data Center Boom Slows

https://www.bloomberg.com/news/articles/2026-11-17/pimco-says-ai-bond-spreads-may-tighten-as-data...
1•madihaa•2m ago•0 comments

The Yang–Mills Mass Gap, Through the Lens of Skyrmions

https://www.patreon.com/CellHacker/posts/yang-mills-mass-175565290
1•efim_bushmanov•7m ago•0 comments

Show HN: BitTorrent Neo – we rebuilt our torrent client natively for macOS

https://www.bittorrent.com/products/mac/neo/
1•BittorrentOps•7m ago•0 comments

LLMs are terrible at designing AI systems

https://www.seangoedecke.com/llms-are-terrible-at-designing-ai-systems/
3•saikatsg•9m ago•1 comments

It Breaks a Village: Bevy's 6th Birthday

https://blog.fallible.net/it-breaks-a-village/
2•pryanshu89•9m ago•0 comments

Estonia plans to run its government from the cloud in case of a Russian invasion

https://www.politico.eu/article/estonias-digital-preppers-have-a-doomsday-backup-plan/
1•giuliomagnifico•14m ago•0 comments

How image generation got good (diffusion derivations)

https://shuklabhay.github.io/gallery/diffusion/
1•01shuklabhay•16m ago•0 comments

Tech leaders are convinced that Jensen Huang's exit was a plot against him

https://www.theverge.com/tech/1035027/tech-leaders-nvidia-jensen-huang-theories
7•madihaa•19m ago•0 comments

Deep Personalization: Unlocking Personalized Proactive Agents with Local Compute

https://nvlabs.github.io/deep-personalization/
1•matt_d•22m ago•0 comments

Microsoft Post-Incident Report Is Up for the Exchange Online Outage

https://www.reddit.com/r/sysadmin/comments/1xxiasy/microsoft_postincident_report_is_up_for_the/
4•vismit2000•22m ago•0 comments

Gone Fishin': The Answer to JensenGate Is the Pond Principle

https://www.pond.is/p/gone-fishin-the-answer-to-jensengate
1•StevenVincent•28m ago•0 comments

Robot Learning

https://robotlearningbook.com/
1•gmays•31m ago•0 comments

Memory Poker

https://juileebhosale.com/memory-poker
1•dropbox_miner•36m ago•0 comments

GitHub Copilot models deprecated on November 16, 2026

https://github.blog/changelog/2026-11-16-github-copilot-models-deprecated-on-november-16-2026/
4•axis_official•39m ago•2 comments

I Rebuilt Google Drive on GitHub

https://adventuresinclaude.ai/posts/i-rebuilt-google-drive-on-github
1•aanet•42m ago•0 comments

Show HN: MillionShort – A search engine you can remove 1M sites

https://millionshort.com/
1•taxonomyman•42m ago•0 comments

I Love "Elizabeth Holmes"

https://sidneynotsydney.substack.com/p/i-love-elizabeth-holmes
1•wmchen•48m ago•0 comments

Saturn Devouring His Sun

https://en.wikipedia.org/wiki/Saturn_Devouring_His_Son
2•wasabi991011•52m ago•0 comments

Show HN: Apple's apps never reached Android. Built in Rust

https://github.com/YashwanthKamireddi/Skykeep
1•YashOnYC•56m ago•0 comments

The whole world is long America

https://www.ft.com/content/1f1a2a9b-9429-4e4b-8606-7be8a1fd701e
4•jmeister•56m ago•0 comments

Nvidia Board Warned of 'Irreplaceable' Talent Loss in Employee Letter

https://www.wsj.com/business/nvidia-board-warned-of-irreplaceable-talent-loss-in-employee-letter-...
5•bryan0•1h ago•1 comments

Towering waterspouts spotted over San Francisco Bay

https://www.sfgate.com/bayarea/article/waterspouts-sf-bay-video-22534057.php
1•kaycebasques•1h ago•0 comments

A Modular, Extensible, Serving System for Multimodal Models

https://mstar.stanford.edu/
2•groodt•1h ago•0 comments

Bunnings to make 230 jobs redundant amid partial offshoring of tech services

https://www.abc.net.au/news/2026-11-17/bunnings-layoffs-and-offshoring/107394860
6•langfo•1h ago•0 comments

Ask HN: Where are you on the spectrum of AI/LLM adoption?

1•joddystreet•1h ago•2 comments

Last year we built megakernels. This year we deleted them: The road to TKCC

https://www.together.ai/blog/road-to-together-compiler
2•matt_d•1h ago•0 comments

File over App (2023)

https://stephango.com/file-over-app
1•theanonymousone•1h ago•0 comments

Devi: App is live. Now find the first customers

https://devi.devz.ai/signup?utm_source=hackernews&utm_medium=hnpost&utm_campaign=hnpost111326
1•devzai•1h ago•0 comments

From One Sentence to a Running Pipeline

https://altertable.ai/blog/2026-11-16-from-one-sentence-to-a-running-pipeline
1•mooreds•1h ago•0 comments

Show HN: Blobby – A design canvas that Claude, Cursor or Codex drives over MCP

https://useblobby.com/
1•bisht3404•1h ago•0 comments