frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

What AI at Work Costs

https://www.microsoft.com/en-us/copilot/blog/2026/11/16/what-ai-at-work-really-costs/
1•saikatsg•37s ago•0 comments

Wall Street Pledged $500B for Nvidia. Not a Dollar Has Been Deployed

https://www.wsj.com/world/wall-street-pledged-500-billion-for-nvidia-not-a-dollar-has-been-deploy...
1•doener•2m ago•0 comments

Ct2shell: New *2shell domains, read straight off the cert logs

https://raesene.github.io/ct2shell/
2•hasheddan•4m ago•0 comments

The Return of the Webmaster – Ben Bashford

https://benbashford.com/posts/the-return-of-the-webmaster/
1•talkinghead•5m ago•0 comments

Baraag.net Domain Seized by FBI

https://boards.4chan.org/g/thread/110372455/baraag-on-life-support
2•RA2lover•18m ago•0 comments

Two stealth models just appeared on the leaderboard, both ahead of Fable 5.2

https://contralabs.com/frontierdesign
4•cheptsov•18m ago•0 comments

Open Source Canva Alternative in Go

https://github.com/hyscaler/HyCanvas
1•pitabas106•19m ago•0 comments

Show HN: Topothesy – a daily online geography game

1•proy87•19m ago•0 comments

Rust Anything – Port apps to Rust and check them against the original

https://github.com/erkamyaman/rust-anything
1•bakigul•20m ago•0 comments

How the European Commission rolled out Matrix to more than 40k staff

https://element.io/blog/how-the-european-commission-rolled-out-matrix-to-more-than-40-000-staff/
2•liotier•23m ago•0 comments

Grok apps leak private data

https://labs.cloudsecurityalliance.org/research/csa-research-note-grok-build-apps-exposed-by-defa...
1•armcat•24m ago•0 comments

Sashiko: Lessons from building an agentic code review system for Linux

https://cloud.google.com/blog/products/application-development/lessons-from-building-sashiko-an-a...
1•DonAtimator•25m ago•0 comments

Huawei Watch Air

https://www.notebookcheck.net/Huawei-Watch-Air-with-ultra-thin-titanium-unibody-looks-like-the-Ap...
1•HatchedLake721•27m ago•0 comments

AI Overworks People

https://twitter.com/catalinmpit/status/2123061832781090948
4•cmpit•29m ago•0 comments

GitHub Deletes Camoufox Repo

https://twitter.com/d4ijro/status/2123332988276531566
2•elsombrero•29m ago•0 comments

Cloudflare releases weights of Clairic, its AI that reads invoices and receipts

https://maccus.fr/en/cloudflare-clairic-open-weights/
1•theanonymousone•31m ago•0 comments

A football API that publishes its own log loss, misses included

https://www.predictiqpro.com/accuracy
2•predictiq•31m ago•0 comments

I Hated Running a VPN on Android, So I Built My Own Zero Trust Infra Instead

https://difhel.dev/en/blog/zero-trust-beyond-vpn
1•difhel•34m ago•0 comments

DeepSeek Limits Free Service Usage via Chat

https://finance.biggo.com/news/3ddf7191-bd44-4073-b849-a2167ecb7b55
2•RockstarSprain•40m ago•1 comments

Ubuntu 26.10 Stonking Stingray

https://ubuntu.com/blog/canonical-releases-ubuntu-26-10-stonking-stingray
2•ankitg12•43m ago•0 comments

AI Questions (Benedict Evans' Bi-Annual, Nov 2026) [pdf]

https://static1.squarespace.com/static/50363cf324ac8e905e7df861/t/6afe293472e19d05894f58bb/179504...
1•daniel_iversen•44m ago•0 comments

Show HN: RISC-V emulator booting 256-hart SMP Linux/uClibc/BusyBox on RTX3060

https://github.com/gaidardzhiev/vertigo
1•mrelf•44m ago•1 comments

Sounds of the Adriatic – a sound map of the Croatian coast

https://sound.marespot.com/
2•yossarian_johnn•46m ago•0 comments

Show HN: Agent Bolt – a browser game that teaches Claude Code by doing

https://agentbolt.dev/#game
3•danlapteacru•58m ago•0 comments

Ask HN: How do you manage the curse of rabbit hole?

3•BOOSTERHIDROGEN•1h ago•1 comments

LumenDisk – read/write ext4 and NTFS on macOS without macFUSE or kexts

https://github.com/giuseppegambino92/LumenDisk
1•giuseppegambino•1h ago•0 comments

Backdoor attacks against Machine Learning IRL

https://phrack.org/issues/73/backdoor-attacks-against-machine-learning-irl_md
2•DonAtimator•1h ago•0 comments

Show HN: QR Anatomy, See what every square of a QR code is for

https://hrih.si/projects/qr-anatomy/
2•DonAtimator•1h ago•0 comments

I will build an LLM to actively defend cyber attacks

1•mastaanshaik•1h ago•0 comments

Ncurses Documentation

https://betsalel-williamson.github.io/ncurses/
1•rbanffy•1h ago•0 comments