frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

A Chemical Hunger

https://slimemoldtimemold.com/2021/07/07/a-chemical-hunger-part-i-mysteries/
1•bilsbie•42s ago•0 comments

GPT-6.1 Terra

https://simonwillison.net/2026/Oct/26/gpt-61-terra/
1•hnisjafx40•49s ago•0 comments

Reddit shares plunge as Google's AI search squeezes traffic

https://www.reuters.com/business/reddit-pinterest-shares-tumble-weak-user-revenue-growth-2026-10-30/
2•randycupertino•1m ago•0 comments

NASA's Voyager 1 Conserves Power, Resolves Brief Communications Pause

https://www.jpl.nasa.gov/news/nasas-voyager-1-conserves-power-resolves-brief-communications-pause/
1•Stratoscope•2m ago•0 comments

macOS 27 Golden Gate does not support CoreStorage or HFS+ volumes

https://wadetregaskis.com/macos-27-golden-gate-does-not-actually-support-corestorage-or-hfs-volumes/
3•chmaynard•6m ago•0 comments

Report from the Vatican

https://garymarcus.substack.com/p/report-from-the-vatican
1•chmaynard•9m ago•0 comments

Show HN: Othismo, a Runtime for Sandboxed Objects

https://othismo.com
1•mamidon•9m ago•0 comments

Bidirectional Charging During Grid Outages

https://www.jefftk.com/p/bidirectional-charging-during-grid-outages
1•luu•11m ago•0 comments

I miss the old ways, so I am trying to find a middleground

https://github.com/TheMissenoOne/OpenArc
1•themissenoone•11m ago•0 comments

What Anthropic’s IPO Filing Actually Says

https://www.youtube.com/watch?v=Ic1Jf7VlXRM
3•Betelbuddy•14m ago•0 comments

NPM, "estee" is not a typo of "testem"

https://smoores.dev/post/no_npm_estee_is_not_a_typo/
2•birdculture•16m ago•0 comments

IdentityHub – Add Google, Dropbox, and email login to your SaaS in 5 minutes

https://www.identityhub.tech
1•wildreallywon•18m ago•0 comments

The New Food Movement

https://www.theatlantic.com/culture/2026/10/american-sustenance-omnivore-dilemma/688643/
1•bilsbie•19m ago•0 comments

The Lithium Hypothesis of Obesity

https://www.youtube.com/watch?v=t5NklTNoKDI
1•dakila5•21m ago•0 comments

The Golden Age

https://dark.ronacher.eu/2026/10/31/golden-age/
2•droidjj•22m ago•0 comments

Surviving "The Graduate"

https://www.newyorker.com/culture/the-weekend-essay/dustin-hoffman-on-surviving-the-graduate
2•samizdis•31m ago•0 comments

HackerTube: YouTube built from videos recommended by HN

https://karpathy.bearblog.dev/hacker-tube/
21•karpathy•36m ago•12 comments

Toit. Language for ESP32

https://toit.io/
2•wiradikusuma•36m ago•0 comments

LocalASO – App Store keyword research in 52 countries, on your Mac

https://localaso.com
1•gianmaurice•37m ago•0 comments

The Linux Command Line

https://linuxcommand.org/tlcl.php
2•kristianp•37m ago•0 comments

Show HN: Read your Character.AI data export in the browser, nothing uploaded

https://github.com/anima-universe/character-ai-export-viewer
1•Amavie•39m ago•0 comments

A Surveilled Country Is Not a Free Country

https://brownstone.org/articles/a-surveilled-country-is-not-a-free-country/
3•CGMthrowaway•42m ago•0 comments

Bub 0.6.0

https://github.com/bubbuild/bub/releases/tag/0.6.0
2•chojanshang•45m ago•0 comments

Evolving Agent Teams

https://arxiv.org/abs/2610.36848
1•anigbrowl•46m ago•0 comments

Automate the setup and configuration of your Windows development environment

https://github.com/microsoft/WindowsDeveloperConfig/
1•gjvc•49m ago•0 comments

Anthropic: Scaling Misuse Detection with Self-Assessment of Chats

https://twitter.com/AnthropicAI/status/2115871889549865429
7•cft•52m ago•0 comments

Anthropic blocks users for anything touching training larger models

https://twitter.com/jiahaoshao1/status/2116475922190922088
10•pretext•53m ago•0 comments

Hackers broke into four of Canada's top law firms

https://www.theglobeandmail.com/business/article-law-firms-hackers-how-did-it-happen-client-files...
5•Teever•54m ago•0 comments

Expert Knowledge and the Conditions of Its Validity: The Limits of Judgment

https://medium.com/@smoking2man/expert-knowledge-and-the-conditions-of-its-validity-the-limits-of...
3•Aldus551•57m ago•0 comments

Show HN: Aruma – clean-room self-hosted backend for the official Firebase SDKs

https://github.com/arumadev/aruma
3•osama200•57m ago•1 comments