frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Another Symptom of Growing Isolation

https://www.theatlantic.com/family/2026/07/talking-less-reasons/688074/
1•theanonymousone•1m ago•0 comments

The Punched Card Tabulator

https://www.ibm.com/history/punched-card-tabulator
1•Bluestein•2m ago•0 comments

A Deep Dive into C++26 Std:Hive: The Ultimate Container for Active Data

https://towardsdev.com/cpp26-std-hive-deep-dive-tutorial-5bdaa44f4d94
1•ibobev•4m ago•0 comments

Atari Legacy Magazine

https://www.goto10retro.com/p/atari-legacy-magazine
1•ibobev•7m ago•0 comments

Claude Code context management: when to /clear and when to /compact

https://tim-schipper.nl/en/blog/claude-code-context-management
2•opwizardx•9m ago•0 comments

Using the Xteink X4, a minimalist e-reader

https://log.schemescape.com/posts/hardware/xteink-x4.html
2•speckx•9m ago•0 comments

Iceberg Collapses and Flips over in Ilulissat, Greenland (July 25, 2026) [video]

https://www.youtube.com/watch?v=UufMqwyO7pY
1•Bender•9m ago•0 comments

Software is about people, not code

https://letterstoanewdeveloper.com/2020/01/27/software-is-about-people-not-code/
4•venamresm__•9m ago•0 comments

99% of My Website Traffic Is Bots

https://patronview.com/news/99-percent-of-my-website-traffic-is-bots/
5•petercooper•12m ago•2 comments

China-Free Batteries Made from Salt Are Finally Here

https://www.wsj.com/business/energy-oil/china-free-batteries-made-from-salt-are-finally-here-cc1c...
2•Vaslo•12m ago•0 comments

Show HN: LettersPractice – Teach your child to read with a modified SRS engine

https://letterspractice.com/
1•NiloCK•12m ago•0 comments

Ultraviolet Bird Photography

https://uvbirds.com/
1•EndXA•13m ago•0 comments

Show HN: Wellsy: Health and Journal

https://www.wellsy.se/en
1•planting•13m ago•0 comments

Local AI Stack Planner

https://local-ai-models.ai/
1•krunck•13m ago•0 comments

Map of the Internet (2006)

https://xkcd.com/195/
1•basilikum•14m ago•0 comments

What Gives AI-Generated Text Away? Not Em Dashes [video]

https://www.youtube.com/watch?v=2jSU0mIzsMM
1•amichail•16m ago•0 comments

AI Threatens Our Economy and Democracy Itself

https://www.spiegel.de/international/business/was-marx-right-how-ai-threatens-our-economy-and-dem...
2•dmckinno•17m ago•0 comments

The 25 Objects That Explain America

https://www.nytimes.com/interactive/2026/08/04/opinion/museum-of-america.html
1•bookofjoe•17m ago•1 comments

Ford Fathom Is Here the $29,945 Electric Truck [video]

https://www.youtube.com/watch?v=4tYewY3P_CY
1•rawgabbit•17m ago•0 comments

Moonshot's AI model Kimi k3 breaks out of testing environment, researchers say

https://www.reuters.com/legal/litigation/chinese-startup-moonshots-ai-model-breaks-out-testing-en...
2•tom2026hn•19m ago•1 comments

Your Big Brain Wouldn't Be Possible Without Sugar

https://nautil.us/your-big-brain-wouldnt-be-possible-without-sugar-1283454
1•Brajeshwar•19m ago•0 comments

Ask HN: Claude Code Alternatives

1•salahadawi•19m ago•0 comments

How many paper folds would get you to the moon?

https://www.scientificamerican.com/article/how-many-paper-folds-would-get-you-to-the-moon/
1•beardyw•21m ago•1 comments

2026 Worst City for Bed Bugs Is Chicago, IL

https://www.orkin.com/press-room/chicago-worst-city-for-bed-bugs-again
1•speckx•21m ago•0 comments

From Handmade to AI-Made Websites: 20 Years in Website Development

https://www.xfive.co/blog/20-years-website-development
1•lubos76•23m ago•0 comments

I Built Remembr

https://apps.apple.com/us/app/remembr-shared-reminders/id6791300772
1•samltschenk•23m ago•2 comments

99.1% Totality

https://twitter.com/garrytan/status/2062760454649487491
1•gmays•24m ago•1 comments

As Reddit stock falls, CEO questions value of Google's AI Overviews

https://arstechnica.com/ai/2026/08/reddit-ceo-on-ai-overviews-were-still-looking-for-that-win-win/
3•mooreds•25m ago•0 comments

Official Dwarf Fortress Guide for Beginners (2026) [video]

https://www.youtube.com/watch?v=aRTwK8XR6kE
1•skibz•25m ago•0 comments

Bb Agent IDE

https://github.com/get-bb/bb
1•dfaiv•25m ago•1 comments