frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Relation Algebra ≠ Relational Algebra

https://remy.wang/blog/ra-ra.html
1•fanf2•31s ago•0 comments

Ask HN: How to Learn Systems Programming

1•sampsn•56s ago•0 comments

Paul's Automotive DIY Repair Guides

https://www.paulstravelpictures.com/Articles/index.htm
1•js2•4m ago•0 comments

Jonathan Swift vs. AI

https://www.thedial.world/articles/news/schools-teachers-artificial-intelligence
1•cainxinth•4m ago•0 comments

Wow Forever Classfinder – Find Your Perfect Class

https://wowforeverclassfinder.com/
1•marc0janssen•6m ago•0 comments

Unsealed files describe OpenAI "research mission" to supplant human authors

https://www.publishersweekly.com/pw/by-topic/digital/copyright/article/101300-unsealed-files-show...
2•ilamont•6m ago•0 comments

Building a Low-Maintenance Technical Blog with Astro and Cloudflare Pages

https://pragmaticbydefault.com/posts/astro-and-cloudflare-pragmatic-blog/
1•lukasz_km•9m ago•0 comments

Implications of the EBR-II Inherent Safety Demonstration Test (1986) [pdf]

https://www.oecd-nea.org/upload/docs/application/pdf/2020-07/neacrp-a-1986-0773.pdf
1•fedecaccia•11m ago•0 comments

New bill to protect American citizens access to AI – Please read and share

https://righttorun.us
7•howdoweknowit•12m ago•0 comments

US DOT unveils new air traffic control system aimed at reducing flight delays

https://www.transportation.gov/briefing-room/trumps-transportation-secretary-sean-p-duffy-deliver...
1•tolugenius•13m ago•0 comments

Stocks had a great Monday, but something alarming occurred not seen since 1999

https://www.cnbc.com/2026/09/21/stocks-had-a-great-day-on-the-surface-but-something-alarming-occu...
1•MilnerRoute•13m ago•2 comments

'Planetary boundaries' necessary for flourishing of life have been breached

https://www.theguardian.com/environment/2026/sep/21/planetary-boundaries-breached-scientists-warn...
2•pseudolus•14m ago•0 comments

Microsoft: September updates break File History backup feature

https://www.bleepingcomputer.com/news/microsoft/microsoft-september-updates-break-file-history-ba...
1•speckx•14m ago•0 comments

The data does not show mass unemployment

https://lemire.me/blog/2026/09/21/nomassunemployment/
1•4lx87•20m ago•0 comments

OpenBSD's hypervisor now supports guest SMP

https://github.com/openbsd/src/commit/d74b165ebc85c9aaf5150f25e6088f52d9fc0f04
1•rockhardandrew•21m ago•0 comments

Vibecoding isn't a crime How Distribute Your App on Linux after Flathub refusal

https://grigio.org/vibecoding-isnt-a-crime-how-to-deal-with-flatpak-flathub-refusals-and-actually...
4•grigio•21m ago•0 comments

If You Want to Learn Algebra, You Need to Have Automaticity on Basic Arithmetic

https://www.justinmath.com/if-you-want-to-learn-algebra-you-need-to-have-automaticity-on-basic-ar...
2•gmays•21m ago•0 comments

A Game Boy Advance emulator in Rust that renders Pokémon FireRed in 3D

https://github.com/x0cero/gba
1•0ARCH•22m ago•0 comments

Webinar: From Data Sheet to Design, Building with AMD Spartan UltraScale+ FPGAs

https://us02web.zoom.us/webinar/register/WN_ICecaVKkQ4G4C0JE7bUoiw#/registration
1•signalhound•23m ago•0 comments

US data centres 'are short six NYCs of electricity'

https://www.ft.com/content/f29de45a-3d32-4d9f-90cd-615f7466c1de
2•frereubu•24m ago•0 comments

GitHub has taken down Bend's repository

https://twitter.com/VictorTaelin/status/2102118439892762936
6•marvinborner•25m ago•0 comments

The Epidemiology of a Cognitive Virus

https://data4sci.substack.com/p/the-epidemiology-of-a-cognitive-virus
1•Anon84•25m ago•0 comments

Show HN: Blackgit – use Git to only download those cared files

https://github.com/zhuzhonghua/blackgit
2•zhonghua•29m ago•0 comments

Xiaomi MiMo v2.6

https://mimo.xiaomi.com/mimo-v2-6
88•volf_•30m ago•16 comments

What if we regulated AI like cars?

https://rkp.science/regulating_ai_like_cars.html
1•rkp8000•31m ago•0 comments

Current landscape of innovative drug development and regulatory support in China

https://www.nature.com/articles/s41392-025-02267-y
1•wslh•32m ago•0 comments

94% on AIME with 1B Params

https://paradigma.inc/blog/limite-1b-violetto/
1•E-Reverance•34m ago•0 comments

Why are all these longevity bros such total snowflakes?

https://www.thenewworld.co.uk/holly-thomas-why-are-all-these-longevity-bros-such-total-snowflakes/
2•simonebrunozzi•35m ago•3 comments

The Forgotten Battle of East Lansing

https://eastlansinginfo.news/the-forgotten-battle-of-east-lansing/
1•rmason•35m ago•0 comments

Ask HN: Do you love your job?

1•good-idea•35m ago•3 comments