frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

How to Make More Prodigies

https://unpublishablepapers.substack.com/p/how-to-make-more-prodigies
1•paulpauper•54s ago•0 comments

Bing Wallpaper showing Ad for Harry Potter and Fantastic beasts box set

https://www.thurrott.com/forums/microsoft/windows/thread/bing-wallpaper-showing-ad-for-harry-pott...
2•neogodless•58s ago•0 comments

The Last Thing Teenagers Will Let You Teach Them

https://www.theatlantic.com/family/2026/09/teen-driving-lessons/688534/
1•paulpauper•1m ago•0 comments

How to find out if a website looks vibe coded

https://wasitvibed.com/
1•brambleworks•2m ago•0 comments

DPP-Flash – Automated Digital Product Passports (DPP) for EU Compliance

https://dppflash.de/
1•bergstreiser•3m ago•0 comments

The postmodern build system (updated 2025)

https://jade.fyi/blog/the-postmodern-build-system/
1•e-topy•3m ago•0 comments

The Machine (1968) [video]

https://www.youtube.com/watch?v=iwVu2BWLZqA
1•ai_critic•5m ago•0 comments

Agencies Without Agency: How Dispersed Power Derails Transportation Infra

https://americanaffairsjournal.org/2026/08/agencies-without-agency-how-dispersed-power-derails-tr...
1•godisdad•5m ago•1 comments

Show HN: I have created a browser FPS game with kamikaze drones

https://sectorlock.com/
2•canerg•11m ago•1 comments

C Is Not a Low-Level Language (2018)

https://queue.acm.org/doi/10.1145/3212477.3212479
3•tosh•12m ago•0 comments

Billionaire tries untested longevity therapy to restore daughter's vision

https://science.slashdot.org/story/26/09/07/0036234/she-lost-her-sight-her-billionaire-father-bet...
3•gumby•15m ago•1 comments

Show HN: Send flowers from your AI agent and make your mum happy

4•fabian_shipamax•16m ago•0 comments

Linux Lost the Human Desktop. Can It Win the Agent Desktop?

https://alexander.holbreich.org/posts/2026/linux-agent-desktop/
2•aholbreich•19m ago•0 comments

Show HN: Titles – Can you write a better Hacker News title?

https://www.orangecrumbs.com/hn-titles
2•oyster143•22m ago•0 comments

Bill Gates tries to install MovieMaker

https://www.techemails.com/p/bill-gates-tries-to-install-movie-maker
3•highfrequency•24m ago•1 comments

Animals fear human voices more than lions (2023)

https://www.bbc.com/news/world-africa-67023033
2•maxloh•24m ago•0 comments

Burrows–Wheeler Transform

https://en.wikipedia.org/wiki/Burrows%E2%80%93Wheeler_transform
2•theanonymousone•26m ago•0 comments

Aging U.S. demographics jolt labor market data

https://www.axios.com/2026/08/13/labor-market-demographics-boomers
2•toomuchtodo•26m ago•0 comments

Jujutsu–A Version Control System

https://docs.jj-vcs.dev/latest/
3•Bluestein•26m ago•0 comments

Show HN: A fast, private, cross-platform Markdown editor built with Tauri/Rust

https://github.com/skanga/mdedit
2•skanga•28m ago•1 comments

An outliner sync engine that is right for the use case

https://k22i.com/journal/outliner-sync-engine/
1•krszwsk•29m ago•0 comments

Remember CVE 2010-2743 (vulnerability that was exploited in Stuxnet)

https://blog.projectnightcrawler.dev/posts/2026-08-14-remember-cve-2010-2743/
1•airhangerf15•29m ago•0 comments

SuperAstra: Edit Super Nintendo games live with GPT-6

https://twitter.com/scottastevenson/status/2096972908828426747
2•tosh•29m ago•1 comments

Tosemu – Wine for the Atari ST

https://e8johan.github.io/tosemu/
1•e8johan•30m ago•0 comments

Filecoin Foundation for the Decentralized Web (FFDW)

https://ffdweb.org
2•Bluestein•30m ago•0 comments

Large Text Compression Benchmark

https://mattmahoney.net/dc/text.html
1•theanonymousone•31m ago•0 comments

After six decades (of filming), the seminal series bows out with 70 Up

https://www.theguardian.com/tv-and-radio/2026/sep/07/seminal-series-ends-six-decades-70-up
1•evolve2k•31m ago•0 comments

Show HN: Qumra – Screen recorder that uploads while you record

https://qumra.io
1•trafargarlaw•34m ago•0 comments

Developers eye Native nations, tribal communities for new data center projects

https://alabamareflector.com/2026/09/06/repub/developers-eye-native-nations-tribal-communities-fo...
2•Teever•34m ago•0 comments

Reverse recruiting and the HR shift: what changes when talent also chooses

https://www.foxapply.com/blog/en/reverse-recruiting-hr-talent-also-chooses
1•josanjohnata•36m ago•0 comments