frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

The Digger disaster: what an epic movie flop means for Tom Cruise and Hollywood

https://www.theguardian.com/news/ng-interactive/2026/oct/17/the-digger-disaster-what-an-epic-movi...
1•amrrs•1m ago•0 comments

Speeding up code review with `small-change`

https://lethain.com/small-changes/
1•gpi•3m ago•0 comments

Experience with the Molten-Salt Reactor Experiment (1970) [pdf]

https://media.githubusercontent.com/media/openmsr/msr-archive/master/docs/NAT_MSREexperience.pdf
1•fedecaccia•5m ago•0 comments

I Became a Citizen of Japan

https://www.derekwessman.com/blog-1/natural
3•luu•6m ago•0 comments

Show HN: Bitty – Turn AI coding wait time into brain breaks

https://playbitty.com/
2•ayush23dash•9m ago•1 comments

Show HN: GoRoute – Ultra-Lightweight LLM Gateway in Go (<15MB RAM)

https://github.com/ziuus/goroute
2•noelyt101•13m ago•0 comments

Show HN: Atari Gravitar in VR

https://gravitar-vr.github.io
3•smoothwater8912•14m ago•0 comments

Show HN: I reverse engineered serum 2 and build an open source alternative

https://github.com/itsfabioroma/tessera
1•ofabioroma•22m ago•0 comments

OpenCode: Potential provider key breach [Reddit]

https://www.reddit.com/r/opencode/comments/1x8bas3/they_fd_up_breach/
7•tobwen•22m ago•0 comments

Harvard's 1869 Entrance Exam [pdf]

https://graphics8.nytimes.com/packages/pdf/education/harvardexam.pdf
6•haunter•23m ago•0 comments

A Prosthesis for the Mind

https://medium.com/@smoking2man/a-prosthesis-for-the-mind-9ef2e677236e
2•Aldus551•25m ago•0 comments

Elon Musk's foundation is opaque, miserly and self-serving

https://www.economist.com/business/2026/10/13/elon-musks-foundation-is-opaque-miserly-and-self-se...
11•kensai•26m ago•2 comments

JetBrains Junie Local: An agent you own, not one you rent

https://junie.jetbrains.com/
3•LelouBil•26m ago•1 comments

Everything We Know About Facebook's Mood Manipulation Experiment (2014)

https://www.theatlantic.com/technology/archive/2014/06/everything-we-know-about-facebooks-secret-...
1•r721•26m ago•1 comments

Show HN: Flying rocket car x Flappy Bird

https://bs.fyi/arcade/flying-car
1•drchiu•27m ago•0 comments

Detecting Filesystem Capability Laundering in MCP Servers at Scale

https://arxiv.org/abs/2610.22301
1•ersinesen•27m ago•0 comments

TikTok "Permanently Suspends" the 'Musk' Film Account, Raising Suppression Fears

https://www.hollywoodreporter.com/news/politics-news/musk-movie-tiktok-banned-theaters-showtimes-...
6•softwaredoug•27m ago•0 comments

Linux bugs fixed per release over time: >2× rise since 2026-04

https://lwn.net/Articles/1088776/
5•farlight•28m ago•0 comments

What Makes Art Great?

https://nabeelqu.substack.com/p/what-makes-art-great
3•matteohorvath•28m ago•0 comments

Implant can restore sight for patients with macular degeneration

https://www.technologyreview.com/2026/10/16/1145840/prima-implant-restores-sight-macular-degenera...
2•joozio•29m ago•0 comments

Some of my recent talks and interviews

https://terrytao.wordpress.com/2026/10/17/some-of-my-recent-talks-and-interviews/
2•smilelamp•31m ago•0 comments

tsc-ts: TypeScript written in TypeScript

https://github.com/vercel-labs/tsc-ts
3•tosh•31m ago•1 comments

Show HN: UOS – a workspace the server can't read (post-quantum, E2EE)

https://uos.sh/whitepaper/
2•ultimaos•31m ago•0 comments

Show HN: Would You Merge It? – 24 bugs AI assistants write, as fix-it katas

https://github.com/SohailKhan0525/would-you-merge
2•qofenolabs•32m ago•0 comments

Tennyson's Faith: A Nobler Type

https://hedgehogreview.com/issues/the-fading-promise-of-higher-education/articles/tennysons-faith
2•prismatic•32m ago•0 comments

Texas Has Been Considering Selling a Beloved State Park to Elon Musk's SpaceX

https://www.texasmonthly.com/news-politics/boca-chica-spacex-elon-musk/
6•malshe•32m ago•0 comments

Show HN: Setforge – free lifting tracker for iPhone/Watch that counts reps

https://testflight.apple.com/join/kXfU8bRv
2•yashsinghal0316•33m ago•0 comments

Gold is Now the Top U.S. Export

https://www.numismaticnews.net/gold-now-top-u-s-export
4•iamnothere•36m ago•0 comments

EU plans to fast-track antitrust approval of SpaceX rival

https://finance.yahoo.com/economy/policy/articles/eu-plans-fast-track-antitrust-183153257.html
6•malshe•37m ago•1 comments

$1.5B data centre for Canada's cyber spy agency to be built in Ottawa area

https://www.ctvnews.ca/ottawa/article/data-centre-for-canadas-cyber-spy-agency-to-be-built-in-ott...
3•Teever•38m ago•1 comments