frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Ask HN: What was the initial reaction to search engines?

1•hopa•1m ago•0 comments

SpaceX's near-term AI payoff seen tethered to Earth, not outer space

https://www.reuters.com/science/spacexs-near-term-ai-payoff-seen-tethered-earth-not-outer-space-2...
1•adithyaharish•5m ago•0 comments

The Unreasonable Effectiveness of LLMs in Mathematics

https://www.chrishayduk.com/p/the-unreasonable-effectiveness-of
2•rfv6723•11m ago•0 comments

Revisiting "The Great Mathematical Sputnik of 1979"

https://pubsonline.informs.org/do/10.1287/ORMS.2026.02.12
1•fforflo•14m ago•0 comments

The Graph That Should Be Front-Page News

https://www.lyrebirddreaming.com/post/the-graph-that-should-be-front-page-news
1•rakel_rakel•14m ago•0 comments

MCP gateway can't see most of what your agent does

https://onecli.sh/blog/mcp-gateway-is-not-enough
1•Jonathanfishner•17m ago•0 comments

Tired of Cloud Providers

1•unrealuci•17m ago•0 comments

Shooting Starlink: The "no limits" partnership between Russia and China is takin

https://theins.press/en/inv/294635
2•arunc•18m ago•0 comments

Think for Yourself

https://www.nybooks.com/articles/2026/06/25/think-for-yourself-ai-dan-chiasson/
1•1vuio0pswjnm7•18m ago•0 comments

Tim O'Reilly: Musk is building a form of capitalism that Adam Smith would hate

https://economist.com/by-invitation/2026/07/12/elon-musk-is-building-a-form-of-capitalism-that-ad...
1•uses•20m ago•0 comments

Sotheby's video showcases working Apple-1 serial number 01-0033

https://www.youtube.com/watch?v=NiOu3DL7t94
1•giuliomagnifico•26m ago•1 comments

Nuclear Fusion Ready for Commercialization?

https://abc7news.com/post/inertia-worlds-1st-fusion-factory-lawrence-livermore-national-laborator...
1•dd-sharma•30m ago•1 comments

Telling a tom from a snare with one microphone

https://drummate.app/blog/the-snare-has-wires
1•sashyo•30m ago•1 comments

Beavis Ultrasound PnP ISA Sound Card Replica

https://github.com/schlae/BeavisUltrasound
10•mariuz•34m ago•1 comments

Same agent tasks, 76% fewer LLM calls – we moved semantic cache inside the graph

https://github.com/insightitsGit/ChorusGraph/
2•insightits•35m ago•0 comments

Data Engineers Should Be Held to the Same Standards as Bakers

https://www.hermit-tech.com/blog/data-engineers-and-bakers
1•l0b0•39m ago•0 comments

Bob's Research, stock analysis, filings read for you

https://www.bobsresearch.com/
1•mrmarco•41m ago•0 comments

TwoMillionKit: Private Cloud Compute in FoundationModels without an entitlement

https://github.com/insidegui/TwoMillionKit
1•zdw•48m ago•0 comments

'Quality decays exponentially following AI arrival': Experts leaving in droves

https://www.techradar.com/pro/quality-decays-exponentially-following-ai-arrival-research-shows-ex...
1•Fricken•50m ago•0 comments

Red Hat's Project Lightwell. Interview with Mo Duffy

https://opensourcesecurity.io/2026/2026-07-lightwell-mo-duffy/
1•LaSombra•54m ago•0 comments

NyxOS

https://github.com/kazah-png/nyx-os
2•kazah•1h ago•2 comments

Ask HN: How long do you use your personal laptop before replacing it?

4•thallavajhula•1h ago•5 comments

Gleam for Python Programmers

https://third-bit.com/gl4py/
3•TheWiggles•1h ago•0 comments

Letl1en

1•l1en•1h ago•0 comments

Billionaire exodus? California drew 10x more venture capital than anyother state

https://www.latimes.com/business/story/2026-07-10/billionaire-exodus-california-attracted-10-time...
1•WarOnPrivacy•1h ago•1 comments

Is the top song on Australian radio AI-generated?

https://www.theguardian.com/music/2026/jul/13/josh-fawaz-like-a-prayer-song-is-it-ai-radio
3•sbulaev•1h ago•0 comments

Sticky Note Chrome Extension Turns Favorites into Multimedia Sticky Notes

https://chromewebstore.google.com/detail/sticky-note-web-clipper-s/gniilbpapgommpalikcclpcnbcamgila
1•taskloco_nyc•1h ago•0 comments

The Future Worth Building Is Human

https://thinkingmachines.ai/blog/the-future-worth-building-is-human/
1•gmays•1h ago•0 comments

The University in the AI Era

https://htmx.org/essays/universities-and-ai/
1•vismit2000•1h ago•0 comments

Comparing the Burn Ability of 4 Materials Used for Wall Insulation [video]

https://www.youtube.com/watch?v=CdItsso3ur0
1•nomilk•1h ago•0 comments