frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Show HN: ParkourNote – A research workspace, built solo in a month with Claude

https://note.parkourlabs.io/
1•sushiwang•6m ago•0 comments

Show HN: Help us fire our UI/UX designers

https://vosu.ai
1•nafisfaysal•8m ago•1 comments

MiniMax M3.1-Flash-Preview

https://twitter.com/MiniMaxAgent/status/2104079819881517400
1•shenli3514•8m ago•0 comments

Alibaba Cloud Joins as a Founding Corporate Patron with $3M

https://omarchy.org/news/2026/09/alibaba-cloud-joins-as-founding-corporate-patron/
2•felixfurtak•9m ago•1 comments

Opening Up New Possibilities for "Blue" in Roses: New Findings on Copigmentation

https://www.suntory.com/sic/story/20260911
1•crescit_eundo•11m ago•0 comments

Cambrian Explosion of AI

https://debarshibasak.github.io/readables/blogs/cambrian-explosion
1•debarshri•11m ago•0 comments

OllamaMQ v0.5.0 – supports SystemOne APIs

1•chleba•21m ago•0 comments

The Truth Physics Can No Longer Ignore

https://www.theatlantic.com/science/2025/12/physics-life-reductionism-complexity/685257/
2•jdkee•21m ago•1 comments

How do I promote an anti AI slop tool I built? It's free and genuine

1•arpanghoshal•29m ago•1 comments

Turning My PS3 into a Moonlight Streaming Host, and Building with LLMs

https://kenmyers.io/posts/ps3-moonlight
2•bruhfeefee•32m ago•0 comments

Show HN: Novrl, clickable product demos from screenshots, no account needed

https://novrl.com/
1•dylan_builds•36m ago•0 comments

Thorsten Ball – What I believe about the future of software development

https://thorstenball.com/blog/2026/09/19/what-i-believe-about-the-future-of-software-development/
4•Helithumper•37m ago•1 comments

Is Life Itself a State of Matter?

https://thereader.mitpress.mit.edu/is-life-itself-a-state-of-matter/
2•pseudolus•38m ago•0 comments

Trust No Bot

https://trustnobot.com
2•kevinmannix•41m ago•1 comments

Is open source contribution still relevant?

1•cipherdc•42m ago•2 comments

How to Know When the AI Boom Is About to Go Bust

https://www.wsj.com/finance/stocks/how-to-know-when-the-ai-boom-is-about-to-go-bust-61af3d26
3•1vuio0pswjnm7•43m ago•0 comments

Show HN: DeepFace is now running on PyTorch alongside TensorFlow

https://github.com/serengil/deepface
1•serengil•43m ago•0 comments

How a Zig IDE Could Work

https://matklad.github.io/2023/02/10/how-a-zig-ide-could-work.html
1•birdculture•46m ago•0 comments

European industry is doing better than you may think

https://www.economist.com/business/2026/09/27/european-industry-is-doing-better-than-you-may-think
2•andsoitis•47m ago•0 comments

San Francisco Bay Area faces potential death spiral of transit system

https://www.theguardian.com/us-news/2026/sep/26/san-francisco-bay-area-public-transportation-bart
1•andsoitis•48m ago•0 comments

Thread-identity switcheroo for io_uring

https://lwn.net/SubscriberLink/1094303/bf025f98cb71f941/
2•chmaynard•49m ago•0 comments

Windows Developer Config

https://github.com/microsoft/WindowsDeveloperConfig
1•wontoncc•50m ago•0 comments

Flux 3 Action: A 7B open-weight world action model for robots

https://huggingface.co/blog/black-forest-labs/flux-3-action
3•fourfire•52m ago•0 comments

Show HN: DynamicNotch – An interactive, customizable notch utility for macOS

https://github.com/Hitjack007/DynamicNotch
2•Hitjack007•58m ago•0 comments

Show HN: Agenttab – Status Icons for Claude Code, Codex and OpenCode Tabs

https://github.com/marciob/agenttab
1•marciob•59m ago•0 comments

How do you turn a random idea into a good X post?

https://hokly.vercel.app
1•Raimundoevita•1h ago•0 comments

Gold-rich Nicaragua hands Chinese miners rights to a tenth of its land

https://www.ft.com/content/452648fd-90d6-450f-9739-073f5b6a0d18
3•JumpCrisscross•1h ago•0 comments

Judge orders release of records on Nazi war criminals who settled in Canada

https://ottawacitizen.com/public-service/defence-watch/judge-orders-release-of-records-on-nazi-wa...
16•Teever•1h ago•2 comments

Leaked Gemini 4 Pro numbers

https://www.reddit.com/r/GoogleGeminiAI/comments/1wqze2k/looking_at_the_leaked_gemini_4_pro_numbe...
1•simonpure•1h ago•1 comments

What Happened in Austin

https://www.freerange.city/p/what-happened-in-austin
2•JumpCrisscross•1h ago•0 comments