frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

I still like writing websites by hand

https://chenhuijing.com/blog/i-still-like-writing-websites-by-hand/
1•speckx•4s ago•0 comments

Bot Management for a Changing Internet

https://www.radiustech.xyz/blog/bot-management-for-a-changing-internet
1•madars•1m ago•0 comments

OpenAI let a mob of LLM agents game a test and ransack Hugging Face

https://arstechnica.com/security/2026/08/how-openai-let-a-mob-of-llm-agents-game-a-test-and-ransa...
1•joozio•2m ago•0 comments

Tailscale PAM beta: Manage connectivity and privileged access in one place

https://tailscale.com/blog/tailscale-pam-beta
1•iscmt•3m ago•0 comments

New book on System Design: is it any good?

https://books.lextrem.com/system-design-1/
1•hnque•5m ago•1 comments

Building a Functional Suitcase Car (Technically a Kart)

https://www.borninspace.com/building-a-functional-suitcase-car-technically-a-kart/
1•speckx•7m ago•0 comments

Ask HN: What's your career / life plan for the next few years?

1•tarikozket•8m ago•0 comments

200+ Deaths in the Nepal-Tibet Floods of Aug 26. These deaths were avoidable

https://mfe.respirer.in/hkh-glacier-watch/
1•ronzensci•8m ago•1 comments

Mobile phone dropped from SPACE remains intact thanks to record-breaking case

https://www.guinnessworldrecords.com/news/2026/8/mobile-phone-literally-dropped-from-space-remain...
1•ivell•9m ago•0 comments

Flock CEO gets his house blurred out on Google Maps and Zillow

https://twitter.com/LocumRex/status/2092993787605717176
7•lorecore•11m ago•2 comments

The Israeli Influence Machine [video]

https://www.youtube.com/shorts/fpeCldf7iyE
2•untitledsource•11m ago•0 comments

GitHub page when it was launched

https://web.archive.org/web/20080514210148/http://github.com/
1•prakashqwerty•12m ago•0 comments

A cited AI answer can still be wrong: the retrieval bug we found in ZettaVector

https://zettavector.com/blog/cited-ai-answer-can-still-be-wrong
1•warrowarro•14m ago•0 comments

Grok Bot for Linux: Unofficial port of the official app (open source)

https://github.com/jakob-bu/grok-bot-linux-unofficial
12•j-bu•14m ago•1 comments

Reverse Engineering My ADHD Test

https://nullpt.rs/reverse-engineering-adhd-test
3•hazebooth•14m ago•0 comments

Compromising Signal's Contact Discovery Enclave (SGX)

https://v12.sh/blog/signal
2•RobLach•14m ago•0 comments

InferCrane – Deploy and safely evolve self-hosted AI inference

https://github.com/infercrane/infercrane
2•yasintoy•15m ago•0 comments

Linux Foundation Submits OpenMDW AI License to Open Source Initiative

https://techstrong.ai/articles/linux-foundation-submits-openmdw-ai-license-to-open-source-initiat...
2•CrankyBear•16m ago•0 comments

How to Hack a Consulting Engineering Firm Using Social Engineering

https://www.itsecurityawareness.ie/news/89/
2•Rubayo•17m ago•0 comments

À break down of what a Token is and how to build a token calculator with Go

https://blog.devgenius.io/how-to-audit-ai-generated-code-with-the-go-standard-library-381d0f03d52...
2•cheikhdev•18m ago•0 comments

Dwarf Fortress is getting the mother of all magic updates

https://www.rockpapershotgun.com/dwarf-fortress-is-getting-the-mother-of-all-magic-updates-extend...
7•Tomte•19m ago•0 comments

Show HN: AiTells, a Vale style package for AI-written prose tells

https://github.com/krishnasunkam/vale-ai-tells
2•krishnas2020•19m ago•0 comments

Foundation Model 3x better at predicting cancer treatment

https://arxiv.org/abs/2608.24688
2•shcheklein•21m ago•0 comments

See fiber breaks linked to a map

https://react-networks-lib.rackout.net/otdr-strip
3•matt-p•26m ago•0 comments

Show HN: My Claude quota ran out in 10 minutes, so I made a tool to find out why

https://github.com/kelviq/tare
2•sachinneravath•26m ago•0 comments

OpenClaw: Maintainers Round Table [video]

https://www.youtube.com/watch?v=5VSwaUXtPIE
2•tosh•27m ago•0 comments

Braindump: Extract coding rules from PR review comments

https://github.com/pydantic/braindump
2•ThibWeb•28m ago•0 comments

Htdym (How to Deploy Your Model)

https://www.sailresearch.com/blog/htdym
2•bobstax•28m ago•0 comments

Our First Maintainers in Residence

https://blog.rust-lang.org/2026/08/26/announcing-our-first-maintainers-in-residence/
2•birdculture•28m ago•0 comments

Sandy – A sandbox for AI coding agents with monitoring and policy controls

https://github.com/kontext-security/sandy
2•mc-serious•30m ago•0 comments