frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•6mo ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

The Hundred-Year Language (2003)

https://www.paulgraham.com/hundred.html
1•swatson741•5m ago•0 comments

Bullsquid.com

https://bullsquid.com/
1•sergiotapia•6m ago•0 comments

Harley-Davidson Dealerships Are Shutting Down Across America

https://www.jalopnik.com/2029438/why-harley-davidson-dealerships-are-shutting-down/
2•bookofjoe•6m ago•0 comments

Why synthetic emerald-green pigments degrade over time

https://arstechnica.com/science/2025/11/why-synthetic-emerald-green-pigments-degrade-over-time/
1•pseudolus•12m ago•0 comments

Probing Chinese LLM Safety Layers: Reverse-Engineering Kimi and Ernie 4.5

https://zenodo.org/records/17681837
1•dennisdeman•12m ago•1 comments

A visual guide to Cloudflare Primitives

https://momito.co.uk/cloudflare-primitives/
2•NicoJuicy•13m ago•0 comments

A Cell So Minimal That It Challenges Definitions of Life

https://www.quantamagazine.org/a-cell-so-minimal-that-it-challenges-definitions-of-life-20251124/
2•pseudolus•16m ago•0 comments

Show HN: My first published app – track contraception ring cycle

https://apps.apple.com/us/app/lunella/id6755366887
2•matsucks•21m ago•0 comments

Australia establishes new institute to strengthen AI safety

https://www.industry.gov.au/news/australia-establishes-new-institute-strengthen-ai-safety
1•ajdlinux•21m ago•0 comments

AWS's Project Rainier: the most powerful computer for training AI

https://www.aboutamazon.com/news/aws/aws-project-rainier-ai-trainium-chips-compute-cluster
2•kristianp•22m ago•0 comments

The Cost of Resetting a Password

https://www.pwndefend.com/2025/11/22/the-cost-of-resetting-a-password/
2•gm678•24m ago•0 comments

John Searle's Campus War

https://fusionaier.org/2025/john-searles-campus-war/
1•B1FF_PSUVM•27m ago•0 comments

EPA just approved new 'forever chemical' pesticides for use on food

https://www.washingtonpost.com/climate-environment/2025/11/22/forever-chemicals-pesticides/
6•measurablefunc•28m ago•3 comments

Show HN: Bringing stacked diff workflow to Perforce

https://github.com/minhkhoango/p4-stack
1•kai2006•31m ago•0 comments

MCP Ultimately Leads to Closed Gardens

https://chatbotkit.com/reflections/mcp-ultimately-leads-to-closed-gardens
2•_pdp_•36m ago•0 comments

New software toolbox enables brain-like models to learn directly from data

https://www.biorxiv.org/content/10.1101/2024.08.21.608979v2
1•PaulHoule•37m ago•0 comments

Kimchi's Immune System Benefits

https://www.nature.com/articles/s41538-025-00593-7
4•DaveZale•38m ago•0 comments

We Built the v0 iOS App

https://vercel.com/blog/how-we-built-the-v0-ios-app
3•MaxLeiter•40m ago•0 comments

Have You Considered Load-Bearing Shell History? (2022)

https://blog.tjll.net/load-bearing-shell-history/
3•wonger_•40m ago•0 comments

Terraform Industries' Business Case Doesn't Add Up

https://klaasnotfound.com/2025/06/03/terraform-industries-business-case-doesnt-add-up/
1•verzali•41m ago•0 comments

A tool for dealing with GPS time in Ns

https://andrew.diamonds/gpsnanos
1•andrewxdiamond•43m ago•0 comments

Show HN: Realtime, expressive AI personas that you can video call

https://playground.keyframelabs.com/playground/persona-1-live
3•kraddypatties•46m ago•2 comments

Ask HN: GitHub vs. self-hosted forges – What's your first impression?

2•bitbasher•48m ago•1 comments

We're Helping Companies Turn Open Source Contributions into Hiring

https://issuepay.app
1•Mario10•48m ago•1 comments

The Web Install API is ready for testing

https://blogs.windows.com/msedgedev/2025/11/24/the-web-install-api-is-ready-for-testing/
2•syx•53m ago•0 comments

Avian Influenza H5N5 Washington Death

https://www.idse.net/Influenza/Article/12-25/First-Person-Dies-From-H5N5-Bird-Flu/78941
4•howard941•55m ago•0 comments

One of the Greatest Polar-Bear Hunters Confronts a Vanishing World

https://www.newyorker.com/magazine/2025/12/01/one-of-the-greatest-polar-bear-hunters-confronts-a-...
2•bookofjoe•59m ago•1 comments

Launching the Genesis Mission

https://www.whitehouse.gov/presidential-actions/2025/11/launching-the-genesis-mission/
2•oidar•59m ago•0 comments

A P2P Grindr alternative I built in a weekend: no server, no accounts

https://meateor2.netlify.app/
1•guiprav•1h ago•1 comments

Pornhub Is Urging Tech Giants to Enact Device-Based Age Verification

https://www.wired.com/story/pornhub-is-urging-tech-giants-to-enact-device-based-age-verification/
3•toomuchtodo•1h ago•1 comments