frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•6mo ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Tell HN: I want open AI to succeed for the sake of humanity

1•totaldude87•1m ago•0 comments

30 things I've learned from 30 years as a Python freelancer

https://lerner.co.il/2025/12/08/30-things-ive-learned-from-30-years-in-business/
1•reuven•1m ago•0 comments

AWS introduces Graviton5–the company's most powerful and efficient CPU

https://www.aboutamazon.com/news/aws/aws-graviton-5-cpu-amazon-ec2
1•ksec•1m ago•0 comments

Elysia Chlorotica

https://en.wikipedia.org/wiki/Elysia_chlorotica
1•thunderbong•2m ago•0 comments

Ruby devs earn more than average devs

1•pogrebnoy•2m ago•0 comments

Symfony 8 Released

https://symfony.com/8
1•BafS•2m ago•0 comments

They have to be able to talk about us without us

https://www.anildash.com/2025/12/05/talk-about-us-without-us/
1•lalitmaganti•3m ago•0 comments

Building Secure C++ Applications: A Practical End-to-End Approach [video]

https://www.youtube.com/watch?v=GtYD-AIXBHk
1•BiraIgnacio•6m ago•0 comments

OCI Artifacts Explained

https://oneuptime.com/blog/post/2025-12-08-oci-artifacts-explained/view
2•ndhandala•6m ago•0 comments

How to get to Chennai cheaply and plan a smooth holiday trip

https://medium.com/@ameliadaltonone/cheap-flights-to-india-chennai-family-travel-tips-for-an-unfo...
1•belatwing•6m ago•1 comments

Alignment Is Capability

https://www.off-policy.com/alignment-is-capability/
1•drctnlly_crrct•7m ago•0 comments

Building a custom Ghost theme with AI (and leaving Substack)

https://dannb.org/blog/2025/newsletter-ghost-theme-tour/
1•dannb•8m ago•0 comments

Bit flips: How cosmic rays grounded a fleet of aircraft

https://www.bbc.com/future/article/20251201-how-cosmic-rays-grounded-thousands-of-aircraft
1•signa11•10m ago•0 comments

Can You Believe the Documentary You're Watching?

https://www.nytimes.com/2025/11/18/movies/documentary-filmmaking-ai-trust.html
1•bookofjoe•11m ago•1 comments

Show HN: YM2149-rs – Chiptune sound synthesis in Rust

https://ym2149-rs.org/
1•slippyvex•12m ago•0 comments

Parallel Development with Git Worktree and LLMs

https://news.ycombinator.com/from?site=matada.org
1•matada_•15m ago•0 comments

IBM Nears Roughly $11B Deal for Confluent

https://www.wsj.com/business/deals/ibm-nears-roughly-11-billion-deal-for-confluent-276f52d8
2•nycdatasci•16m ago•0 comments

Are EV Drivers at Risk from Radiation? A New Study Has the Answers

https://www.carscoops.com/2025/11/are-ev-drivers-at-risk-from-radiation/
1•ksec•16m ago•1 comments

IBM to Acquire Confluent

https://newsroom.ibm.com/2025-12-08-ibm-to-acquire-confluent-to-create-smart-data-platform-for-en...
2•bbzjk7•16m ago•0 comments

Pantone Color of the Year 2026: Pantone 11-4201 Cloud Dancer

https://www.pantone.com/color-of-the-year/2026
2•ksec•17m ago•0 comments

Show HN: Axo Pass – Unlock SSH/GPG Keys and Secrets with Touch ID on macOS

https://github.com/axo-sh/axo-pass
2•octavore•17m ago•0 comments

Colors of Growth

https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5804462
2•mhb•18m ago•1 comments

Listened to your feedback, Critical CSS Generator now for SPA and inline CSS

https://kigo.studio/tools/critical-css-generator
1•stevenpotts•18m ago•1 comments

Ridge and Lasso Math Deep Dive

https://zaurtarunov.substack.com/p/ridge-and-lasso-from-scratch
1•taruza•18m ago•0 comments

Going Loopy

https://xania.org/202512/08-going-loopy
1•hasheddan•19m ago•0 comments

Python cold start improvements – Cloudflare Workers

https://developers.cloudflare.com/changelog/2025-12-08-python-cold-start-improvements/
2•NicoJuicy•19m ago•1 comments

TicketSwap Bot

1•lkka•20m ago•0 comments

Show HN: Liora Gallery – Minimal self-hosted photo portfolio

https://photos.jannchie.com/
1•jannchie•20m ago•0 comments

Netflix Considered Buying EA

https://www.bloomberg.com/news/articles/2025-12-07/netflix-co-ceo-ted-sarandos-wooed-trump-person...
1•HelloUsername•20m ago•0 comments

Netflix's $72B Warner Bros deal could shrink both companies

https://ericlamb.substack.com/p/netflix-warner-bros-and-the-deal
2•ericlamb89•21m ago•0 comments