frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•6mo ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Tell HN: Being bullied by an Indian compliance automation platform

1•bitlad•8m ago•0 comments

Is $140k the real poverty line? A viral essay sparks debate

https://www.kron4.com/news/national/is-140000-the-real-poverty-line-a-viral-essay-sparks-debate/
2•gscott•8m ago•1 comments

Volcanic eruptions set off a chain of events that brought Black Death to Europe

https://www.cam.ac.uk/stories/volcanoes-black-death
1•gmays•9m ago•0 comments

Hire the Founder of TiddlyWiki

https://tiddlywiki.com
1•sogen•11m ago•0 comments

Phreeli: The Privacy-by-Design Mobile Carrier You Can Trust

https://finance.yahoo.com/news/meet-phreeli-privacy-design-mobile-170500820.html
1•MaysonL•11m ago•0 comments

Double Blind Armadillo: Cryptographic Architecture for Anonymous Phone Service [pdf]

https://www.phreeli.com/files/PhreeliDoubleBlindArmadilloWhitePaper.pdf
1•MaysonL•14m ago•0 comments

Intellectual Fly Is Open

https://bcantrill.dtrace.org/2025/12/05/your-intellectual-fly-is-open/
1•cyndunlop•15m ago•0 comments

Dotfiles Management

https://mitxela.com/projects/dotfiles_management
1•mhb•28m ago•0 comments

Theater Owners Worry Netflix Buying Warner Bros. Will Cripple Their Business

https://variety.com/2025/film/news/theater-owners-netflix-buying-warner-bros-fewer-movies-ted-sar...
2•mgh2•30m ago•1 comments

EU "Chat Control" Twist: Commissioner Sides with Parliament over Governments

https://www.patrick-breyer.de/en/eu-chat-control-twist-commissioner-sides-with-parliament-over-go...
1•walterbell•31m ago•0 comments

Show HN: Tiny Benchmarking Lib for Zig

https://github.com/pyk/bench
1•zigser•31m ago•0 comments

Show HN: Ogblocks – Create Jaw Dropping UIs with Simple Drag and Drop

https://ogblocks.dev/
1•karanzkk•34m ago•0 comments

James Cameron on AI in Hollywood

https://www.readtrung.com/p/james-cameron-on-ai-in-hollywood
1•sarego•38m ago•1 comments

Show HN: A New Language Compiler: Quark

https://github.com/quark-programming/quark
1•ephf•44m ago•0 comments

President Donald J. Trump Awarded "FIFA Peace Prize – Football Unites the World"

https://inside.fifa.com/campaigns/football-unites-the-world/news/president-trump-peace-prize-foot...
2•treetalker•44m ago•2 comments

How Kit Kat Was Killed: Video Shows What a Robot Taxi Couldn’t See

https://www.nytimes.com/2025/12/05/us/waymo-kit-kat-san-francisco.html
4•rl3•57m ago•0 comments

Quick Reminder: ADHD-Friendly

https://apps.apple.com/us/app/quick-reminder-adhd-friendly/id6756063126?mt=12
2•mraduldeodhiya•58m ago•1 comments

'We've been eating stink bugs for over 100 years'

https://www.theguardian.com/environment/2025/nov/21/turning-stink-bug-infestations-into-lunch-ind...
2•bookofjoe•1h ago•0 comments

Linux kernel source tree – with OpenPaX patch (rebased onto Linux-6.18.y)

https://github.com/quinndiggity/linux-openpax
2•openpax•1h ago•0 comments

Nook Browser

https://browsewithnook.com
14•ray__•1h ago•9 comments

Understanding Hytale Player Count: How to Find Active Servers

https://hytaletop100.com/blog/understanding-hytale-player-count-how-to-find-active-servers
1•doobie12•1h ago•0 comments

Visual Neuroscience: How Do Moths See to Fly at Night?

https://www.sciencedirect.com/science/article/pii/S0960982216000701#
2•andsoitis•1h ago•0 comments

Albert Michelson's Harmonic Analyzer (2014) [pdf]

https://engineerguy.com/fourier/pdfs/albert-michelsons-harmonic-analyzer.pdf
8•o4c•1h ago•2 comments

PalmOS on FisherPrice Pixter Toy

https://dmitry.gr/?r=05.Projects&proj=27.%20rePalm#pixter
4•dmitrygr•1h ago•1 comments

Have I been Flocked? – Check if your license plate is being watched

https://haveibeenflocked.com/
30•pkaeding•1h ago•8 comments

Show HN: Flexy – We Built a Faster Way to Get Small Dev Tasks Done

https://www.flexytasks.dev/
1•plakhlani2•1h ago•1 comments

Angel

https://en.wikipedia.org/wiki/Angel
1•marysminefnuf•1h ago•0 comments

Show HN: A small reasoning engine that learns rewrite rules from two examples

3•heavymemory•1h ago•3 comments

Jolla Launches Community-Funded Linux Phone

https://linuxiac.com/jolla-launches-community-funded-linux-phone/
6•embedding-shape•1h ago•1 comments

Building PagerDuty's SRE Agent

https://www.pagerduty.com/eng/context-over-cleverness-building-pagerdutys-sre-agent/
1•dadbod80•1h ago•0 comments