frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Barings, Boeing, and Bots: The Promises and Perils of Delegation

https://www.spinellis.gr/blog/20260715/
1•DSpinellis•1m ago•0 comments

California colleges spend millions on faulty AI systems'The chatbot is outdated'

https://themarkup.org/machine-learning/2026/03/07/california-colleges-spend-millions-on-faulty-ai...
1•Jimmc414•1m ago•0 comments

Ban commits/transactions using AST analysis and linters

https://www.droppedasbaby.com/posts/db-commits/
1•offbyone42•1m ago•0 comments

Garry Tan to Keynote the SF Ruby Startup Conference

https://evilmartians.com/events/sf-ruby-startup-conference-2026
1•camimirabal•1m ago•0 comments

What your tears could reveal about your brain

https://www.acs.org/pressroom/presspacs/2026/july/what-your-tears-could-reveal-about-your-brain.html
1•gmays•2m ago•0 comments

The form asked my permission to share my health data. It wouldn't let me say no

https://themarkup.org/privacy/2026/05/27/opt-out-dark-patterns
2•Jimmc414•2m ago•0 comments

Winged robot "puffin" can fly starting from the water

https://www.nytimes.com/2026/07/14/science/new-winged-robot-can-fly-and-swim-like-a-puffin.html
1•marojejian•2m ago•1 comments

Show HN: Fork – Customize the web, just by asking

https://withfork.co
1•dhanaway518•2m ago•0 comments

OnePlus to Pull Out of American and European Markets

https://www.macrumors.com/2026/07/15/report-oneplus-to-pull-out-of-us-and-europe/
2•ericmay•2m ago•0 comments

Show HN: 3-line calendar for Apple Watch – free, open source, no sign-in

https://threelinecal.apps.zzn.im/
1•xinbenlv•3m ago•0 comments

Primate Is the Last Great Web Framework

https://superarch.org/theanswerisc/primate-is-the-last-great-framework.html
3•terrablue•3m ago•0 comments

The Looting of Science Fiction

https://aeon.co/essays/silicon-valley-has-a-science-fiction-problem
2•robtherobber•4m ago•0 comments

A General Goal-Conditioned Minecraft Model

https://pantograph.com/journal/pan-1
1•agajews•4m ago•0 comments

PayPal stock soars as Stripe, Advent make $53B takeover offer

https://www.cnbc.com/2026/07/15/stripe-advent-offer-to-buy-paypal-for-more-than-53-billion-reuter...
2•edward•4m ago•0 comments

Ode

https://www.ode.com/
2•tosh•5m ago•0 comments

OpenAI's first hardware product is the $230 Codex Micro macropad by Work Louder

https://thenewstack.io/openai-codex-micro-macropad/
1•thoughtpeddler•5m ago•0 comments

Collection of Digital Clock Designs

https://clocks.dev
2•levmiseri•6m ago•0 comments

Show HN: I Built a Capture the Flag Arena for Agents

https://lab.clayseal.com/
1•yuvvantalreja•6m ago•0 comments

ChatGPT now defaults to Codex instead of chat:(

2•amukbils•7m ago•1 comments

FreeBSD 16 Retires the Last of Its GPL Code from Its Base System

https://www.phoronix.com/news/FreeBSD-16-Goes-GPL-Free
4•lr0•7m ago•0 comments

The Linux.org story

https://lwn.net/Articles/1082901/
3•Brajeshwar•8m ago•0 comments

SpaceX stock sinks below $135 IPO price for the first time

https://www.cnbc.com/2026/07/15/spacex-spcx-stock-ipo-price.html
2•abduhl•8m ago•0 comments

Hedos – Local models in one native Mac app (llama.cpp, MLX, diffusers)

https://www.hedos.ai/
1•theiskaa•12m ago•0 comments

Psion's Potter says Amazon may "flop" (1999)

https://www.theregister.com/on-prem/1999/06/22/psions-potter-says-amazon-may-flop/1523694
2•bookofjoe•12m ago•0 comments

Nano Banana 2 Lite Review

https://developer.puter.com/blog/nano-banana-2-lite-puter-js/
1•reynaldi•12m ago•0 comments

We Analyzed 137K Sites: 97% of Llms.txt Files Never Get Read

https://ahrefs.com/blog/llmstxt-study/
1•mooreds•12m ago•0 comments

TeleBrain – turn your Telegram chats into a synthesized wiki with proof

https://telebrain.ai
2•brothaakhee•12m ago•1 comments

Show HN: Lineation – One security control plane for all agents

https://lineation.ai
3•camsjams•13m ago•1 comments

As a dev, would you use a form backend tool?

2•danilovilhena•15m ago•0 comments

Show HN: Ty-extended – a Ty fork with plugin support

https://github.com/regularkevvv/ty-extended
2•demoonkevin•15m ago•0 comments