frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Getting started with Neovim – PDE p.I

https://xnacly.me/posts/2022/neovim-ped-1/
1•ibobev•15s ago•0 comments

Show HN: Durable Workflow 2.0 polyglot workflows in PHP, Python and Rust

https://github.com/durable-workflow/sample-app
1•rmcdaniel•25s ago•0 comments

The IBM PC, Part 2: Tsunami – Creatures of Thought

https://technicshistory.com/2026/08/29/the-ibm-pc-part-2-tsunami/
1•rbanffy•1m ago•0 comments

Private group wants to launch "cheapest possible" mission to Alpha Centauri

https://arstechnica.com/space/2026/09/private-group-wants-to-launch-cheapest-possible-mission-to-...
1•rbanffy•2m ago•0 comments

Please stop calling databases CP or AP (2015)

https://martin.kleppmann.com/2015/05/11/please-stop-calling-databases-cp-or-ap.html
1•deadletterq•2m ago•0 comments

Show HN: MQLens – A Native MongoDB GUI (SSH, X.509, Kerberos, No Electron)

https://mqlens.com/
1•deveshk0•3m ago•0 comments

Attention Is All You Need, with a real transformer running in the page

https://onehop.world/
2•timratl•3m ago•1 comments

Tempe scraps Axon agenda item after license plate reader mix-up

https://www.azfamily.com/2026/09/01/tempe-scraps-axon-agenda-item-after-license-plate-reader-mix-up/
1•imzadi•4m ago•0 comments

Xavlegbmaofffassssitimiwoamndutroabcwapwaeiippohfffx

https://en.wikipedia.org/wiki/Xavlegbmaofffassssitimiwoamndutroabcwapwaeiippohfffx
1•doener•4m ago•0 comments

Who Hosts the HN Top 100?

https://hn-hosting.up.railway.app
1•phineyes•4m ago•0 comments

Show HN: Swoff – I built the most comprehensive PWA assets generator

https://assets.swoff.space
1•iamsuudi•5m ago•0 comments

Mklinux Multikernel: Run several Linux kernels at once, bare metal, no VT-x

https://lore.kernel.org/lkml/ao34RJ7aZ2BLd67S@pop-os.localdomain/
2•harvie•6m ago•1 comments

Improving our alignment and security efforts

https://www.anthropic.com/news/improving-alignment-security-efforts
2•jbegley•7m ago•1 comments

Show HN: Open-sourced runtime for better Codex and Claude subagent experience

https://github.com/ringlochid/oh-my-subagents
3•ringlochid•10m ago•1 comments

Show HN: Manzanas - a dozen iOS simulators on one Mac, leased to coding agents

https://github.com/BariBariGood/manzanas
1•baribarigood•10m ago•0 comments

Show HN: Indexflow-SEO – A lightweight SEO analyzer written in Rust

https://github.com/IndexFlowing/IndexFlow-core/tree/main/crates/indexflow-seo
1•mandarinclips•10m ago•1 comments

Timeline of the Far Future

https://en.wikipedia.org/wiki/Timeline_of_the_far_future
2•Bluestein•10m ago•1 comments

I Built My Agent Computer in the Cloud

https://www.hadijaveed.me/2026/08/27/agent-computer-in-the-cloud/
1•hjaveed•11m ago•0 comments

Dyson made a camera-equipped toothbrush that flosses for you

https://www.theverge.com/tech/986737/dyson-camerajet-smart-toothbrush-live-camera-flosser-pricing...
3•WalterSobchak•12m ago•1 comments

Kernel/hypeman: A multi-hypervisor VM runtime for OCI images

https://github.com/kernel/hypeman
1•tilt•12m ago•0 comments

Clibo – A beautiful, keyboard-first, privacy focused clipboard manager for macOS

https://clibo.app/
1•pawelborkar•13m ago•0 comments

Hs of HTML

https://alvaromontoro.com/blog/68111/the-4-hs-of-html
1•speckx•14m ago•0 comments

HEPA air purifiers may boost brain function after just one month

https://www.sciencedaily.com/releases/2026/08/260830000016.htm
3•_____k•15m ago•0 comments

Show HN: SQLFlow (DuckDB for streaming data) Go Rewrite 10x Throughput

https://turbolytics.io/products/sqlflow/benchmarks/
1•dm03514•16m ago•0 comments

Show HN: Haserupt – A different way to reduce your phone usage

https://www.haserupt.com
2•vishalds•17m ago•1 comments

Show HN: Use AI to make fun of other AI

https://claude-code-buster.web.app/play3
1•ferb900•17m ago•0 comments

EFF to Courts: Don't Rewrite Copyright over AI Hype

https://www.eff.org/deeplinks/2026/08/eff-courts-dont-rewrite-copyright-over-ai-hype
11•DeepLogin•18m ago•3 comments

Accessibility Is Resistance

https://tink.uk/accessibility-is-resistance/
1•speckx•22m ago•0 comments

Show HN: AICademy – AI you learn by doing the job you have

https://ragentic.netlify.app/
1•AjyW88•22m ago•0 comments

Invisible Companies

https://colossus.com/article/invisible-companies/
2•ltononro•23m ago•0 comments