frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Motorola signature 27 is unveiled

https://motorolanews.com/motorola-signature-27/
1•Cider9986•49s ago•0 comments

Microdnf: Minimal Python-Free Dnf

https://github.com/rpm-software-management/microdnf
1•nateb2022•5m ago•0 comments

Getting the most out of Opus 5.5 in Claude and Claude Code

https://claude.dev/blog/getting-the-most-out-of-opus-5-5/
2•mfiguiere•9m ago•0 comments

Show HN: DynamicNotch – An interactive, customizable notch utility for macOS

https://github.com/Hitjack007/DynamicNotch
1•Hitjack007•10m ago•0 comments

Diesel prices could crush Republicans in the heartland

https://www.natesilver.net/p/diesel-prices-could-crush-republicans
5•7777777phil•11m ago•0 comments

Meta's Muse Drags Down Stocks That Depend on 'Consumer Inertia'

https://www.bloomberg.com/news/articles/2026-09-22/meta-s-muse-drags-down-stocks-that-depend-on-c...
1•garbawarb•11m ago•0 comments

Ask HN: When is fine-tuning a small LLM worth it?

4•kooldeep7•13m ago•0 comments

Are we going to use the same Desktop UX forever? [video]

https://www.youtube.com/watch?v=V7AfAcQwLW0
3•upboundspiral•13m ago•1 comments

Better prompt caching for GPT‑6

https://openai.com/index/better-prompt-caching-for-gpt-6/
2•mehrdadrad•16m ago•0 comments

S&P Global Enters Agreement to Acquire OpenZeppelin

https://www.openzeppelin.com/news/spglobal-enters-agreement-to-acquire-openzeppelin
1•wslh•17m ago•0 comments

Z.ai says sorry for slurping up your code, open sources ZCode

https://www.theregister.com/security/2026/09/22/zai-says-sorry-for-slurping-up-your-code-open-sou...
3•sbulaev•17m ago•0 comments

Bootstrapping Frontier AI Governance by Mutualizing Risk

https://www.lawfaremedia.org/article/bootstrapping-frontier-ai-governance-by-mutualizing-risk
1•tfehring•19m ago•0 comments

'Same sense of urgency': UN chief compares AI risk to nuclear weapons

https://www.smh.com.au/politics/federal/australia-joins-call-for-ai-safeguards-amid-warnings-of-o...
3•andrewstuart•19m ago•1 comments

Agent's Memory Needs a Retention Policy

https://memanto.ai/blog/your-agents-memory-needs-a-retention-policy
1•supportm•20m ago•0 comments

Hayek's Federalism and the Making of European Integration [pdf]

https://cosmosandtaxis.org/wp-content/uploads/2022/09/masini_ct_vol10_iss11_12.pdf
1•brandonlc•21m ago•1 comments

Are Meta's smart glasses training AI for robots?

https://proton.me/blog/meta-smart-glasses-ai-robots
1•dgellow•23m ago•0 comments

Show HN: Shrewd – what I learned distilling LLM labels into local classifiers

https://github.com/sshah03/shrewd
3•sshah03•24m ago•0 comments

Show HN: Riftri – copy-on-write Git worktrees for running agents in parallel

https://twitter.com/KinfishT/status/2102093551601684897
1•kinfish•26m ago•0 comments

The JavaScript Midlife Crisis

https://maroun-baydoun.com/blog/javascript-midlife-crisis/
6•maroun-baydoun•26m ago•2 comments

Ask HN: Ideas for getting more GitHub stars?

3•NatalieTrono•27m ago•1 comments

Open source tool for building hierarchical agent loops

https://github.com/plasma-ai/fractal
2•NatalieTrono•29m ago•0 comments

How the Barcode Was Invented

https://worldofsystems.co/invention-of-the-barcode/
1•eawosika•31m ago•1 comments

I built a tool that reverse engineers competitors SEO

https://www.rankshawk.com
2•fanel•31m ago•1 comments

Egress Testing – Server that records inbound TCP and UDP packets

https://portleak.link/
1•Xtrato•36m ago•1 comments

A16Z is challenging Silicon Valley's love for drop-outs by launching a school

https://techcrunch.com/2026/09/22/a16z-is-challenging-silicon-valleys-love-for-drop-outs-by-launc...
2•wslh•37m ago•2 comments

Reading specs beats reading code

https://technative.eu/en/blog/specgetty-introduction/
2•mipselaer•40m ago•1 comments

Native apps written in TypeScript and CSS

https://github.com/geastack/examples
20•arbayi•42m ago•1 comments

Agent manager now with mouse support

https://agent-manager.dev/writing/mouse-support/
5•Michaelov•43m ago•2 comments

Obscura: The first VPN that can't log your activity

https://obscura.com/#faq-technical
18•Flimm•44m ago•14 comments

AI Leaders Are Standing on a Liability Landmine

https://www.wsj.com/tech/ai/ai-leaders-are-standing-on-a-liability-landmine-736a8060
7•JumpCrisscross•44m ago•2 comments