frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

The Harness Eats Everything

https://spock.is/writing/the-harness-eats-everything
1•BenediktHolm•3m ago•0 comments

Fragment of oldest known peace treaty found in Turkey

https://www.livescience.com/archaeology/ancient-egyptians/we-have-found-traces-of-peace-thousands...
1•gmays•4m ago•0 comments

AI messaging scam costs Italy's top bank Intesa millions, sources say

https://www.reuters.com/legal/government/ai-messaging-scam-costs-italys-top-bank-intesa-millions-...
1•gbocs•5m ago•0 comments

In an $80 Motel Room, a Discovery to Shed Light on the Origins of Life

https://www.nytimes.com/2026/09/26/science/motel-science-discovery.html
2•danso•9m ago•1 comments

Active speaker detection for deaf and hard-of-hearing

https://captivision.app/
1•trobifi•11m ago•0 comments

How do you compare religions?

https://plurilore.com
1•nickvicman•11m ago•0 comments

All you need is accessibility

https://maheepk.net/posts/accessibility/
1•technusm1•12m ago•0 comments

Show HN: AI agent running cost calculator (and when a SaaS platform is cheaper)

https://broutonlab.com/calculators/how-much-does-an-ai-agent-cost/
1•myurushkin•13m ago•0 comments

Who Killed Paulina Borsook's Career?

https://www.wired.com/story/paulina-borsook-profile/
2•danielmorozoff•15m ago•0 comments

Ask HN: In 3 months 4300 Dowloads but only 100 Stars, what I need to do?

2•Arshad-Talpur•18m ago•1 comments

AI and the Fall? Of the Creative Class

https://www.apricitas.io/p/ai-and-the-fall-of-the-creative-class
2•m-hodges•23m ago•0 comments

Shame and snobbery as American students blamed for St Andrews classism

https://www.theguardian.com/education/2026/sep/27/st-andrews-university-class-divide-american-stu...
2•jimnotgym•23m ago•0 comments

Cashing in on Dust

2•spottedmarley•24m ago•0 comments

>1B tokens/minute/GPU by combining query planner and inference engine

https://modal.com/blog/quail-billion-tpm
1•birdculture•27m ago•0 comments

Software occlusion culling in Block Game

https://enikofox.com/posts/software-rendered-occlusion-culling-in-block-game/
1•airhangerf15•32m ago•0 comments

'Gaming pays me double what I earned as a teacher'

https://www.bbc.com/news/articles/cwe8eje6zny7o
2•theanonymousone•33m ago•1 comments

A Vindication of Bjorn Lomborg

https://humanprogress.org/a-vindication-of-bjorn-lomborg/
1•mpweiher•34m ago•0 comments

New generation of Business analytics Intelligence

https://blunxai.com/
1•rima_667•34m ago•1 comments

Minecraft developer found dead in his home in Paraná, Brazil (portuguese)

https://www.correio24horas.com.br/brasil/desenvolvedor-dos-jogos-minecraft-batman-e-the-walking-d...
2•danielt3•35m ago•1 comments

My development setup. A pivot toward terminal and dotfiles

https://besok.github.io/posts/my-development-setup/
3•besok•35m ago•0 comments

Ask HN: How are you getting inference for personal projects?

1•variety8675•37m ago•2 comments

Maplibre-Gl-Lanes v1.0.0

https://nuxx.net/blog/2026/09/27/maplibre-gl-lanes-v1-0-0/
2•c0nsumer•37m ago•0 comments

Show HN: A deterministic tool-call gateway vs. prompt-injection classifiers

https://github.com/Yehielamor/provenance-gate/blob/main/posts/01-provenance-vs-detection.en.md
1•YehielAmor•38m ago•0 comments

Sourced tracker for Tasmania's proposed AI data centres

https://tasdatacentres.org/30min/
1•demodefib•40m ago•0 comments

Can a practitioner's judgment be shipped as a text file?

https://grace.training/
2•pvachon•40m ago•0 comments

Quantum computing's "dark horse" just proved it can go universal

https://www.sciencedaily.com/releases/2026/09/260924020403.htm
2•arto•40m ago•0 comments

Jev and the Return of AI/ML Engineering

https://leehanchung.github.io/blogs/2026/09/20/jev-return-ai-ml-engineering/
2•mustaphah•51m ago•0 comments

Ask HN: What task manager do you use? What do you miss on them?

1•KlyX•54m ago•0 comments

Colyseus – Real-Time Multiplayer Framework for Node.js

https://colyseus.io/
1•eustoria•54m ago•0 comments

Show HN: I spent 10 months building a Markdown editor for Mac, iOS and web

https://www.markdown.beauty/
5•thiagoperes•55m ago•5 comments