frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Airbnb Sets New Rules That Limit Checkout Chores

https://www.airbnb.com/help/article/4168
1•chirau•3m ago•1 comments

Building an AmigaOS Development Environment in 2026

https://turtleware.eu/posts/Building-an-AmigaOS-Development-Environment-in-2026.html
1•andsoitis•4m ago•0 comments

Canadian cyber executive charged in federal hacking case

https://www.politico.com/news/2026/10/09/canadian-cyber-executive-charged-in-federal-hacking-case...
1•paulpauper•6m ago•1 comments

Kevlar = MCP Firewall for LLM's

https://github.com/Ablation-Tool/kevlar
1•zellkernel•11m ago•0 comments

The Hackening

https://thezvi.substack.com/p/the-hackening
3•paulpauper•24m ago•0 comments

Solving Postgres' Count Problem

https://www.paradedb.com/blog/opening-a-closed-tin-part-2
1•philippemnoel•26m ago•0 comments

WikiCity – Explore 100k Wikipedia Articles as a 3D City

https://wikicity.app
1•gnabgib•26m ago•0 comments

Finding Flaws in Technical Documentation

http://paddy3118.blogspot.com/2026/10/finding-flaws-in-technical-documentation.html
1•lumpa•32m ago•0 comments

Club Cobra's Instagram page returns after 9-month battle with Meta

https://qvoicenews.com/2026/09/23/club-cobras-instagram-page-returns-after-9-month-battle-with-meta/
1•gnabgib•33m ago•0 comments

Show HN: Call4me – a ChatGPT plugin that lets it make phone calls on your behalf

https://chatgpt.com/plugins/plugin_asdk_app_6abdec89d46c81919cda058ca9f62cb8?search=call4me
1•skeptrune•34m ago•0 comments

Someone Is Bringing Civilisation to the Neo Geo Pocket Color

https://handheldhideout.neocities.org/articles/someone-is-bringing-civilisation-to-the-neo-geo-po...
2•Kate0CoolLibby•35m ago•0 comments

Disposable Tools for Thought

https://nicholascharriere.com/blog/disposable-tools-for-thought/
3•nichochar•36m ago•0 comments

Show HN: A client-side adaptive cognitive test measuring micro-hesitations

https://kat-assessment.com/
2•mr-boombastic•39m ago•1 comments

Argus – a free, open-source agentic security operations platform – MIT

https://thomasunise.com/argus
12•humxn•41m ago•3 comments

Show HN: Tributary – Discover who influenced your favorite musicians

https://tributary.music/
2•ASpring•44m ago•0 comments

We should be more ambitious with the software we build

https://danluu.com/ambitious/
5•ltratt•48m ago•0 comments

FBI Explores Espionage Case Against Saudi OpenAI Suspect

https://www.wsj.com/us-news/law/fbi-explores-espionage-case-against-saudi-openai-suspect-fbaedefe
2•JumpCrisscross•48m ago•0 comments

Small Programs and Languages

https://ratfactor.com/cards/pl-small
2•andsoitis•51m ago•0 comments

The Importance of Limitations for Creativity and Learning

https://ratfactor.com/cards/limitations
3•andsoitis•53m ago•0 comments

Forecasting Financial Markets with Timestral

https://philippdubach.com/posts/forecasting-financial-markets-with-timestral/
7•7777777phil•53m ago•0 comments

The Experiment review – easily the most disturbing thing on British TV

https://www.theguardian.com/tv-and-radio/2026/oct/21/the-experiment-channel-four-tv-review-uk-naz...
3•nephihaha•53m ago•0 comments

Show HN: WhatsApp Bridge for those with their own VPS

https://github.com/vid-t/whatsapp-bridge
2•vid_t•54m ago•1 comments

Israeli central bank rejects Netanyahu's plan to use crypto to evade sanctions

https://www.ft.com/content/39e475e7-0392-4856-aaaf-5ab3e35b8215IsraelicentralbankrejectsBenjaminN...
5•JumpCrisscross•55m ago•0 comments

Interesting properties about the design of the UK 50p piece [pdf]

https://cdn.ima.org.uk/wp/wp-content/uploads/2022/03/Westward-Ho-Conway-Concorde-and-curiously-cu...
2•greengreengrass•57m ago•0 comments

US executives quit $25B gas venture over claims of secret Russian control

https://www.ft.com/content/e9cfbfbb-e65a-4303-aebb-20d59319ef1b
4•JumpCrisscross•57m ago•0 comments

How to Start a Startup Game

https://www.neuroplusgbrain.net/
1•FDX2018•59m ago•0 comments

Apple should fuck themselves with their "privacy"

5•itvision•1h ago•3 comments

The power of having less features

https://ratfactor.com/cards/no-feature
2•andsoitis•1h ago•0 comments

OpenAI says it will no longer train its AI models on the live internet

https://techcrunch.com/2026/10/23/openai-says-it-will-no-longer-train-its-ai-models-on-the-live-i...
2•colinprince•1h ago•0 comments

Bridgeplay: Windows Steam games on your Mac

https://bridgeplay.dev/
2•evo_9•1h ago•0 comments