frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

EU border agency unlawfully transferred data on migrants/activists to Europol

https://english.elpais.com/international/2025-07-13/for-years-the-eus-border-agency-illegally-tra...
1•robtherobber•24s ago•0 comments

AI Video and Audio Generator

https://silknova-ai.com/
1•amonte•4m ago•0 comments

Codeberg bans vibe coded projects

https://codeberg.org/Codeberg/org/pulls/1253#issuecomment-19820434
2•ambigious7777•5m ago•1 comments

Mapping Alien Continents: Achieving Optical VLBI for Exoplanet Imaging

https://www.nasa.gov/directorates/stmd/mapping-alien-continents-achieving-optical-vlbi-for-exopla...
1•fireflymetavrse•9m ago•0 comments

Hyra: A simple yet effective scaffold for general discovery

https://hy.tencent.com/research/hyra
1•ijk•10m ago•0 comments

Why I'd choose Tauri again for a cross-platform database client

https://tabularis.dev/blog/why-tabularis-runs-on-tauri
1•theanonymousone•11m ago•0 comments

Sharecoin, a Bitcoin Core fork that turns GPU mining into public randomness

https://github.com/TVHeroes/sharecoin
1•TVHeroes•17m ago•0 comments

Thoughts on Integers (2023)

https://blog.xoria.org/integers/
1•birdculture•17m ago•0 comments

Distributed Development with Reticulum

https://reticulum.network/manual/distributed.html
2•bergie•19m ago•0 comments

Show HN: Shirei v0.6 adds iOS/Android support for cross-platform GUI development

https://judi.systems/shirei/blog/release-v0.6-2026-07-22/
1•hsn915•24m ago•0 comments

Melaya – the agent builder that gives AI a governed Android phone

https://www.melaya.org
1•melaya•25m ago•1 comments

Have the Chips Fully Cooled?

https://robinhood.com/us/en/learn/weekly-rundown/3wGS8sjCYEufVoC3EfYph9/
1•dabinat•25m ago•0 comments

Aks HN: Why does GitHub grapql API returns missing data?

1•ThierryRkt•25m ago•0 comments

A hand-cranked device for running local LLMs

https://squeezlabs.github.io/handcrank/
1•antondd•29m ago•0 comments

Session Revocations at Scale

https://www.canva.dev/blog/engineering/session-revocations-at-scale/
1•SerCe•32m ago•0 comments

Show HN: Open benchmark for memory layers vs. pasting full chat history

https://github.com/leapmemory/memory-bench
1•canu21•33m ago•0 comments

Senior-agent-skills, make your agent act as a senior

https://adityaarakeri.github.io/senior-agent-skills/#harness
1•humblejedi•34m ago•0 comments

LynavoDrive: An open-source alternative to iCloud and Google Photos

https://drive.lynavo.io/
1•ilreb•34m ago•0 comments

"You're right to push back"

https://walterra.dev/blog/2026-06-25-youre-right-to-push-back
2•walterra•35m ago•1 comments

A story about Amara's law

https://twitter.com/stevesi/status/2079726752012616171
2•tosh•38m ago•0 comments

Show HN: RadioGuessr – Guess the country from a live radio stream on a 3D globe

https://www.radioguessr.space/
1•barryspace•38m ago•0 comments

Sylve with FreeBSD Instead of Proxmox for Virtualization

https://gyptazy.com/blog/boxybsd-moving-from-proxmox-to-bhyve-with-sylve/
1•d4gli•39m ago•0 comments

The Requirement of Requirements in Software Projects – Yakir Havin

https://yakirhavin.com/blog/the-requirement-of-requirements-in-software-projects/
1•l0b0•40m ago•0 comments

Scoring every ad click for fraud in real time

https://adpurity.collabtower.com/features/click-fraud-detection
1•changalwa•41m ago•0 comments

The Blood Bank and the Logistics of Wartime Medicine

https://warontherocks.com/cogs-of-war/the-blood-bank-and-the-logistics-of-wartime-medicine/
1•baud147258•42m ago•0 comments

Show HN: A map platform where every category is just a filter

https://umkreisel.com/karte
2•lostbanana4•49m ago•0 comments

How much cost would it take to run a LLMs locally

1•anitroves•50m ago•2 comments

Show HN: Slate, a to-do list shaped like your week, not an endless backlog

https://slate-todo.com
1•al3xandre•53m ago•0 comments

Show HN: RunKit – a browser based tmux manager

https://github.com/sahil87/run-kit
5•sahil87•56m ago•2 comments

Characterizing Metastable Faults and Failures

http://muratbuffalo.blogspot.com/2026/07/characterizing-metastable-faults-and.html
1•matt_d•57m ago•0 comments