frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Nitter: Update Oct 10th seeking funding and legal help

https://nitter.net
1•ForHackernews•28s ago•0 comments

Reverse-engineering the 8086 processor's address and data pins from die photos

http://www.righto.com/2023/07/8086-pins.html
1•utiiiD•2m ago•0 comments

"Robot" Is a Social Construct: Why Your Dishwasher Is Not a Robot

https://robotgirlgang.com/2026/10/08/robot-is-a-social-construct-why-your-dishwasher-is-not-a-robot/
2•birdculture•3m ago•0 comments

You Built a Knowledge Graph from 1M Documents. Can You Trust It?

https://memgraph.com/blog/can-you-trust-your-knowledge-graph
1•LLcolD•4m ago•0 comments

Show HN: WhimKid, an AI storybook generator for children

https://whimkid.com/
1•sylwair•5m ago•0 comments

Training LLMs to write tools generalized beyond self use

https://tool-use-smith.github.io/
2•blackcat201•9m ago•0 comments

Sudden drop in Cloudflare bot traffic after strike on Yandex datacenter

https://radar.cloudflare.com/bots/as13238?dateRange=7d
4•walrus01•10m ago•1 comments

Rank 17 Rock and Roll Hall of Fame

https://medium.com/the-hitmagist/rank-17-rock-and-roll-hall-of-fame-d3b4e0d6f7e2
1•bryanrasmussen•12m ago•0 comments

Simulation Hypothesis

https://www.realm33.org/conspiracy-theory/the-simulation-hypothesis/
2•jruohonen•18m ago•0 comments

Brickbait

https://olliegreen.info/posts/18/brickbait/
2•Oarch•18m ago•0 comments

Running the unmodified Linux amdgpu driver on an iPad

https://github.com/Geramy/LemonSeed-Studio
2•joshcsimmons•20m ago•0 comments

H.266 vs. AV1 for Live Streaming: What Codec to Choose

https://www.red5.net/blog/h266-vs-av1/
3•mondainx•22m ago•0 comments

Superstar podcasts are Silicon Valley's way of talking to itself

https://economist.com/culture/2026/10/08/superstar-podcasts-are-silicon-valleys-way-of-talking-to...
3•andsoitis•22m ago•0 comments

Progressive Determinization in Software Development

https://novian.works/progressive-determinization.html
2•reverseblade2•25m ago•1 comments

Show HN: THX-01 – Free API for our open-source decision model

https://twitter.com/reversedoofz/status/2109005792246657448
2•lebagetdefrance•26m ago•0 comments

IRCv3

https://ircv3.net/
27•basilikum•26m ago•3 comments

cgo is not Go (2016)

https://dave.cheney.net/2016/01/18/cgo-is-not-go
2•tosh•28m ago•0 comments

go-duckfs: DuckDB virtual file system based on io/fs

https://github.com/firetiger-oss/go-duckfs
1•tosh•30m ago•0 comments

Relevance of LTS distro releases and the GenAI world

https://lpc.events/event/20/contributions/2586/
1•Hendrikto•39m ago•1 comments

The new rules of context engineering for Claude 5 generation models

https://claude.dev/blog/the-new-rules-of-context-engineering-for-claude-5-generation-models/
2•robluxus•47m ago•0 comments

Vibe Prospecting – B2B Prospecting from Claude and Claude Code via MCP

https://github.com/explorium-ai/vibeprospecting-mcp
1•zivnadil•47m ago•0 comments

A new language has been born in the Northwest (2022)

https://www.opb.org/article/2022/01/05/new-language-for-deaf-blind-born-in-northwest/
3•thunderbong•55m ago•0 comments

Sniffing a Bricked Glucose Monitor with Codex

https://medium.com/@farhanhubble/sniffing-a-bricked-glucose-monitor-with-codex-690c74229d02
1•farhanhubble•1h ago•1 comments

Shelley – a coding agent that lives in the browser

https://shelley.dev/
1•tosh•1h ago•0 comments

Google releases a new local-first Granola competitor

https://techcrunch.com/2026/10/08/google-releases-a-new-local-first-granola-competitor/
1•janandonly•1h ago•1 comments

Programmable pigments: Photochromic nanoparticle inks for rewritable tattoos

https://www.cell.com/matter-light/fulltext/S3117-5848(26)00119-5
1•Bluestein•1h ago•0 comments

Web Design in Auckland: Costs, Options and How to Choose

https://www.kiwiwebdesign.co.nz/affordable-web-design-auckland/
2•kiwiwebdesign•1h ago•0 comments

Land animals and ecosystems walloped in wake of end-Permian mass extinction

https://nhmu.utah.edu/press/land-animals-and-ecosystems-walloped-wake-end-permian-mass-extinction
2•gehwartzen•1h ago•0 comments

I build an open-source runtime security layer for AI agents – Let's break it

https://github.com/Pryxor/pryxor
2•makan09•1h ago•0 comments

Offline voice packs and an open-source agent that texts, calls, posts to Slack

https://github.com/eyeguide-dev/speakvora-pack-agent
1•speakvora•1h ago•0 comments