frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Apple Says iPhone 18 PM Users with AT&T Cellular Issue Need Device Replaced

https://forums.macrumors.com/threads/apple-says-iphone-18-pro-max-users-with-at-t-cellular-issue-...
1•thm•2m ago•0 comments

Show HN: .cmd, cross-platform build tool manager and task launcher you check in

https://github.com/dotcmdhq/dotcmd
1•vlaaad•6m ago•0 comments

California Attorney General Serves Investigative Subpoena on OpenAI

https://oag.ca.gov/news/press-releases/part-ongoing-investigation-attorney-general-bonta-serves-i...
2•geox•9m ago•1 comments

Nobody Asked AI to Hack Hugging Face. So Why Did It?

https://ankitjain.info/ankit/2026/09/28/ai-agents-sandboxes-hugging-face-incident/
3•ankit84•14m ago•1 comments

Compiling the Linux Kernel with Gccrs

https://lwn.net/Articles/1095553/
1•fanf2•14m ago•0 comments

Show HN: Collaborative AI Engineering

https://griyd.com
1•bitsoup•15m ago•0 comments

U.S. may have overthrown Venezuela due to chat with Grok

https://www.thedailybeast.com/jaw-dropping-way-trump-80-got-talked-into-a-war-is-leaked/
4•tty456•16m ago•0 comments

Show HN: Offrun – manage every coding agent from one workspace

https://offrun.dev/
2•arunbhatia•16m ago•0 comments

I made my iPhone a second GPU for my MacBook-Qwen 3.8 27B prefills 29–44% faster

https://reddit.com/comments/1wvz1ex/
1•thunderbong•17m ago•0 comments

Cronos, the black metal innovator who reignited rock's hellraising attitude

https://www.theguardian.com/music/2026/oct/02/cronos-venom-heavy-metal-conrad-lant
1•YeGoblynQueenne•18m ago•0 comments

Skip List Data Structure

https://pradyumnachippigiri.substack.com/p/skip-lists-data-structure
2•birdculture•21m ago•0 comments

Charts on the State of Markets (1H'26)

https://www.a16z.news/p/state-of-markets-ii
1•hubraumhugo•21m ago•0 comments

DeepSeek ports DeepGEMM to Huawei Ascend 950

https://github.com/deepseek-ai/DeepGEMM-Ascend
1•fourfire•24m ago•0 comments

Spotlight Memory

https://www.percepta.ai/blog/spotlight-memory
1•ronfriedhaber•26m ago•0 comments

AI Experts Want to Do High-Stakes Research Out in the Open

https://www.wired.com/story/trillium-labs-wants-to-do-high-risk-ai-research-in-the-open/
1•pretext•29m ago•0 comments

Show HN: Analog Social Media

https://www.analogle.com/
1•lennartb•36m ago•2 comments

What are you watching

1•mogarn•37m ago•1 comments

Show HN: Sketio – a whiteboard that turns rough sketches into clean diagrams

https://draw.sketio.app
1•youyo_•44m ago•0 comments

Show HN: Grow and Control a Swarm

https://nohope.io
1•levmiseri•45m ago•0 comments

Boom Supersonic loses key customer

https://techcrunch.com/2026/09/25/crusoe-abandons-1-25b-plan-to-use-boom-turbines-at-ai-data-cent...
1•hubraumhugo•50m ago•1 comments

Show HN: A critical thinking site for kids and teens

https://critikid.com/
1•Critikid•52m ago•0 comments

Show HN: Zebu tracking/invoicing for freelancers and small teams

https://zebu.work/
2•waffl•57m ago•0 comments

4 Years of Early Retirement – Is It What I Imagined?

https://financialmechanic.com/4-years-of-early-retirement-is-it-what-i-imagined/
2•serhack_•1h ago•0 comments

Why should I have to pay more for buses if I don't use a smartphone?

https://www.theguardian.com/money/2026/oct/02/why-should-i-have-to-pay-more-for-buses-if-i-dont-u...
16•DamonHD•1h ago•4 comments

Chamath says open AI models are "commoditize your complement." Agree?

2•Dinuda•1h ago•1 comments

Ignore the naysayers. The new Firefox interface is awesome

https://www.newsonaut.com/articles/ignore-the-naysayers-the-new-firefox-interface-is-awesome
2•jyhrow•1h ago•0 comments

Zedgerr – self-hosted invoicing and bookkeeping for freelancers

https://github.com/vMawk/Zedgerr
1•vMawk•1h ago•0 comments

Solving Open Research Problems Together

https://research.meta.ai/blog/solving-open-research-problems-together
1•o4c•1h ago•1 comments

Anthropic commits $100M to Claude Frontier Academy to train 10k FDEs by 2028

https://www.unite.ai/new-anthropic-academy-backs-10-000-engineer-residencies-with-100m/
3•thoughtpeddler•1h ago•0 comments

Show HN: Halo – Dynamic Island for macOS that also works on external monitors

https://halo-mac.vercel.app/
1•otabekabdiraimo•1h ago•0 comments