frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Why developers use LLMs to write blog posts

https://writethatblog.substack.com/p/report-llms-tech-blogs
1•eatonphil•2m ago•0 comments

Zentral+|+Dang.ai

https://dang.ai/tool/zentral-ai-erp-crm-suite
1•andreforsyth•5m ago•0 comments

I replaced the backup camera in my 2016 Kia Soul EV

https://ruk.ca/content/i-replaced-backup-camera-my-2016-kia-soul-ev
2•speckx•6m ago•0 comments

Steganography Without Modification: Hidden Communication via LLM Seeds

https://arxiv.org/abs/2606.09135
1•sbulaev•7m ago•0 comments

Universal Worldwide Goods API

https://productapi.dev
1•gustutu•9m ago•1 comments

Apple Game Porting Toolkit 4

https://developer.apple.com/games/game-porting-toolkit/
1•Topfi•10m ago•0 comments

Learn anything with the /teach skill [video]

https://www.youtube.com/watch?v=s5T5oQJcJ6U
1•kesor•11m ago•0 comments

A World Without Strings Is Chaos

https://beyondloom.com/blog/strings.html
1•tosh•13m ago•0 comments

I Stopped Fighting My Tools and Built a Game Engine in D

https://blog.dlang.org/2026/05/29/i-stopped-fighting-my-tools-and-built-a-game-engine-in-d/
1•ibobev•14m ago•0 comments

Show HN: Cc-bridge – Two Claude Code windows talking via one JSONL file

https://github.com/Incultnitollc/claude-code-live-bridge
2•PengSpirit•16m ago•0 comments

Apify is launching MCP connectors to give Actors access to external apps

https://blog.apify.com/announcing-mcp-connectors/
1•jancurn•17m ago•0 comments

Show HN: Productatlas – Preview and compare ProductHunt launches in a map

https://productatlas.io/
1•davseby•17m ago•0 comments

Five More Questions with Stephen Kotkin: Can America Still Lead the World? [video]

https://www.youtube.com/watch?v=gBEdxb8ei_0
1•jger15•19m ago•0 comments

Saving Money on Inference

http://blog.merrilin.ai/engineering/2026/saving-money-on-inference/
2•stonecharioteer•19m ago•0 comments

Tracking the 2026 Ebola outbreak in maps and figures

https://www.nbcnews.com/data-graphics/ebola-outbreak-2026-cases-virus-tracking-maps-spread-congo-...
1•speckx•19m ago•0 comments

Tokenminning: Because Tokenmaxxing Is a Bad Idea

https://www.tokenminning.com/
3•robmay•20m ago•4 comments

Show HN: Webhix – Self-hosted webhook.site alternative in a single Go binary

https://github.com/GaIsBax/Webhix
3•Joseph_SPF•22m ago•0 comments

Show HN: RainBreak App – The AI doesn't need a break. But you do

https://rainbreak.franzai.com/
2•franze•24m ago•1 comments

Treating LLMs as Programming Books

https://jola.dev/posts/treating-llms-as-programming-books
2•shintoist•24m ago•0 comments

Linear Tape-Open

https://en.wikipedia.org/wiki/Linear_Tape-Open
1•CGMthrowaway•25m ago•0 comments

Repro-Bot, our GitHub issue triage agent

https://www.metabase.com/blog/reprobot-github-issue-triage-agent
2•mooreds•25m ago•0 comments

Toyota uses superconducting motor in race for first time

https://www.asahi.com/ajw/articles/16626731
1•Tor3•26m ago•0 comments

Lego Education SPIKE portfolio retiring

https://education.lego.com/en-us/spike-update-2026/
2•etruong42•26m ago•0 comments

Reorgs Happen

https://ben.balter.com/2026/06/07/reorgs-happen/
2•mooreds•27m ago•0 comments

Premature Optimization is Fun Sometimes (2025)

https://invlpg.com/posts/2025-06-19-premature-optimization.html
1•birdculture•28m ago•0 comments

Steve Yegge

https://yegge.ai/
1•tosh•31m ago•3 comments

AI Traffic Grew 6.5x Faster Than Human Traffic This Year

https://www.fastly.com/blog/ai-traffic-grew-6-5x-faster-than-human-traffic-this-year
1•HieronymusBosch•32m ago•0 comments

Non-Alcoholic Beer Sold Out Before the Booze

https://medium.com/@dmitry_titov/spatanism-a-photo-zone-with-coffins-and-wrestling-how-i-attended...
1•Dmitry_Titov•33m ago•0 comments

Is music a distraction for my teenager while they revise?

https://www.bbc.co.uk/bitesize/articles/zx228p3
1•mmarian•34m ago•0 comments

xAI Taps Starlink Staffer to Run Grok Training Team

https://www.bloomberg.com/news/articles/2026-06-09/musk-s-xai-taps-starlink-staffer-to-run-grok-t...
1•petethomas•34m ago•0 comments