frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

He Jiankui Affair

https://en.wikipedia.org/wiki/He_Jiankui_affair
1•cl3misch•1m ago•0 comments

JAXA is about to perform a Phobos sample return mission

https://www.science.org/content/article/audacious-space-heist-japan-aims-bring-home-bits-martian-...
1•Muhammad523•2m ago•0 comments

A Princeton PhD Applied to 2,300 Jobs. He Still Can't Get One

https://www.wsj.com/lifestyle/careers/labor-market-freeze-phd-graduate-f8e17d7c
1•mid1110•6m ago•0 comments

Zero-Click Spyware Is Infecting Phones via Targeted Ads

https://www.wired.com/story/nightmare-scenario-zero-click-spyware-is-infecting-phones-via-targete...
1•walterbell•8m ago•0 comments

Encryption Is Getting Squeezed from All Sides

https://www.wired.com/story/kernel-panic-encryption-is-getting-squeezed-from-all-sides/
1•ent101•16m ago•0 comments

Space Shuttle Endeavour Transport

https://www.cordobacorp.com/move-of-the-space-shuttle-endeavour/
1•thunderbong•22m ago•0 comments

Algorithmic Similarity and the Limits of Proof: Facial Recognition

https://medium.com/@smoking2man/algorithmic-similarity-and-the-limits-of-proof-facial-recognition...
1•Aldus551•27m ago•0 comments

The Cycle of New Software: On Operative Simulacra

https://szymon-wilczek.me/writings/the-cycle-of-new-software/
1•signa11•27m ago•0 comments

'What the hell did this?': The orca brothers preying on great white sharks

https://www.bbc.com/future/article/20261015-sharks-washed-up-one-after-another-after-another-why-...
1•jazali•28m ago•0 comments

Want to Release Projects Easily?

https://cx-shipd.netlify.app
1•CX-Designs•37m ago•0 comments

Anthropic turns to lawyers to help AI agents strike deals

https://www.ft.com/content/f7c26ac0-f5f2-443a-86b2-39d62f7920a9
1•thm•39m ago•0 comments

Show HN: Parents Inbox – Communication Guide for Schools

https://helptheparents.org/
1•sxates•43m ago•0 comments

TurboScribe AI: Free video to text and audio to text converter

https://www.turboscribeai.org/
1•wsm123456•47m ago•0 comments

China startup demoes prototype EUV light source, still years away from viability

https://www.tomshardware.com/tech-industry/semiconductors/china-startup-demoes-prototype-euv-ligh...
1•rguiscard•48m ago•0 comments

PwnEscape: Guest-to-Host KVM Escape (CVE-2026-99999)

https://pwn.ai/blog/pwnescape
1•taubek•49m ago•0 comments

I made an OS kernel in Rust that runs in the browser and on an actual computer

https://github.com/avycado13/webos
1•avycado13•57m ago•0 comments

LLMs are inside fabs, so why aren't they solving core problems?

https://www.waferpilot.xyz/resources/fab-llm-yield-reliability/
2•mangohaha•1h ago•0 comments

Telegram Web A: Telegram's Zero-Dependency Official Web Client

https://github.com/Ajaxy/telegram-tt
2•theanonymousone•1h ago•0 comments

Show HN: Pbschema-lens – static doc generator for protobuf

https://github.com/ymmt2005/pbschema-lens
1•ymmt2005•1h ago•0 comments

The game industry is broken – can we fix it?

https://knowledge.edge-online.com/p/the-game-industry-is-broken-can-we-fix-it-tim-sweeney-edge-crash
15•mellosouls•1h ago•10 comments

World's Timekeepers Vote to Eliminate the Leap Second

https://www.smithsonianmag.com/smart-news/its-official-timekeepers-have-gotten-rid-of-the-leap-se...
1•signa11•1h ago•0 comments

Fast approximation algorithms for knapsack problems (1977)

https://ieeexplore.ieee.org/document/4567944
1•vismit2000•1h ago•0 comments

Dot factory – a spec to describe complex (agentic) workflows

https://redbeardlab.github.io/dotFactory/
1•siscia•1h ago•0 comments

Matthew Prince on why Cloudflare offers a free version and always will

https://webmasters.stackexchange.com/questions/88659/how-can-cloudflare-offer-a-free-cdn-with-unl...
37•thatslast•1h ago•15 comments

Mobile Application GPU Optimization Guide

https://arm-software.github.io/magog/
1•matt_d•1h ago•0 comments

Rahn Curve

https://en.wikipedia.org/wiki/Rahn_curve
1•baxtr•1h ago•0 comments

Does moving a GPU server's request loop into the kernel save CPU?

https://eunomia.dev/blog/2026/10/17/bpf-gpu-server/
1•thatslast•1h ago•0 comments

Wing Commander 3 is getting a remaster

https://www.pcgamer.com/games/sim/it-looks-like-wing-commander-3-is-getting-a-remaster-after-ea-p...
3•jbm•1h ago•0 comments

AI Slop? Nay, AI Gourmet

https://octomon.dev/blog/ai-slop-and-ai-gourmet/
1•securitypedant•1h ago•1 comments

A Mole Infiltrated the Highest Ranks of American Militias

https://www.propublica.org/article/ap3-oath-keepers-militia-mole
52•georgecmu•1h ago•5 comments