frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

JaJa: Job Agency Harness

https://github.com/Kahl-d/jaja
2•khalidmehtabk•1m ago•0 comments

The Designer Fallacy

https://humanslivehere.com/articles/the-designer-fallacy/
1•Patrax•3m ago•0 comments

Ask HN: Does your company require human review of AI-generated code?

1•is-is-odd•6m ago•0 comments

Can They Write a Function?

https://idiallo.com/blog/can-they-write-a-function
1•firefoxd•6m ago•0 comments

FileBot Forums (phpBB) have been hacked

https://www.reddit.com/r/filebot/comments/1xf4s2b/filebot_forums_phpbb_have_been_hacked/
2•hippogod•14m ago•0 comments

ARM1: Chip That Changed the World of Computing

https://www.youtube.com/watch?v=Q8OYQKuYtjE
1•cable2600•21m ago•0 comments

If AI displaces human workers, they will lose more than just pay

https://www.economist.com/business/2026/10/22/if-ai-displaces-human-workers-they-will-lose-more-t...
2•andsoitis•34m ago•0 comments

Biff 2.0.4: LLM Skills

https://biffweb.com/p/skills/
2•TheWiggles•38m ago•0 comments

Show HN: God – real-time control room for LLM agent societies (EMNLP 2026 demo)

https://github.com/XiaoLuoLYG/GOD
2•xiaoluolyg•45m ago•0 comments

U.S. birth rate drops to record low, but older women are having more babies

https://www.npr.org/2026/10/24/nx-s1-6012804/birth-rate-population-cdc
2•pseudolus•50m ago•0 comments

iPhone Duo Teardown [video]

https://www.youtube.com/watch?v=WOVIjFnivJA
2•obilgic•56m ago•1 comments

The subreddit each age is most over-represented in, women vs. men

https://www.reddit.com/r/dataisbeautiful/comments/1xf6gt3/oc_i_checked_177_million_redditors_who_...
1•gmays•59m ago•0 comments

IBM CEO says open weight models are now irresistibly good and cheap on-prem

https://www.theregister.com/systems/2026/10/22/ibm-ceo-says-open-weight-models-are-now-irresistib...
17•Betelbuddy•1h ago•0 comments

Data centre debate heats up ahead of US midterms

https://www.bbc.com/news/articles/cq2e9we7w2ejo
5•Betelbuddy•1h ago•0 comments

Recycling ANSI art: Tracing the origins of Fire Escape's BBS logon screens

https://breakintochat.com/blog/2026/10/25/recycling-ansi-art/
4•Kirkman14•1h ago•4 comments

Show HN: Little Fun Games – daily trivia with uncommon-answer scoring

https://littlefungames.com/
2•littlefungames•1h ago•0 comments

Grokking: A 777-Parameter Transformer Learned Real Math

https://themenonlab.blog/blog/grokking-777-parameter-transformer
4•peter_d_sherman•1h ago•1 comments

iPhone Duo Teardown

https://www.ifixit.com/News/119895/iphone-duo-teardown
36•kripy•1h ago•8 comments

Cve.now: A Free Feed of Security Vulnerabilities for Agents

https://www.sazabi.com/blog/introducing-cve-now
2•shcallaway•1h ago•0 comments

Please Don't Mess with Links

https://maurycyz.com/misc/real_links/
6•birdculture•1h ago•0 comments

Scientists Discover a Surprising Shortcut to Nuclear Fusion

https://scitechdaily.com/scientists-discover-a-surprising-shortcut-to-nuclear-fusion/
2•g-b-r•1h ago•0 comments

Drone warfare is evolving faster than armies can adapt

https://www.thestar.com/news/canada/drone-warfare-is-evolving-faster-than-armies-can-adapt-expert...
3•sleepyguy•1h ago•1 comments

Show HN: Freehire, open-source search 3M+ tech jobs from company career boards

https://freehire.me/
3•i_strelov•1h ago•0 comments

Show HN: Depono – Chat with many AI models at cost and 10%, files kept in Git

https://depono.xyz/
1•saxonnicholls•1h ago•0 comments

Show HN: RainbowSay – Learn, teach, research languages live with shows you love

https://rainbowsay.ai/
3•gigapotential•1h ago•0 comments

Bringing Flame Serving Close to Standalone vLLM

https://xflops.io/blog/flame-vllm-serving/
1•k82cn•1h ago•0 comments

Removing Next.js Got My Blog to 100 on Every Lighthouse Category

https://korindiehacker.bloffy.blog/en/removing-nextjs-got-my-blog-to-100-on-every-lighthouse-cate...
8•textlanes33•1h ago•0 comments

Setup Home Lab Static Website: Rasp Pi, Astro, Nginx Proxy Mgmt, Cloudflare

https://blog.jacq.cc/guides/static-blog-raspberry-pi-nginx-proxy-manager-cloudflare/
2•xx__yy•1h ago•0 comments

Ask HN: Is it not possible to enroll for Apple Developer anymore?

4•olalonde•1h ago•0 comments

Coding Is Dead. Programming Is Not

https://twitter.com/jay4fun_/status/2114522024387269032
3•jairojair•1h ago•1 comments