frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•7mo ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

The open hardware water cooling controller project

https://github.com/kennycoder/waku-ctl
1•kennycoder•1m ago•1 comments

Datadog built a low-latency, multi-tenant data replication platform

https://www.datadoghq.com/blog/engineering/cdc-replication-search/
1•mooreds•1m ago•0 comments

Odies – AI Companions living on your screen

https://www.youtube.com/watch?v=uwQjUHvm0JM
1•omoistudio•2m ago•0 comments

Static Analysis of APL Code [video]

https://www.youtube.com/watch?v=d4pRvKMcp_g
1•pillowshift•2m ago•0 comments

"I've failed 17 times with the exact same error": An agent debugging tale

https://blog.tonkotsu.ai/p/ive-failed-17-consecutive-times-with
1•derekcheng08•3m ago•1 comments

A smart-glasses HUD app for guiding IKEA assembly [video]

https://www.youtube.com/watch?v=1bgYNNsjEAI
1•tash_2s•4m ago•1 comments

Dingo – a meta-language for Go

https://dingolang.com/
1•ezekg•4m ago•0 comments

Show HN: Banking-Grade Validators for IBAN, Swift, OFAC and Blockchain Networks

https://zkorigoplus.com/
1•ADCXLAB•4m ago•1 comments

Backpropagation: Find Partial Derivatives [video]

https://www.youtube.com/watch?v=lZrIPRnoGQQ
1•dwa3592•5m ago•0 comments

Discover the World's Top Vibe Coders

https://vibolio.com/
1•helloviby•5m ago•0 comments

Due to relentless AI scrapers notabug.org is currently down

https://notabug.org
3•ankitpati•6m ago•1 comments

Berkeley professor's camera caught student allegedly sabotaging another student

https://www.mercurynews.com/2025/12/08/uc-berkeley-professor-installed-secret-camera-allegedly-ca...
2•justin66•7m ago•0 comments

Developing a food-safe finish for my wooden spoons and cups

https://alinpanaitiu.com/blog/developing-hardwax-oil/
1•speckx•11m ago•0 comments

DocuSign phishing ranks as top inbox threat, analysis finds

https://www.scworld.com/news/docusign-phishing-ranks-as-top-inbox-threat-analysis-finds
1•Bender•13m ago•0 comments

Pompeii construction site confirms recipe for Roman concrete

https://arstechnica.com/science/2025/12/study-confirms-romans-used-hot-mixing-to-make-concrete/
1•Bender•14m ago•0 comments

Days after COP30, Brazil weakened Amazon safeguards

https://insideclimatenews.org/news/09122025/brazil-weakens-amazon-forest-protection/
1•Bender•14m ago•0 comments

Firewood Banks Aren't Inspiring. They're a Sign of Collapse

https://newrepublic.com/article/204051/firewood-banks-heating-bill-winter
6•toomuchtodo•14m ago•1 comments

Show HN: Redis Shield – Token bucket rate limiting in Redis at 50K req/s (Rust)

https://github.com/ayarotsky/redis-shield
1•ayarotsky•14m ago•0 comments

2026: The Last Year Before AGI

https://www.tenmas.tech/post/2026-the-last-year-before-agi-and-how-to-build-software-teams-that-s...
1•avivby•15m ago•0 comments

Lidar is being used to modernize complex infrastructure

https://www.lanl.gov/media/publications/1663/lidar-at-lansce
1•LAsteNERD•15m ago•0 comments

Show HN: AutEng Docs – Generate and Share Markdown and Mermaid and Katex

https://auteng.ai
1•llabs•16m ago•0 comments

Boom Supersonic to Power AI Data Centers with Superpower Natural Gas Turbines

https://www.businesswire.com/news/home/20251209195489/en/Boom-Supersonic-to-Power-AI-Data-Centers...
1•pixelesque•17m ago•0 comments

Jay – An i3 look and feel inspired Wayland WM written in Rust

https://github.com/mahkoh/jay/blob/master/docs/features.md
1•foxrider•18m ago•0 comments

Thinking About Thinking, with Reference to Galileo

https://www.ystrickler.com/the-galileo-method-private-first-public-when-ready/
1•OhMeadhbh•18m ago•1 comments

Now CachyOS Is Eating Arch Linux' Lunch on Desktop

https://boilingsteam.com/now-cachy-os-is-eating-arch-linux-lunch/
2•ekianjo•18m ago•0 comments

Egypologists find 225 'exceptional' figurines in pharaoh's tomb

https://www.france24.com/en/live-news/20251205-amazing-figurines-find-in-egyptian-tomb-solves-mys...
1•gmays•19m ago•0 comments

Someone hijacked Spotify's Share-to-Instagram asset for a 2004 track

https://ercanermis.com/when-spotifys-share-to-instagram-flow-turns-into-a-free-billboard/
1•ermis•19m ago•1 comments

Open-source, AI-powered flashcards with modern UX

https://github.com/maltsevmki/flashcards_backend
1•maltsevmki•20m ago•1 comments

Node.js Security Pre-Alert for Upcoming Releases on Monday, Dec 15, 2025

https://nodejs.org/en/blog/vulnerability/december-2025-security-releases
1•ezekg•21m ago•0 comments

Warm, humid 'atmospheric rivers' threaten Antarctica

https://www.science.org/content/article/warm-humid-atmospheric-rivers-threaten-antarctica
1•bikenaga•22m ago•0 comments