frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Ask HN: What internal tools/SASS replacements are you building?

1•kostarelo•26s ago•0 comments

Why is there smoke from the boiler room? – Botanical Garden using Home Assistant

https://vooijs.eu/posts/why-is-there-smoke-from-the-boiler-room/
1•Baardappel•40s ago•0 comments

Coding Agents as Teammates in Issues, Pull Requests, and CI

https://onedev.io/blogs/33
2•timplant•1m ago•0 comments

Owarix, version of 8000 year old game for the Vic20. (3k: v20,c64,c16,zx,PC)

https://orac81.itch.io/owarix
1•orac81•2m ago•0 comments

TikTok Viral Score – deterministic scoring engine, no login required

https://github.com/NaiaLorente/GoViral-Tiktok
1•naialorente•2m ago•0 comments

If Terraform is so great, why isn't anyone using it anymore?

https://medium.com/@sebkow/if-terraform-is-so-great-why-isnt-anyone-using-it-anymore-1b79b2159272
1•sebkow•2m ago•1 comments

Probably the best AI detector tool is ready

https://aidetector.my/en
1•GemsGame•4m ago•0 comments

I built Who Goes? app to make game nights feel fun again

https://apps.apple.com/in/app/who-goes-party-games/id6777402559
2•shubham_iosdev•7m ago•1 comments

Eight – Interactive fiction made with AI

https://huggingface.co/spaces/alvations/hallway8
2•alvations•8m ago•0 comments

The Parts Based Programming Kernel

https://programmingsimplicity.substack.com/p/the-parts-based-programming-kernel
3•surprisetalk•10m ago•0 comments

Reasons to be optimistic about America's future

https://www.washingtonpost.com/opinions/interactive/2026/07/03/25-reasons-be-optimistic-about-ame...
2•baal80spam•11m ago•0 comments

Trump Financial Disclosure Shows 21,000 Trades in 2025

https://www.advisorhub.com/trump-financial-disclosure-shows-21000-trades-in-2025/
4•throw0101d•12m ago•1 comments

pkgsrc is still available on macOS as a package manager

https://pkgsrc.smartos.org/install-on-macos/
2•uneven9434•12m ago•0 comments

FlowerBench: Benchmarking AI Agents on Real Enterprise Work

https://flower.ai/benchmarks/flowerbench/
2•dimitrisflwr•14m ago•1 comments

China will likely have its own Mythos-like model around February 2027

https://www.the-substrate.net/p/china-will-likely-have-its-own-mythos
3•throw0101d•16m ago•0 comments

Show HN: Open-source Claude Code skills that mine Reddit/X for content topics

4•vatricemir•16m ago•0 comments

Ask HN: Are there good security benchmarks for LLMs?

2•melvinroest•16m ago•0 comments

The Devadasis, Dance Community of South India: A Legal and Social Outlook

https://brill.com/view/journals/ijgr/29/1/article-p102_102.xml
2•thunderbong•22m ago•0 comments

We built a P2P app with no servers. Internet of Peers [video]

https://www.youtube.com/watch?v=n76zGrt4aRY
2•closet_slayer•23m ago•0 comments

Road to Elm 1.0

https://elm-lang.org/news/faster-builds
6•wolfadex•23m ago•0 comments

D7VK 1.12, a DXVK fork for Direct3D 3-7 on top of Vulkan

https://github.com/WinterSnowfall/d7vk/releases/tag/v1.12
2•Tiberium•23m ago•0 comments

Amazon Leo constellation nears 400 satellites as broadband launch looms

https://www.theregister.com/networks/2026/07/03/amazon-leo-constellation-nears-400-satellites-as-...
2•Bender•25m ago•0 comments

C programmers commit fresh crimes against readability

https://www.theregister.com/offbeat/2026/07/05/c-programmers-commit-fresh-crimes-against-readabil...
8•Bender•26m ago•0 comments

Confidential computing's core trust mechanism is broken. The fix may not exist

https://www.theregister.com/security/2026/07/04/confidential-computings-core-trust-mechanism-is-b...
2•Bender•26m ago•0 comments

"Software Engineering" Is Not Engineering

https://web.archive.org/web/20050615235108/http://www.geocities.com/tablizer/science.htm
12•abrbhat•28m ago•0 comments

Serendipity

https://amin.waldi.blog/serendipity
2•waaldev•28m ago•0 comments

A floating point option shield to check for sensible C compiler configurations

https://gist.github.com/Marc-B-Reynolds/1e2ef2a7e59d100e39d26cf69079ded6
2•fanf2•28m ago•0 comments

Big tech has suddenly flipped on the AI jobs wipeout scenario

https://www.msn.com/en-us/money/careersandeducation/big-tech-has-suddenly-flipped-on-the-ai-jobs-...
4•johnhamlin•31m ago•0 comments

ABT: EBT for Art: it could work

https://medium.com/@zrkjsy/the-art-benefits-transaction-an-economic-case-for-subsidizing-art-4c9b...
2•taivare•32m ago•1 comments

Taxing Artificial Intelligence

https://arxiv.org/abs/2607.02144
4•ilreb•34m ago•0 comments