frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

IBM Bob

https://bob.ibm.com/
2•artpar•3m ago•0 comments

Restoring 5 GHz Wi-Fi on an LG C5 by changing its webOS region

https://github.com/hawshemi/lg-c5-webos25-region-change
3•hawshemi•4m ago•1 comments

Flashviz: Microcontroller flash and RAM 3D visualization

https://clisystems.com/tools/flashviz/
2•drewcg•4m ago•0 comments

AI adoption at work is broad but shallow

https://www.theregister.com/ai-and-ml/2026/09/01/ai-adoption-at-work-is-broad-but-shallow/5293545
3•dijksterhuis•6m ago•0 comments

.FAGE is a brand TLD owned by FAGE a Greek dairy company

https://domaindetails.com/tlds/fage
3•gregsadetsky•10m ago•0 comments

Parrot was caught ordering items off Amazon's Alexa

https://www.cnbc.com/2018/12/21/african-grey-parrot-rocco-was-caught-ordering-items-off-amazons-a...
3•theanonymousone•10m ago•0 comments

Nearly impossible? How Fairphone built the ethical, repairable Fairphone Gen 6+

https://arstechnica.com/gadgets/2026/09/nearly-impossible-how-fairphone-built-the-ethical-repaira...
3•CrypticShift•10m ago•0 comments

AI in 2026 feels like Covid in 2020

https://bejofo.com/blog/ai-feels-like-the-pandemic
3•YannickR•11m ago•0 comments

Ok, but Does It Scale?

https://spacetimedb.com/blog/how-does-spacetime-scale
2•theanonymousone•12m ago•0 comments

The best dark mode toggle is probably none

https://lea.verou.me/blog/2026/dark-mode-toggles-2/
1•lukasgelbmann•12m ago•0 comments

A fun debugging story from this weekend

https://hamatti.org/posts/a-fun-debugging-story-from-this-weekend/
1•speckx•12m ago•0 comments

Payroll employment increases by 162k in August; unemployment unchanged at 4.1%

https://www.bls.gov/news.release/empsit.nr0.htm
1•JumpCrisscross•12m ago•0 comments

Build on BareMetal

https://returninfinity.com/blog/sep2026-build-on-baremetal-contest
1•ianseyler•13m ago•1 comments

Designing Grok Bot for a world of persistent agents

https://x.ai/news/designing-grok-bot
1•aratahikaru5•13m ago•0 comments

Denavigation: The End of Apps and the Verification Bottleneck

https://alexanderabramovich.medium.com/denavigation-18cdc039da2d
1•happyalexander•17m ago•0 comments

Terence Tao: Speed in science isn't the same thing as progress [video]

https://www.youtube.com/watch?v=svl_1upFpQo
1•gessha•17m ago•0 comments

What archaeology reveals about the rise of all-powerful rulers

https://knowablemagazine.org/content/article/society/2026/what-archaeology-reveals-about-rise-of-...
1•sohkamyung•21m ago•0 comments

Climbers rescued on Mount Shasta after using AI chatbot to plan trip

https://www.sfchronicle.com/outdoors/article/shasta-climbers-rescued-chatgpt-22414629.php
2•dsr12•21m ago•0 comments

Machine Testimony

https://yalelawjournal.org/article/machine-testimony
2•Bluestein•21m ago•0 comments

Negative people make you age faster

https://www.pnas.org/doi/10.1073/pnas.2515331123
2•RickJWagner•21m ago•0 comments

A new method for data transformation. Hash, PRNG, XOF – High speed

https://github.com/Ligatum/Lustro
1•Ligatum•25m ago•1 comments

Argus – an anti-detect browser with automation, local API, and MCP

https://www.browserargus.com
2•rpochtman•27m ago•0 comments

Most Websites Don't Need Developers

https://websmith.studio/blog/most-small-business-websites-dont-need-a-web-developer/
2•pumbaa•27m ago•1 comments

The script didn't hate AI. It hated the "@" character

1•ahunia•27m ago•0 comments

Fork a fast and friendly Git client for Mac and Windows

https://git-fork.com/releasenoteswin
1•Bluestein•27m ago•0 comments

Testing a New Soundbar with Browser Tools: Frequency Response, SPL, and Lip-Sync

https://capytoolkit.com/blog/audio/testing-soundbar-browser-tools-frequency-response-spl-lip-sync...
1•ChillyCapy•29m ago•0 comments

Tzopilotl: A statically typed live-coding language for real-time audio

https://lfnoise.github.io/tzpl/
1•jarmitage•32m ago•0 comments

Microsoft to impose time limits on Xbox cloud gaming as costs continue to climb

https://www.cnbc.com/2026/09/03/microsoft-xbox-game-pass-cloud-limits.html
1•magoghm•33m ago•0 comments

Nvidia PAIR turns your household's idle PCs into a local AI cluster

https://tokenstead.ai/guides/nvidia-pair-personal-ai-router
2•cdnsteve•34m ago•0 comments

What Did She Expect?" – Sexism and Classism Behind UK's Aesthetics Safety Crisis

https://www.marieclaire.co.uk/beauty/what-did-she-expect-the-sexism-and-classism-behind-the-uks-a...
3•bryanrasmussen•37m ago•1 comments