frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Publishers Are Preparing to Opt Out of Google Search

https://www.adweek.com/media/publishers-opt-out-google-search/
1•giuliomagnifico•30s ago•0 comments

Lisp as the Maxwell's Equations of Software

https://michaelnielsen.org/ddi/lisp-as-the-maxwells-equations-of-software/
1•andsoitis•46s ago•0 comments

Experiment with tiny quantum universe: time 'arises' from changes in disorder

https://www.sciencedaily.com/releases/2026/07/260709160632.htm
1•alok-g•1m ago•0 comments

Neuralwatt Doubling the Price

https://portal.neuralwatt.com/pricing
1•MehrdadKhnzd•2m ago•0 comments

The great AI data centre cover-up

https://www.ft.com/content/7800ba0f-1420-49fe-b260-9838632a19a4
1•1vuio0pswjnm7•10m ago•0 comments

AI Investors Buying Accounting Companies and Force Them to Use OpenAI [video]

https://www.youtube.com/watch?v=2dp98vEGWq0
2•xbmcuser•13m ago•0 comments

Zeno's Paradox and Infinite Sums – Lectures on Infinity (Lecture 1) [video]

https://www.youtube.com/watch?v=4Y9p0yp8Mow
2•FillMaths•14m ago•0 comments

Italy privacy watchdog fines Character.ai owner over age-check failures

https://www.reuters.com/business/italy-privacy-watchdog-fines-characterai-owner-over-age-check-fa...
1•1vuio0pswjnm7•15m ago•0 comments

Hypeplan: Turn plans into terminal keynote speeches

https://github.com/martinrue/hypeplan
1•afisxisto•15m ago•1 comments

Semantic Fingerprinting Made Easy

https://github.com/thorwhalen/guise
1•ankitg12•23m ago•0 comments

Show HN: Zero2Robot – free, open source interactive textbook for robot learning

https://zero2robot.com/
1•kaushikbokka•23m ago•0 comments

Ask HN: Recommend a Local LLM Setup (M2 Max, 9GB)

1•balivandi•25m ago•0 comments

Show HN: Short SciFi/Fantasy Index

https://quasar.fyi/
1•FifthRocket•26m ago•1 comments

Ask HN: How do I get immoral AI?

2•nasaok•27m ago•0 comments

Best Job Oriented Courses in India: Guide, Rules and Benefits

https://www.smfgindiacredit.com/knowledge-center/best-job-oriented-courses-in-india.aspx
1•saumyaraut11•28m ago•0 comments

Show HN: World Clock with Twilight/Night Overlayed on Map

http://nixon-development.com/worldclock/
1•plun9•31m ago•0 comments

Ukraine's Drones Are Now Reaching Siberia and Imperiling Russian Energy Assets

https://www.wsj.com/world/ukraines-drones-are-now-reaching-siberia-and-imperiling-russian-energy-...
2•JumpCrisscross•32m ago•0 comments

Tech volatility hits highest since dot-com bust next to S

https://fortune.com/2026/07/07/tech-volatility-hits-highest-since-dot-com-bust-sp-500/
2•1vuio0pswjnm7•33m ago•0 comments

Mercor acquires Deeptune to build AI training environments

https://www.mercor.com/blog/mercor-to-acquire-deeptune/
1•doppp•39m ago•0 comments

UN digital tech agency launches initiative to improve trust in AI agents

https://www.reuters.com/legal/litigation/un-digital-tech-agency-launches-initiative-improve-trust...
1•giuliomagnifico•39m ago•0 comments

China's public QR codes are being hijacked to redirect users to porn and scams

https://www.sixthtone.com/news/1018752/ScanScam:CriminalsRedirectChina’sPublicQRCodestoPorn
13•whiteblossom•39m ago•0 comments

Jukebox: Themes inspired by music cover art

https://github.com/nooneknowspeter/jukebox
1•nooneknowspeter•39m ago•0 comments

Counting ArXiv Delays

https://fi-le.net/arxiv/
1•fi-le•44m ago•0 comments

China recovers Long March 10B rocket

https://www.bilibili.com/video/BV1n6NL6fEP9
5•ycui7•46m ago•2 comments

OpenAI and Google sell AI models to blacklisted China groups

https://www.ft.com/content/5d6aafa1-5d47-4585-aa95-6ec06a6cd20f
2•JumpCrisscross•47m ago•0 comments

China recovers reusable rocket used in the maiden launch of Long March 10B

https://www.scmp.com/news/china/science/article/3360069/china-recovers-long-march-10b-reusable-ro...
6•yms_hi•48m ago•0 comments

Think you can win on prediction markets? Here's why you're more likely to lose

https://www.cbc.ca/news/business/prediction-market-skilled-traders-9.7258090
2•1vuio0pswjnm7•50m ago•1 comments

I wrote about how we used Conway's Law to fix legacy architecture

https://one2n.io/blog/fixing-legacy-architectures-with-conways-law
1•chinmay185•55m ago•1 comments

"Worthless Idiot, Donkey Head": Parodies of Pedantry on the Renaissance Stage

https://publicdomainreview.org/essay/parodies-of-pedantry/
2•lermontov•57m ago•0 comments

Formally Verifying AI-Generated GPU Kernels

https://gimletlabs.ai/blog/formally-verifying-ai-generated-kernels
3•matt_d•58m ago•0 comments