frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•6mo ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

With Love to KDE: Take a Moment

https://korcenji.neocities.org/Writings/KDE-Take-A-Moment
1•todsacerdoti•49s ago•0 comments

Contact Center Bank Aladin

1•mymandap•11m ago•0 comments

Tired of checking AWS costs daily. Is this SaaS idea valid?

https://www.billping.com/
1•bval•16m ago•1 comments

The Hidden Job Market: How to Access the Roles No One Posts

https://medium.com/@sangram_navale/the-hidden-job-market-how-to-access-the-roles-no-one-posts-7a3...
1•sangramnavale•16m ago•0 comments

Ant Design 6.0 is released

https://github.com/ant-design/ant-design/issues/55804
1•zombiej•18m ago•0 comments

The Strange and Totally Real Plan to Blot Out the Sun and Reverse Global Warming

https://www.politico.com/news/magazine/2025/11/21/stardust-geoengineering-janos-pasztor-regulatio...
1•dsr12•18m ago•0 comments

Leading in Low-Trust Times

https://www.subbu.org/articles/2025/leading-in-low-trust-times/
3•gpi•25m ago•1 comments

Windows 95 and 98 emulator with games

https://emupedia.net/beta/emuos/
1•ericzawo•26m ago•0 comments

Overview of the Spin-Polarized-Fusion Landscape [pdf]

https://arpa-e.energy.gov/sites/default/files/2025-05/03_Sandorfi%20-%20SPF%20Overview-final.pdf
1•teleforce•26m ago•0 comments

Spinning Fusion Fuel for Efficiency

https://www.pppl.gov/news/2024/spinning-fusion-fuel-efficiency
1•teleforce•27m ago•0 comments

The Probability Paradox: Why Actuaries Can't Price AI

https://jonathancc.substack.com/p/the-probability-paradox-why-actuaries
2•felixnga•30m ago•0 comments

Show HN: KNothing – A privacy-first, client-side developer tool station (Nuxt 3)

https://knothing.com
1•bgkkdev•30m ago•1 comments

No Longer an Amazon.com Customer

https://dan.bulwinkle.net/blog/no-longer-an-amazon-customer/
2•pilingual•31m ago•1 comments

Source of Widespread 'Forever Chemical' Contamination in N Carolina

https://pratt.duke.edu/news/uncovering-the-source-of-widespread-forever-chemical-contamination-in...
3•thunderbong•37m ago•0 comments

Marriott's Disastrous Bet on Short-Term Rental Company Sonder

https://www.wsj.com/business/hospitality/sonder-bankruptcy-marriott-partnership-d0ced515
2•JumpCrisscross•41m ago•0 comments

Micromort

https://en.wikipedia.org/wiki/Micromort
1•supermdguy•46m ago•0 comments

How many valid JSON byte sequences are there?

https://qntm.org/jsonutf
2•zdw•48m ago•0 comments

Ask HN: What tools do you pay for today that feel overpriced or frustrating?

4•psicombinator•50m ago•0 comments

RuBee

https://computer.rip/2025-11-22-RuBee.html
23•Sniffnoy•1h ago•1 comments

Japan's gamble to turn island of Hokkaido into global chip hub

https://www.bbc.com/news/articles/c8676qpxgnqo
2•1659447091•1h ago•0 comments

The Cloudflare outage was a good thing

https://gist.github.com/jbreckmckye/32587f2907e473dd06d68b0362fb0048
9•radeeyate•1h ago•0 comments

KeePassXC 2.7.11 Released

https://keepassxc.org/blog/2025-11-23-2.7.11-released/
1•theodorejb•1h ago•0 comments

A free tool that stuns LLMs with thousands of invisible Unicode characters

https://gibberifier.com
4•wdpatti•1h ago•3 comments

McMaster Carr – The Smartest Website You Haven't Heard Of

https://www.bedelstein.com/post/mcmaster-carr
3•jcartw•1h ago•1 comments

Style Reference vs. Image Prompts: What's the Difference?

https://image2prompts.com/blog/style-reference-vs-image-prompts-what-the-difference
1•zack119•1h ago•0 comments

Visualizing asymmetry in the 196 Lychrel chain (50k steps, 20k digits)

1•jivaprime•1h ago•0 comments

Napster Said It Raised $3B from an Investor. Now 'Investor' and 'Money' Are Gone

https://www.forbes.com/sites/phoebeliu/2025/11/23/napster-said-raised-3-billion-mystery-investor-...
2•pseudolus•1h ago•0 comments

Ouya

https://en.wikipedia.org/wiki/Ouya
3•Ariarule•1h ago•2 comments

'The public has been lied to': made doc insists that aliens exist

https://www.theguardian.com/film/2025/nov/22/age-of-disclosure-documentary-aliens
2•handfuloflight•1h ago•0 comments

SecIron Is Recruiting for Technical Support in KL, Malaysia-Challenge Yourself

https://malaysia.indeed.com/job/mobile-app-securit-engineer-93c4f95524a00f8f
1•bboypy•1h ago•0 comments