frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Flock Offers Employees Buyouts as Customers Flee

https://www.wired.com/story/flock-is-offering-voluntary-buyouts-to-employees/
1•ent101•6m ago•0 comments

Why People Are Sabotaging Flock Surveillance Cameras

https://www.nytimes.com/2026/09/18/opinion/flock-cameras-ai-privacy.html
1•trinsic2•15m ago•2 comments

I accidentally created a mini-Jev and you can too

https://medium.com/@gouravd_61431/i-accidentally-created-a-mini-jev-for-splitting-expenses-and-yo...
1•das_vicky•15m ago•0 comments

Fly-paradise: Fruit flies on your Windows desktop

https://github.com/pyd021226/fly-paradise
1•csmantle•19m ago•0 comments

SDCC – Small Device C Compiler

https://sdcc.sourceforge.net/
6•lioeters•24m ago•0 comments

Swarm_ethics.txt

https://www.guidavid.com/writing/autopoietic-ethics-constitution.txt
1•gdss•26m ago•0 comments

Managers Are Catalysts

https://laughingmeme.org/2026/09/14/managers-are-catalysts.html
1•mavelikara•28m ago•0 comments

Opus 5 has a Noun Problem

https://www.reddit.com/r/ClaudeCode/comments/1wk0s2i/opus_5_has_a_noun_problem/
1•nonethewiser•31m ago•1 comments

Science Is Open Software

https://jepedersen.dk/blog/202505_research/
12•jegp•35m ago•6 comments

Show HN: LaTeX to Image Converter – Free PNG, SVG and JPG

https://latextoimg.com
1•light001•38m ago•0 comments

Let's Fix Bug Bounty

https://fixbugbounty.com/
2•nwang783•41m ago•0 comments

The Rise of Parasite Authors

https://www.theatlantic.com/technology/2026/09/ai-authors-impersonating-writers-amazon/688709/
5•pseudolus•41m ago•1 comments

Show HN: Swormhörn a one-of-one cicada synthesizer [video]

https://www.youtube.com/watch?v=GHiStriaaso
2•zorlack•44m ago•0 comments

Elon Musk and Tesla Forged a New EV Path

https://spectrum.ieee.org/elon-musk-tesla
5•vinhnx•47m ago•1 comments

Einstein on the Atomic Bomb (1945)

https://www.theatlantic.com/magazine/archive/1945/11/einstein-on-the-atomic-bomb/656626/
3•cisc•51m ago•0 comments

Official mold linker rewrite in Rust

https://github.com/rui314/mold
2•adamnemecek•53m ago•0 comments

I found love at an Irish matchmaking festival – and I want others to do the same

https://www.bbc.com/news/articles/cw5y4jz6k2p3o
1•rmason•55m ago•1 comments

The Contract on America

https://3quarksdaily.com/3quarksdaily/2026/09/the-contract-on-america.html
17•hkhn•55m ago•12 comments

Plotly for Highly Customizable and Non-Interactive Data Visualization

https://chris-parmer.com/plotly-for-highly-customizable-and-non-interactive-data-visualization/
1•chriddyp•58m ago•0 comments

Master of Malt Hacked, User Data Compromised

https://www.masterofmalt.com/sorry/
1•Naracion•59m ago•0 comments

Prompts Aren't Real

https://evaluation.club
1•mcfunley•1h ago•1 comments

Kev – A Jev-Compatible API on top of DiffusionGemma running on Workers AI

https://kev.workers-ai-mle.workers.dev/
1•kflansburg•1h ago•1 comments

Gemini hacked three companies in first known breakout by Google's AI

https://www.reuters.com/business/gemini-hacked-three-companies-first-known-breakout-by-google-ai-...
12•usernomdeguerre•1h ago•8 comments

Nuclear tests at Mt. Mantap have reactivated intraplate faults

https://www.science.org/doi/10.1126/science.adx5917
1•geox•1h ago•0 comments

NIST Elliptic Curves Seeds Bounty (2023)

https://words.filippo.io/seeds-bounty/
2•greyface-•1h ago•0 comments

Google's Gemini becomes latest AI model to break out and hack computer systems

https://www.cnbc.com/2026/09/18/googles-gemini-becomes-latest-ai-model-to-break-out-and-hack-comp...
5•ahmedhossamdev•1h ago•1 comments

Australian government considers ban on smart glasses in public buildings

https://www.theguardian.com/technology/2026/sep/17/albanese-government-considers-world-leading-ba...
2•dabinat•1h ago•0 comments

Muse gets all your unclaimed money back!

https://auth.muse.ai/aymh/?origin=https%3A%2F%2Fmuse.ai
1•mayahalp•1h ago•0 comments

Show HN: Typesafe Java SDK (Unofficial)

https://github.com/QAInsights/typesafe-java-sdk
1•qainsights•1h ago•1 comments

The Race for 1000 Goals

https://1k.football/
1•anydigital•1h ago•0 comments