frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Cackle Pop Roar Reptiles have a lot to say

https://knowablemagazine.org/content/article/living-world/2026/the-surprising-sounds-made-by-rept...
1•randomImmigrant•29s ago•0 comments

Rubio Uses Terrorism Law to Ban Secure Email Service

https://reason.com/2026/08/27/rubio-uses-terrorism-law-to-ban-secure-email-service/
1•KomoD•9m ago•1 comments

Judge blocks Pentagon blacklist of Anthropic as supply chain risk

https://www.cnbc.com/2026/08/28/judge-blocks-pentagon-blacklist--anthropic-.html
1•magoghm•9m ago•0 comments

West Point Professor Fired for Refusing to Lie About Climate Change

https://newrepublic.com/post/214853/west-point-professor-fired-refusing-lie-climate-change
1•petethomas•9m ago•0 comments

We will need more (not fewer) scientists

https://blog.valency.io/posts/we-need-more-scientists
1•joshbloom•11m ago•1 comments

Lake America? Spare Us

https://www.nationalreview.com/corner/lake-america-spare-us/
8•petethomas•17m ago•0 comments

Dev.fast: Cursor for Code Review

https://dev.fast/
1•handfuloflight•19m ago•0 comments

GenRec: An LLM-Backed Recommendation Ranker at Netflix

https://arxiv.org/abs/2608.10257
1•armcat•25m ago•0 comments

The World Needs a Plan

https://garymarcus.substack.com/p/excellent-new-bill-gates-essay-on
2•soltanov•25m ago•1 comments

Synchronisation and SMPTE timecode (time code)

https://www.philrees.co.uk/articles/timecode.htm
2•sublinear•27m ago•0 comments

Float Bloat: vector serialization gone wrong

https://bonsai.io/blog/float-bloat/
1•signa11•28m ago•0 comments

Debating Christopher Nolan's the Odyssey

https://medium.com/theentertainmentbreakdown/debating-christopher-nolans-the-odyssey-429a292e2cc7
1•raynchad•28m ago•0 comments

To Silicon Valley, anything could be a 'psyop'

https://www.cnn.com/2026/08/27/us/word-of-week-psyop-data-centers-cec
2•1659447091•31m ago•0 comments

Bandwidth vs. Latency: What Matters for Live Streaming?

https://www.red5.net/blog/bandwidth-vs-latency/
1•mondainx•34m ago•0 comments

Django-query-guard – Pytest plugin for Django N+1 query detection

1•hacker-pro•35m ago•0 comments

Making EUV: From Lab to Fab

https://www.asml.com/en/company/stories/2022/making-euv-lab-to-fab
2•o4c•39m ago•0 comments

Postgres 19: What's new in monitoring?

https://clickhouse.com/blog/postgres-19-monitoring-whats-new
1•saisrirampur•45m ago•0 comments

In response to Polish government, Meta admits the scale of scam ads

https://twitter.com/KGawkowski/status/2092567740116562116
3•franczesko•47m ago•0 comments

The HEIC to JPG Step That Changes Your Colors

https://heic-color-shift.web.app/
5•Hackergeist•51m ago•2 comments

Nepal Needs Your Help

https://www.bbc.com/news/live/cr0qxd1y219kt
1•pokhareel•53m ago•0 comments

In the product end game, every change carries significant risk

https://devblogs.microsoft.com/oldnewthing/20091104-01/?p=16143
3•anitil•53m ago•1 comments

About legal tech, because I can't sleep

https://patent.dev/about-legal-tech-because-i-cant-sleep/
2•funktionslust•54m ago•0 comments

Recording shows Alabama Power lobbyist discussing bill to appoint utility regula

https://www.wbrc.com/2026/02/16/recording-shows-alabama-power-lobbyist-discussing-bill-appoint-ut...
3•newsomix9xl•58m ago•1 comments

A Turning Point in AI Writing

https://www.theatlantic.com/technology/2026/08/wall-street-journal-ai-op-ed/688433/
1•petethomas•1h ago•0 comments

In a divided America, left and right unite to oppose AI data centers

https://apnews.com/article/data-centers-bipartisan-opposition-trump-democrats-a419be82fb6b32a8fc0...
2•1vuio0pswjnm7•1h ago•0 comments

MI: Measure Price Calculator – AI Pricing for Shopify

https://apps.shopify.com/mi-measure-price-calculator
2•motion-hero•1h ago•0 comments

Leibniz's Philosophy of Physics

https://plato.stanford.edu/archives/fall2024/entries/leibniz-physics/
4•andsoitis•1h ago•0 comments

Show HN: My fast TUI Finnish-English dictionary is now in the browser via WASM

https://taskusanakirja.com/
1•hiAndrewQuinn•1h ago•0 comments

£50k needed to purchase church with Maxwell's grave

https://www.bbc.com/news/articles/cjw5d121x9lo
5•dboreham•1h ago•2 comments

Entropy – Mental Model

https://read.perspectiveship.com/p/entropy
1•fagnerbrack•1h ago•0 comments