frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Show HN: Rendro – fills in security questionnaires and RFPs from your own docs

https://www.rendro.net
1•itslupichuk•1m ago•0 comments

3 D's of software: distribution, distribution, distribution

https://pgdog.dev/blog/distribution
1•levkk•1m ago•0 comments

Agentic Ordering on DoorDash

https://developer.doordash.com/en-US/mcp/
1•Zambyte•5m ago•0 comments

Show HN: Ryzova UCE – A local-first, rule-based software compatibility analyzer

https://uce.ryzova.com/analyze
1•manethsethnal•7m ago•0 comments

What's the worst bug an AI coding agent silently introduced into your code?

2•riyashikanedunc•9m ago•0 comments

The Escape Room Economy

https://twitter.com/nicholasachow/status/2115839602749849840
1•gmays•17m ago•0 comments

Anti-Monopolists Soared in the Midterms

https://www.thebignewsletter.com/p/ten-things-to-know-about-this-crushing
2•chmaynard•21m ago•0 comments

Letagents – let your coding agents talk across machines

https://letagents.talk/
1•pg_2023•21m ago•0 comments

Intent to Deprecate and Remove Google Chrome

https://dbushell.com/2025/11/01/intent-to-deprecate-and-remove-google-chrome/
1•gurjeet•23m ago•0 comments

Interactive Trillion Packet Anonymized Network Analysis with the GraphBLAS

https://ieeexplore.ieee.org/abstract/document/11196571
1•teleforce•27m ago•0 comments

Ask HN: Credit card and loyalty analytics, where to start?

2•scipio1551•27m ago•0 comments

Septaro, an AI-powered weekly reset to help you pursue your goals

https://septaro.com
1•buildforwardco•28m ago•0 comments

Newly discovered Bacteria uses Acetone for food

https://phys.org/news/2026-11-arctic-ocean-bacteria-acetone-carbon.html
1•silver92bullet•29m ago•0 comments

I rebuilt my earthquake tracker from scratch

https://klaxon.live/en
1•Accher•30m ago•0 comments

Agentic Network Traffic Monitoring

https://arxiv.org/abs/2609.32778
1•teleforce•32m ago•1 comments

Why Isn't Retatrutide Approved Yet?

https://lettersfrombethlehem.substack.com/p/why-isnt-retatrutide-approved-yet
3•Sniffnoy•35m ago•0 comments

OpenAI spent $1.2M in API cost to fix 948 Linux vulnerabilities

https://twitter.com/OpenAI/status/2118119451401048497
2•sidcool•36m ago•0 comments

The $18B Contingent Workforce Machine

https://burbank-ledger.pages.dev/articles/manpowergroup-experis-corporate-finance-audit/
1•measurablefunc•36m ago•0 comments

The White T-Shirt Experiment

https://whiteteelab.com/
1•Numerlor•37m ago•0 comments

Learnings from Auditing Public Evaluations

https://www.primeintellect.ai/blog/auditing-public-evaluations
1•gmays•43m ago•0 comments

Flims and TV shows created using AI have now reached a high level of quality

https://crateh.com/en
3•haebom•45m ago•0 comments

Magic Layers – Split a flat image into named, editable layers

https://magiclayers.net
2•dotcurio•52m ago•0 comments

Infinite Slop

https://infiniteslop.ai/
1•jdkee•59m ago•0 comments

Visual Positioning System for Trees

https://twitter.com/DjimoSerodio/status/2118157383369396289
2•MetaFarmer•1h ago•1 comments

Order of Adjectives

https://dictionary.cambridge.org/grammar/british-grammar/adjectives-order
1•thunderbong•1h ago•0 comments

Does Pretraining Teach Chemical Language Models Chemistry?

https://arxiv.org/abs/2610.18651
1•yz-exodao•1h ago•0 comments

How does a rocket engine work?

https://www.readfp.com/chapters/how-a-rocket-engine-works
2•shaikhmubin•1h ago•0 comments

Show HN: REMO – Free 4D web network connecting 24 cities with ad-free live radio

https://remoworld.com/
1•and11155•1h ago•0 comments

Transcribe Video to Text – Transcribe Video to Text Online Free

https://videotranscriber.ai/
1•Lemarie•1h ago•0 comments

CVS to Split Off Drugstore Business, Ending Its Bigger-Is-Better Era

https://www.nytimes.com/2026/11/04/business/cvs-health-split.html
2•ChrisArchitect•1h ago•1 comments