frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

What's type-coverage, and why should I care?

https://pyrefly.org/blog/why-type-coverage/
1•ocamoss•1m ago•0 comments

Wall St. Scrutinizes Nvidia's Deal Machine

https://www.nytimes.com/2026/08/26/business/dealbook/nvidia-earnings-ai-investments.html
2•doener•2m ago•0 comments

HQ – Your infrastructure as a colony on Mars (local, real data)

https://github.com/cloudstudio/hq
1•cloudtudio•4m ago•0 comments

Cooperating with aliens and AGIs: An ECL explainer

https://www.lesswrong.com/posts/eEj9A9yMDgJyk98gm/cooperating-with-aliens-and-distant-agis-an-ecl...
1•Bluestein•5m ago•0 comments

Show HN: Routebase – One OpenAPI spec drives your docs, mocks, tests, monitors

https://routebase.dev/
1•driedl•7m ago•0 comments

I'm using Grok Bot to build a mobile game studio

https://ryanperry.io/post/grokbot-mobile-app-lifecycle
1•Rperry2174•12m ago•0 comments

Scientists make giant cyborg cockroaches that can fire drug-filled syringes

https://www.smh.com.au/national/scientists-make-giant-cyborg-cockroaches-that-can-fire-drug-fille...
1•dibbsonline•12m ago•1 comments

Grid Data Explorer

https://open-energy-transition.github.io/Awesome-Electrical-Grid-Mapping/
2•ly0n•12m ago•1 comments

PyCon26: LLM Governance, Guardrails, and Presidio When the Guardrail Leaks PII

https://www.petrostechchronicles.com/blog/How_I_Measured_The_PII_Layer
2•Aherontas•12m ago•1 comments

The Mismanaged Geniuses Hypothesis

https://alexzhang13.github.io/blog/2026/mgh/
1•ghuntley•13m ago•0 comments

Show HN: Zeitgeist Game – guess the date of a HN front page

https://zeitgeistgame.pages.dev/
1•mstipetic•13m ago•0 comments

The exoskeletons are coming (to a store near you)

https://www.nature.com/articles/d41586-026-02641-y
2•bookofjoe•17m ago•1 comments

Latency Optimizations on the System Level

https://denyspoltorak.medium.com/latency-optimizations-on-the-system-level-40dd45ddf2db
1•birdculture•18m ago•0 comments

Top Best AI Aggregators in 2026

https://data-infinityfreeapp.gt.tc
1•learningseo•19m ago•0 comments

LibreOffice 26.8: Tabbed UI improvements, better typography, and no AI

https://blog.documentfoundation.org/blog/2026/08/26/libreoffice-26-8/
3•mksaunders2•19m ago•0 comments

Apple Maps Ads Are Here, and There's No Way to Turn Them Off

https://www.macrumors.com/2026/08/25/apple-maps-ads-live/
4•robtherobber•20m ago•2 comments

Sevren: A new European AI lab developing open-source AI technologies

https://sevren.ai/news.html
2•OxyKodit•21m ago•1 comments

The Practical Side of Building AI Products in Production [video]

https://www.youtube.com/watch?v=nBQEaMC27eM
3•Harish_0089•22m ago•0 comments

Show HN: DBLift – database migration management for Python teams

https://dblift.com/
1•cmodiano•22m ago•0 comments

Show HN: Typebase – A single-folder back end you write in TypeScript

https://typebase.io
1•andrewww-dev•24m ago•0 comments

The Record: Predictions

https://longbets.org/predictions/
2•EndXA•25m ago•0 comments

PepsiCo Scraps Coverage of Weight-Loss Drugs for Employees

https://www.bloomberg.com/news/articles/2026-08-25/pepsico-scraps-coverage-of-weight-loss-drugs-f...
2•cramer4next•26m ago•0 comments

A Trillion Times Larger

https://0xsmac.substack.com/p/a-trillion-times-larger
1•tosh•27m ago•0 comments

Bill Gates warns A.I. is more dangerous than Big Tech will admit

https://www.nytimes.com/2026/08/26/technology/bill-gates-ai-risks.html
3•eternalreturn•29m ago•0 comments

MI Rep "I took off a dead voter and guess what? That dead voter was put back on"

https://twitter.com/WallStreetApes/status/2092567742914122117
4•bilsbie•29m ago•0 comments

As Ubuntu embraces AI, Debian discusses banning all AI-generated code

https://www.xda-developers.com/as-ubuntu-embraces-ai-debian-discusses-banning-all-ai-generated-code/
2•robtherobber•30m ago•0 comments

Oral-History: Frances "Fran" Allen

https://ethw.org/Oral-History:Frances_%22Fran%22_Allen#Working_on_Early_Supercomputers:_The_Stret...
1•Bluestein•30m ago•0 comments

Axera AX8850 LLM running ggufs

https://github.com/woolcoxm/LLMTest
1•woolcoxm•30m ago•0 comments

Moonshot AI wants 30% of what US clouds earn from Kimi K3

https://thenextweb.com/news/moonshot-k3-revenue-sharing-us-clouds
6•Aboutplants•33m ago•0 comments

The turbulent AI era is here. The choices we make now are critical.

https://www.gatesnotes.com/work/make-ai-work-for-everyone/reader/a-turbulent-ai-era-and-critical-...
1•nanna•33m ago•0 comments