frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

TSMC Approves $1B AI Investment

https://www.macrumors.com/2026/11/11/tsmc-approves-ai-investment/
1•tosh•1m ago•0 comments

Open research, stronger privacy: Making Firefox users harder to fingerprint

https://blog.mozilla.org/security/2026/11/10/open-research-stronger-privacy-making-firefox-users-...
2•Vinnl•2m ago•0 comments

Self-Building Labs

https://self-building-labs.github.io/
1•zoizoi•3m ago•0 comments

Show HN: Kodelyth ECC – 71 AI agents and MCP and 55% token cuts for Claude Code

https://ecc.kodelyth.com
2•sifxprime•6m ago•0 comments

Australia considers criminal penalties for rogue AI in wake of OpenAI hack

https://www.bbc.co.uk/news/articles/cmp3g37l566po
3•rwmj•11m ago•1 comments

ClankTalk – Sandboxed Scripting for Agents

https://clank.talk/
2•renerick•15m ago•0 comments

Can a Linear Program Do Weight-Space Programming?

https://nathan.rs/posts/weight-space-lp/
2•emschwartz•15m ago•0 comments

Ponovo-sysinfo – a UEFI app to identify hardware (made for refurb, repair shops)

https://gitlab.com/ponovo/Sysinfo
1•marxo•16m ago•0 comments

We need more goat sacrifices

https://www.experimental-history.com/p/we-need-more-goat-sacrifices
1•iamnothere•16m ago•0 comments

Change in Opening Engineering Roles over the Past Year

https://twitter.com/lennysan/status/2120274852766703938
1•MrBuddyCasino•16m ago•0 comments

Notes on Mathematics for Engineers (1959) [pdf]

https://websites.umich.edu/~ners311/CourseLibrary/MathNotes.pdf
2•the-mitr•20m ago•0 comments

Portals

https://portals-endless-worlds.netlify.app/
1•andybak•21m ago•0 comments

Sony Wins "Hall of Shame" Award for Killing Discs and Being All Around Awful

https://www.thegamer.com/sony-choice-hall-of-shame-shonky-award-2026-killing-discs/
1•robtherobber•27m ago•0 comments

Show HN: Inp-Analyser – MIT CLI That Diagnoses Interaction to Next Paint

https://inp-analyser.franzai.com/
1•franze•28m ago•0 comments

GeekyAnts reports No. 1 ranking among California app developers on Clutch

https://geekyants.com/blog/geekyants-ranks-no-1-among-app-development-companies-in-california-on-...
1•Harish_0089•28m ago•0 comments

State of the tech job market: late 2026

https://www.lennysnewsletter.com/p/state-of-the-tech-job-market-late
1•davedx•28m ago•1 comments

Show HN: Faraway – Physically accurate solar system, time travel 1900–2100

https://faraway.space/
3•qianyiyu•28m ago•0 comments

The coin-flipping trick that counts the Internet

https://www.scientificamerican.com/article/the-coin-flipping-trick-that-counts-the-internet/
1•sohkamyung•30m ago•0 comments

Show HN: Aiproxy – Redact PII locally before it reaches Claude/OpenAI

https://github.com/cucooOnGithub/aiproxy
1•cucoo•30m ago•0 comments

Grok API text watermarking is now 'off' by default

https://docs.x.ai/developers/advanced-api-usage/watermarking
1•apalerwuss•35m ago•1 comments

How OpenAI, Canva and Spotify made slow CI steps up to 20x faster

https://berrybox.io/playbooks
1•chiragasarpota•35m ago•0 comments

Next-Level Benchmarking Overfitting – Thomas Neumann

http://databasearchitects.blogspot.com/2026/11/next-level-benchmarking-overfitting.html
2•artrax•36m ago•0 comments

Show HN: Who Wins? (Daily Mini Game)

https://crux.quest/who-wins/
2•saretup•36m ago•0 comments

Show HN: Browser-based PDF and image tools that never upload your files

https://bytepriva.com/exif-remover/
1•bytepriva•38m ago•0 comments

Turning a Cheap Photo Frame into a Family Wall Display (Without Trusting It)

https://timothyjohnsonsci.com/writing/2026-11-06-photo-frame-wall-display/
1•adunk•39m ago•0 comments

We need more science in the judgment of AI

https://livingsystems.substack.com/p/we-need-more-science-in-the-judgment
1•samuell•39m ago•0 comments

Nvidia Vera CPU Review: 2TB/S Memory Bandwidth, a Real x86 Rival

https://www.storagereview.com/review/nvidia-vera-cpu-review
3•rbanffy•39m ago•0 comments

Show HN: Agent Buddies – Swappable animated characters for AI agents

https://izr8809.github.io/agent-buddies/
1•izr8809•40m ago•0 comments

Google SWE points 48 AI agents at NASA Lidar, finds unmapped Maya pyramid in 72h

https://pietromiotti.com/latest/maya-site/?maya
4•eyvindn•40m ago•1 comments

Dee the Cat

https://mihaiolteanu.me/dee-the-cat
1•molteanu•40m ago•0 comments