frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Show HN: GLYP – A shared canvas you can draw on via SSH

https://glyp.online/
1•moononite•1m ago•0 comments

Detect and send production issues straight to your agent in Cloudflare

https://blog.cloudflare.com/real-time-issue-detection/
1•sidcool•1m ago•0 comments

Dots is not available in Europe:/

https://help.openai.com/en/articles/20001530-getting-started-with-your-dot
1•perganomoly•1m ago•1 comments

Who Runs Elixir in Production

https://sublimecoding.com/blog/elixir-in-production-fact-checked
1•sublimecoding•2m ago•0 comments

Show HN: Dad Joke Archive

https://www.instagram.com/pappawalejoke
1•chaturabhishek•3m ago•0 comments

I built an isometric office where my AI models work (and Slack off)

https://github.com/s4ps4n/prompt-hospital
1•sapsanius•4m ago•0 comments

Agent Skills: 4 Powerful Ways to Improve Enterprise AI

https://devnavigator.com/2026/09/30/agent-skills-contextualized-execution/
1•thescienceguy93•4m ago•0 comments

RIP, Vector Database

https://turbopuffer.com/blog/rip-vector-database
1•emschwartz•4m ago•0 comments

Show HN: An App that names each cell in a spreadsheet

https://demo.graphcell.co.uk/?demo=1
1•BraamV•5m ago•0 comments

Show HN: Jauvex 1.3 released. Turn any agent task into automated workflows

https://github.com/reindent/jauvex
1•daraosn•7m ago•1 comments

Show HN: Riffle – Switch between windows of the current Mac app with Option-Tab

https://github.com/voising/riffle
1•voising•7m ago•0 comments

Show HN: Offlineisbetter: Efficient Models for Text on CPU

https://github.com/offlineisbetter/offlinedemo
1•chronicallyoffl•8m ago•1 comments

Radsort: A parallel O(sqrt n) overhead LSD radix sort

https://arxiv.org/abs/2607.05302
1•fanf2•9m ago•0 comments

Bill Gates' blunt warning on AI

https://www.nytimes.com/2026/09/29/opinion/ezra-klein-podcast-bill-gates.html
1•andsoitis•9m ago•0 comments

JsPad: Instant Playground for the Web

https://jspad.dev/
1•eustoria•13m ago•0 comments

I can't tell who's teaching who anymore

https://blog.murphytrueman.com/i-cant-tell-whos-teaching-who-anymore/
1•eustoria•14m ago•0 comments

A physical Version of the AI Singularity

https://economist.com/by-invitation/2026/09/29/theres-a-physical-version-of-the-ai-singularity-an...
1•andsoitis•14m ago•0 comments

Show HN: Paperweight – local-first, open-source email cleanup and privacy tool

https://github.com/wslyvh/paperweight
2•wslyvh•14m ago•0 comments

Pentagon data breach of military personnel raises national security concerns

https://www.cnn.com/2026/09/25/politics/pentagon-data-personnel-breach
1•eustoria•14m ago•0 comments

SDF Public Access Unix System ... est. 1987

https://sdf.org/
1•kmstout•15m ago•0 comments

Agent interactions are failing silently

https://merj.com/blog/agent-interaction-research
6•ryansiddle•15m ago•0 comments

Show HN: Burning Man for Agents

https://burning-tokens.transitivebullsh.it/
1•transitivebs•16m ago•0 comments

A Brief History of the Bloomberg Terminal

https://spectrum.ieee.org/bloomberg-terminal
2•rbanffy•17m ago•0 comments

Disgust, Desire, and Durian

https://daily.jstor.org/disgust-desire-and-durian/
1•herbertl•18m ago•0 comments

AI CEO Panel [video]

https://www.youtube.com/watch?v=DlTNN0gvkLM
1•doruk101•18m ago•0 comments

Show HN: Singapore MRT announcements app – Built for my son

https://kavyaj.github.io/mrt-announcements/
1•kavyaj•18m ago•1 comments

Show HN: Select text, right click to fact-check

https://evergreen-labs.org/products/credibility-analyzer
1•billylo•19m ago•0 comments

MI5 issues spy alert to UK universities over Chinese front co. stealing research

https://www.theguardian.com/uk-news/2026/sep/30/mi5-issues-spy-alert-over-body-linked-chinese-sta...
1•chrisjj•19m ago•1 comments

'Attention Infidelity' Is Ruining Romance

https://www.nytimes.com/2026/09/30/opinion/attention-infidelity-ruin-romance.html
2•voxleone•20m ago•2 comments

Tech Giants Face Questions over Secret AI Data-Center Deals

https://www.wsj.com/politics/policy/tech-giants-face-questions-over-secret-ai-data-center-deals-b...
1•elsewhen•21m ago•0 comments