frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Scientists' Side Hustle? Using AI and Quantum Computing to Generate New Peptides

https://www.wired.com/story/scientists-using-ai-and-quantum-computing-to-generate-new-peptides/
1•joozio•26s ago•0 comments

AI Agents Are About to Change Payments Operations

https://open.spotify.com/episode/41kRSmDW5IKhvamyzlPxqq
1•siroj•1m ago•1 comments

25% long-form social media posts appear AI-generated

https://www.theregister.com/ai-and-ml/2026/07/09/ai-slop-writing-has-taken-over-the-internet-part...
1•u1hcw9nx•2m ago•0 comments

Laws of Project Management

https://www.lucasfcosta.com/blog/laws-of-software-project-management
2•lucasfcosta•4m ago•0 comments

Some features work in design meetings but fail in the real world

https://mattcasmith.net/2026/07/12/feature-design-testing
1•mattcasmith•5m ago•0 comments

OpenAI's Head of Safety Is Leaving the Company

https://www.wired.com/story/openai-head-of-safety-leaving/
1•theanonymousone•6m ago•0 comments

Databricks AI Agent Genie Code Is No Longer Free. Now You Have to Pay as You Go

https://medium.com/databrickscommunity/databricks-ai-agent-genie-code-is-no-longer-free-now-you-h...
1•protmaks•8m ago•0 comments

Databricks News: CLI v1.0.0, AI-tools, Docker, DABs UI sync, mutators

https://medium.com/databrickscommunity/databricks-news-cli-v-1-0-0-ai-tools-last-updated-25th-may...
1•protmaks•8m ago•0 comments

Understanding the Databricks Genie Family: Which Genie Is Right for You?

https://medium.com/databrickscommunity/understanding-the-databricks-genie-family-which-genie-is-r...
1•protmaks•8m ago•0 comments

The Proportional Web

https://owickstrom.github.io/the-proportional-web/
1•g0xA52A2A•11m ago•0 comments

Chasing new skills, going back to basics: how software engineers adapting to AI

https://www.theguardian.com/technology/ng-interactive/2026/jul/12/software-developers-engineers-ai
1•beardyw•11m ago•0 comments

Clodex – Open-source agentic IDE with governed execution and graph memory

https://github.com/mereyabdenbekuly-ctrl/clodex-ide
1•clodex_lab•15m ago•0 comments

Sen. Lindsey Graham dies at 71 after 'brief and sudden illness'

https://www.nbcnews.com/politics/politics-news/sen-lindsey-graham-dies-71-brief-sudden-illness-rc...
8•colinprince•16m ago•2 comments

An AI gateway that signs a receipt for every LLM response

https://github.com/AxioRank/gateway/tree/main
1•axiorank•16m ago•0 comments

Solving Santa Claus Puzzle

https://wyounas.github.io/puzzles/concurrency/2026/01/10/how-to-help-santa-claus-concurrently/
1•simplegeek•34m ago•0 comments

Littlenavmap

https://github.com/albar965/littlenavmap
1•marklit•37m ago•0 comments

Datacentres drive up big tech's carbon emissions to a third of those of France

https://www.theguardian.com/us-news/2026/jul/11/microsoft-amazon-google-datacentre-carbon-emissio...
3•YeGoblynQueenne•37m ago•3 comments

Sonnet Encore/ST G4: How a Tiny Capacitor Destroyed a Rare Upgrade

https://retroreverend.com/blog/tantalum-fall-down-go-boom-how-a-tiny-capacitor-destroyed-one-of-t...
1•rbanffy•40m ago•0 comments

The Advantages of Flexible Typing

https://sqlite.org/flextypegood.html
1•ingve•42m ago•0 comments

Oh dear, did someone steal something from Apple?

https://www.businessinsider.com/apple-openai-trade-secrets-masimo-a123-jony-ive-2026-7
4•CrypticShift•43m ago•1 comments

Show HN: Sanbox, batteries included sandboxes for AI agents

https://sanbox.cloud
2•oryx1729•44m ago•0 comments

Google Opposes Site Blocking in Europe as US Piracy Blocking Plans Gain Momentum

https://torrentfreak.com/google-opposes-site-blocking-in-europe-as-u-s-piracy-blocking-plans-gain...
2•gslin•45m ago•0 comments

Death of the Status Update: Why 55% of Americans Stopped Posting on Social Media

https://ca.pcmag.com/social-media/16790/the-death-of-the-status-update-why-55-of-americans-stoppe...
6•thunderbong•46m ago•2 comments

Reflections on building a closed‑source consumer audio tool

https://github.com/AdBusterOfficial
1•Bo_Amigo_910•47m ago•0 comments

I built an AI strength coach because I wanted my training backed by real studies

https://github.com/clementrx/Performance-agent/tree/main
2•clementrx•49m ago•1 comments

CEO Pleads with AI Industry to Stop Charging So Much to Replace Human Labor

https://futurism.com/future-society/palo-alto-ceo-ai-arora-automation-labor
4•latexr•51m ago•0 comments

Show HN: Fenzo – Build an interactive course on any topic

https://fenzo.ai/
3•fahimulhaq•52m ago•0 comments

Show HN: Display Big Text on Screen

https://bigtext.net/
2•liquid99•54m ago•0 comments

Show HN: Spendict – a performance marketer's verdict for AI agents, over MCP

https://www.spendict.com/
2•ds246•58m ago•0 comments

Cloud Rebuild (Preview)

https://learn.microsoft.com/en-us/windows/configuration/cloud-rebuild/
1•taubek•1h ago•0 comments