frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Neovim Plugin for Blazingjj

https://opencommit.eu/sejo/blazingjj.nvim
1•sejo•5m ago•1 comments

Valve will stop selling Steam gift cards at retailers over scam concerns

https://www.pcgamer.com/gaming-industry/valve-will-stop-selling-steam-gift-cards-at-retailers-ove...
2•josephcsible•17m ago•0 comments

Just me feeling that Mythos/Fabel just 1% there?

1•punnerud•17m ago•0 comments

Validation, Docs, tests, and database schemas from one source of truth

https://github.com/justhamade/triadjs
1•justhamade•21m ago•1 comments

Humans ask, computers propose, humans decide

https://jakemccrary.com/blog/2020/11/14/speeding-up-magit/
2•signa11•22m ago•0 comments

"Trust Us" Is Not a Control Surface: Anthropic and the Case for Open Weights

https://trust-us.vercel.app
1•tonydavis•23m ago•0 comments

Smartphones Broke British Politics

https://www.politico.eu/article/keir-starmer-uk-prime-minister-resignation-brexit-whatsapp-westmi...
2•giuliomagnifico•24m ago•0 comments

Canada introduces legislation to ban social media for children under 16

https://www.reuters.com/legal/litigation/canada-introduces-legislation-ban-social-media-children-...
3•thm•30m ago•0 comments

Allegro

https://liballeg.org/
1•tosh•34m ago•0 comments

Ask HN: What internal tool did you build that became a product?

2•nehpets•35m ago•1 comments

CopenPay returns and Copenhagen now rewards tourists who arrive by train

https://www.denmarklifestyledaily.com/article/812071964-copenpay-returns-3-times-bigger-copenhage...
1•slu•38m ago•0 comments

The dispute over what caused Air India flight 171 to crash

https://www.bbc.com/news/articles/cwyk9exxp2qo
2•1659447091•38m ago•0 comments

OpenAI mulls slashing prices as it competes with Anthropic for users

https://www.cnbc.com/2026/06/11/openai-mulls-slashing-prices-ahead-of-competition-from-anthropic-...
30•agentifysh•39m ago•16 comments

Show HN: I built a Red Flag Warning zone-check tool for the East Bay in 48h

https://redflag-check.info
2•vedant28t•39m ago•0 comments

Show HN: Vaportrail – flight recorder for Claude Code, Codex, and OpenCode

https://github.com/B33BMO/vaportrail
2•b33bmo•40m ago•1 comments

Tesla robotaxis stall as Musk's self-driving hype hits real-world traffic

https://www.latimes.com/business/story/2026-06-10/tesla-robotaxis-stall-as-musks-self-driving-hyp...
3•1vuio0pswjnm7•41m ago•0 comments

YouTube terms of service allow AI music training, Google says

https://www.billboard.com/pro/google-youtube-terms-of-service-ai-music-training-lawsuit/
1•sdoering•42m ago•1 comments

Feds move to formally allow sports "trading" on prediction markets

https://www.axios.com/2026/06/10/cftc-prediction-markets-sports-event-contract-rules
1•1vuio0pswjnm7•48m ago•0 comments

Nearly Everyone, Everywhere, Veers Left When Walking

https://www.nytimes.com/2026/06/10/science/humans-walking-veer-left-counterclockwise.html
4•bryanrasmussen•49m ago•2 comments

Agentic Frameworks

https://astledsa.substack.com/p/agentic-frameworks
1•astledsa•51m ago•0 comments

Adafruit files suit against Flux.ai over legal threats [pdf]

https://storage.courtlistener.com/recap/gov.uscourts.cand.471648/gov.uscourts.cand.471648.1.0.pdf
4•russdill•54m ago•1 comments

TokenPulse – Live token and rate limit tracker for Claude and ChatGPT

https://chromewebstore.google.com/detail/tokenpulse-—-chatgpt-clau/oimclhdbljodjkankcnalklchfce...
1•Anoop69_•55m ago•0 comments

TikTok

https://tiktok-guahdfjhshrk.com
1•DARKNNESSANKC•56m ago•0 comments

Grit by GitButler: A from-scratch reimplementation of Git in idiomatic Rust

https://github.com/gitbutlerapp/grit
2•maxloh•59m ago•0 comments

It blocked us at 'hello ' Anthropic Fable 5 refusing innocuous prompts

https://www.theregister.com/ai-and-ml/2026/06/10/anthropic-claude-fable-5-refuses-innocuous-promp...
10•abliterationai•1h ago•1 comments

I built a tool that reads code and lists features with file:line refs

https://www.verifiablyai.com/projects/requests
1•arvvind•1h ago•0 comments

Join-Calculus

https://en.wikipedia.org/wiki/Join-calculus
1•tosh•1h ago•0 comments

See what your AI coding agent is doing with Datadog Lapdog

https://chrisebert.net/see-what-your-ai-coding-agent-is-doing-with-datadog-lapdog/
1•cebert•1h ago•0 comments

Terms of Service Ban AI Agents from Using Stack Overflow for Agents

https://meta.stackoverflow.com/questions/438910/introducing-stack-overflow-for-agents
3•nomilk•1h ago•0 comments

Sales Is the Customer Clock

https://hari.computer/sales-is-the-customer-clock
2•andytratt•1h ago•0 comments