frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

What we measured about "abandoned" software before trying to make money from it

https://github.com/constraint-works/constraint-works/blob/main/etsinta/JULKAISU-1.md
1•constraintworks•4m ago•0 comments

EU to restrict social media and chatbots for children under 15

https://www.ft.com/content/410db291-f133-4d72-b883-b2d5a32abbf8
3•1vuio0pswjnm7•4m ago•0 comments

Reid Hoffman – AI for All Americans

https://reidhoffman.substack.com/p/ai-dual-mandate
1•rmason•4m ago•0 comments

My MCP Server Dropped One Call in Four

https://datasignalslab.com/blog/my-mcp-server-dropped-one-call-in-four/
1•runvouch•5m ago•0 comments

Hacking the NuPhy Air60 keyboard: part 3

https://carlossless.io/nuphy-air60-part-3/
1•carlossless•6m ago•0 comments

One of China's Most Powerful AI Models Has Also Escaped Containment

https://www.wired.com/story/moonshot-kimi-k3-ai-model-escape-sandbox/
1•spenvo•7m ago•0 comments

Show HN: A game where the level is whatever web page you're on

https://page-rage.com/
2•alexreardon•7m ago•0 comments

Forgery of C2PA on a Pixel 10

https://www.hackerfactor.com/blog/index.php?/archives/1102-C2PA-and-Pixel-Glitter-Milk.html
1•birdculture•8m ago•0 comments

Flock (YC S17) dumped by Boston for sharing data in violation of contract

https://arstechnica.com/tech-policy/2026/09/boston-dumps-flock-says-it-shared-data-nationwide-in-...
4•tastyface•11m ago•0 comments

I Found One Interesting Open Source GitHub Gem

https://github.com/maximhq/bifrost
2•aanthonymax•11m ago•0 comments

OpenAI's rogue agents probed Hugging Face weaknesses months before major hack

https://www.reuters.com/legal/litigation/openais-rogue-agents-probed-hugging-face-weaknesses-two-...
2•EA-3167•11m ago•0 comments

You Can't Buy Ada Compliance with a Widget

https://www.complyy.io/blog/accessibility-overlays-dont-make-your-website-ada-compliant
2•complyyio•13m ago•1 comments

Panel Discussion: AI in Mathematical Research – Heidelberg Laureate Forum [video]

https://www.youtube.com/watch?v=H7_d_sgui6o
1•looofooo0•17m ago•0 comments

C++26: Trivial infinite loops are no longer undefined behaviour

https://www.sandordargo.com/blog/2026/09/16/cpp26-trivial-infinite-loops
1•jandeboevrie•17m ago•0 comments

Open Letter to Sir Paul Nurse, President of the Royal Society

https://docs.google.com/document/d/1-xOkPeHmDEdRigT2YcP2nLfTB56yOn4FFbBfVUIXCUE/edit?usp=sharing
2•sonicrocketman•19m ago•0 comments

Convert Your Chatbot's Markdown to Discord-Complaint Markdown

https://markdowntodiscord.com/
1•kennethwolters•22m ago•0 comments

Flet 1.0 released: build desktop, mobile, and web apps in Python

https://flet.dev/
1•appveyor•23m ago•1 comments

The ZSA Backpack

https://newsletters.feedbinusercontent.com/a07/a07862e8dacd093181d102b11d642f1ce4119ed2.html
3•robenkleene•24m ago•0 comments

You can now play doom directly from Proton Drive

https://drive.proton.me/urls/ES5MR2XFYW#3vheWMKe4eAv
1•ghostoftiber•25m ago•1 comments

Why AI's Biggest Rivals Are Suddenly Calling for Restraint

https://www.cfr.org/articles/why-ais-biggest-rivals-are-suddenly-calling-for-restraint
1•DeepLogin•26m ago•0 comments

AI Doomsaying Is an Aggressive Sales Pitch

https://jacobin.com/2026/09/openai-anthropic-human-extinction-criti-hype
1•PaulHoule•27m ago•0 comments

PriFi and the Incomplete Institution: Securing the Transaction Supply Chain

https://blog.logos.co/article/pri-fi-securing-transaction-supply-chain
1•michaelsbradley•27m ago•0 comments

I rated every track on 445 albums using public data, then built a game on it

https://debutle.com/
1•diestro•30m ago•0 comments

A Top Law Firm Went from Standing Up to Trump to Bending the Knee

https://www.nytimes.com/2026/08/02/us/politics/paul-weiss-trump.html
3•saeranv•31m ago•0 comments

Cortex: An open-source L1 memory and state layer for autonomous AI agents

https://github.com/cortex-protocol/cortex-protocol
1•BysertK•31m ago•0 comments

How good are frontier models at physics?

https://arxiv.org/abs/2609.13009
12•qt31415926•32m ago•2 comments

Vortex: One Format for Any Shape

https://spiraldb.com/blog/vortex-one-format-for-any-shape
4•ConnorTsui20•32m ago•1 comments

Neurogrid Terminal Coding Agent

https://github.com/NeuroGrid-AI-exchange/neurogrid-tui
2•cheyodev•37m ago•0 comments

Show HN: Padwan-LLM, a lightweight LLM Python client

https://github.com/polarsen-io/padwan-llm
2•Orelus•39m ago•0 comments

Show HN: Trail, a New Logic Game

https://trail.franzai.com/
2•franze•39m ago•1 comments