frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

What does Claude thinks of the IPO? [video]

https://www.youtube.com/watch?v=LvqLsBBL_zY
1•newuser94303•3m ago•1 comments

Show HN: Harness for building/cloning SaaS using open-weight models

https://neander.ai/
1•kushjoy•6m ago•0 comments

We don't need no education platform evolution

https://www.theregister.com/columnists/2026/11/16/we-dont-need-no-education-platform-evolution-he...
1•zombot•8m ago•0 comments

Pi-memory: persistent memory extension for pi

https://github.com/jayzeng/pi-memory
1•_kb•11m ago•0 comments

Adopting AI inside an organization that has to pass a compliance audit

https://zimmergren.net/ai-and-compliance/
2•zimmergren•15m ago•0 comments

AI Slop Spiral

https://nolanfrausto.com/posts/ai-slop-spiral/
2•frausto•15m ago•0 comments

Android Fast Switch looks like Google's answer to iPhone Handoff

https://www.androidauthority.com/android-fast-switch-handoff-3735737/
2•thunderbong•21m ago•0 comments

40-domain study: 80% of Shopify stores expose /API/ucp/MCP, 0% /agents.md

https://verisource.dev/benchmarks/ai-search-readiness-2026
1•kulinichnick•24m ago•0 comments

I built GURU. The open source ultimate hacker tool ANYBODY can use

https://github.com/GuruProduction/GURUbyUnusLumen
3•introducingGURU•24m ago•0 comments

Anyone Uses Perplexity? and for What?

2•aashu_bel•26m ago•0 comments

What Is the Internet?

https://www.tinylogger.com/max/f6DDYMm6gJRDDgXl
1•kurinikku•28m ago•0 comments

Maxwell V1 Flash

https://huggingface.co/maxwell-model/Maxwell-V1-Flash
1•ByteAtATime•29m ago•0 comments

Clarification Statement on Wall Street Journal's Article

https://www.mha.gov.sg/media-room/newsroom/clarification-statement-on-wall-street-journals-article/
1•aurareturn•30m ago•0 comments

15M emails and documents reveal the dark secrets of Deutsche Bank

https://www.spiegel.de/wirtschaft/unternehmen/deutsche-bank-datenleak-inside-deutsche-bank-enthue...
3•doener•31m ago•0 comments

Rex Demo: Remote Copy/Paste, Drag/Drop, and Port Forwarding [video]

https://www.youtube.com/watch?v=pkH_WJApzH0
1•nikolay•31m ago•0 comments

The Productivity Trap

https://lindbakk.com/blog/the-productivity-trap
1•atomfinger•32m ago•0 comments

Claude Code Course: Credits Included

1•feynmansletters•33m ago•0 comments

Mizan bias benchmark: testing AI models

https://mizan.techforpalestine.org/hostage-or-detainee/
1•k1m•34m ago•0 comments

TokenEconomizer: Learning from Experience to Make AI Coding Agents Efficient

https://www.microsoft.com/en-us/research/blog/tokeneconomizer-learning-from-experience-to-make-ai...
1•matt_d•34m ago•0 comments

OVH releases first model with EU public funding and supercomputer access

https://twitter.com/olesovhcom/status/2122573582911869173
5•noplay•38m ago•0 comments

Show HN: Groovyfmt, a fast formatter for Groovy, Gradle and Jenkinsfiles

https://github.com/costajohnt/groovyfmt
1•costajohnt•38m ago•0 comments

Trump's stake in Nvidia grew to as much as $62M before scandal broke out

https://www.washingtonpost.com/business/2026/11/16/trumps-stake-nvidia-grew-much-62-million-befor...
1•doener•40m ago•0 comments

Sacha Baron Cohen Emails Sheryl Sandberg

https://twitter.com/TechEmails/status/2121994481797136583
2•theanonymousone•40m ago•0 comments

OpenScientist: An Open AI System That Automates Biomedical Research

https://www.nature.com/articles/s41591-026-04808-6
1•tibastral2•41m ago•0 comments

Building a Rust-Native, Cross-Language Foundation for Agentic ML Compilers

https://tvm.apache.org/2026/11/16/rust-native-cross-language-ml-compiler-foundation
1•matt_d•42m ago•0 comments

Collatz Conjecture (2022)

https://zerolimits.dev/blog/collatz-conjecture
1•sammatilda•45m ago•0 comments

California sues ChatGPT maker OpenAI over rogue hacking incidents

https://www.nbcnews.com/tech/tech-news/california-sues-chatgpt-maker-openai-rogue-hacking-inciden...
1•slu•46m ago•0 comments

Beyond Score Centering: What Else Can We Optimize in Async RL?

https://sky-posttrain.github.io/score-centering-async-rl/
1•matt_d•46m ago•0 comments

Show HN: Backplane – An AI Development Environment for Hardware

https://backplaneworks.com/
2•i2cjak•47m ago•1 comments

Releasing Personal Agent Protocol 1.0

https://sierra.ai/blog/releasing-poppy
2•gmays•58m ago•0 comments