frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Valve/Collabora Release Holo Core Custom Aarch64 Arch Linux Port for Steam Frame

https://www.linuxcompatible.org/story/valve-and-collabora-release-holo-core-a-custom-aarch64-arch...
1•_____k•7m ago•1 comments

Email Is Crazy

https://samkhawase.com/blog/email-is-crazy/
1•fagnerbrack•7m ago•0 comments

Same Idea, Different Decade

https://fagnerbrack.com/same-idea-different-decade-4abaa13ed0f0
1•fagnerbrack•7m ago•0 comments

Lean Programming Language

https://lean-lang.org/
1•fagnerbrack•8m ago•0 comments

Prodigy – AI Workforce for professional teams

1•samayashar•9m ago•0 comments

Order of Magnitude Physics a Textbook with Applications to the Retinal Rod(1998) [pdf]

https://www.inference.org.uk/sanjoy/thesis/thesis-letter.pdf
1•nill0•12m ago•0 comments

The Art of Insight in Science and Engineering – Mastering Complexity(2014) [pdf]

https://ocw.mit.edu/courses/res-6-011-the-art-of-insight-in-science-and-engineering-mastering-com...
1•nill0•16m ago•0 comments

SIMD Vectors in the HotSpot JVM [video]

https://www.youtube.com/watch?v=KpCz6UtViEo
1•tosh•19m ago•0 comments

Kimi K3 is top-tier at cybersecurity

https://twitter.com/rauchg/status/2078647648307880209
2•tosh•21m ago•0 comments

Show HN: PilotCite – Monitor how AI platforms cite and describe your brand

https://www.pilotcite.com
1•standew•25m ago•0 comments

CARE

https://en.wikipedia.org/wiki/CARE_International
1•tosh•27m ago•0 comments

Rise of delivery apps takes a bite out of sales for Big Pizza

https://www.ft.com/content/d10e846e-5615-4cb5-bd4f-b159423d4f75
1•thm•30m ago•0 comments

Beyond Bioinformatics Rewrites

https://claymcleod.dev/blog/2026-07-13-beyond-bioinformatics-rewrites
1•azhenley•32m ago•0 comments

Skyroot Vikram-1 India's First Private Orbital Rocket Launch [video]

https://www.youtube.com/watch?v=2KKZbSX9SgI
1•AareyBaba•35m ago•0 comments

Motion Sensors and Home Security Gadgets Without Cameras

https://www.wired.com/story/best-motion-sensors-private-alternatives-security/
1•joozio•41m ago•0 comments

AI Agents for the Working Mathematician

https://chaoxu.prof/posts/2026-07-18-ai-agents-for-the-working-mathematician.html
2•chaoxu•44m ago•0 comments

Martin Picard's Mitochondrial Theory of Mind

https://www.quantamagazine.org/martin-picards-mitochondrial-theory-of-mind-20260717/
1•Michelangelo11•46m ago•0 comments

Visualizing how multimodal vector search works under the hood

https://github.com/Faizan711/multimodal-search
1•Faizan711•47m ago•0 comments

Why Narcissistic Leaders Resist Remote Work

https://www.sciencedirect.com/science/article/pii/S0749597826000300#kg005
2•ziptron•47m ago•1 comments

UK to Scrap Digital ID

https://www.bbc.co.uk/news/articles/c5y08z25q8eo
3•i-am-cjc•48m ago•0 comments

ACI – The Open Standard for Autonomous Companies

https://github.com/narko4u/aci-spec
1•EddieWade•54m ago•0 comments

Show HN: FlexInference LLM Router

https://www.flexinference.com
1•Aperswal•58m ago•0 comments

Are your teams running out of GitHub Copilot credits?

https://nstech.substack.com/p/are-your-teams-running-out-of-github
3•sriram_iyengar•1h ago•0 comments

Ask HN: How do you as a normal swe use AI?

2•atworkc•1h ago•0 comments

Dave Eggers told OpenAI staff that ChatGPT was 'silencing a generation'

https://www.theverge.com/ai-artificial-intelligence/967630/dave-eggers-openai-chatgpt-silencing-a...
3•littlexsparkee•1h ago•0 comments

Show HN: CodeKitHub – Free browser-based tools, files never leave your device

https://codekithub.com/en/
1•qiaobax•1h ago•0 comments

Facefinder

https://face-finder.org
1•thefirstname322•1h ago•0 comments

Controlling Reasoning Effort in LLMs

https://magazine.sebastianraschka.com/p/controlling-reasoning-effort-in-llms
1•vismit2000•1h ago•0 comments

We are entering the graph engineering phase

https://www.drjoshcsimmons.com/writing/we-are-entering-the-graph-engineering-phase
1•joshcsimmons•1h ago•0 comments

Tooly – Local JSON, YAML, CSV and Regex Tools

https://www.tooly.one/
1•hengery•1h ago•0 comments