frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

The Free Moron Sitting Next to You

https://chriscleveland.com/p/the-free-moron-sitting-next-to-you
1•ccleve•2m ago•0 comments

Chlorophyll Engine 10M Trees – 15km² Test [video]

https://www.youtube.com/watch?v=VC_NUxbeA0E
1•crummy•3m ago•0 comments

Censys Nginx2root Exposure Tracker

https://nginx2root.censys.com/
1•palebluedot•4m ago•0 comments

Nihil – A hardware IDE where your AI agent designs, simulates and tests PCBs

https://nihil.sh/
1•Teever•5m ago•0 comments

Gemini 4 Neon

https://docs.cloud.google.com/gemini-enterprise-agent-platform/models/guides/gemini-4-neon
7•mike97•9m ago•0 comments

How we use agents to patch and deploy 40M lines of Chromium code in < 1 day

https://www.browserbase.com/blog/how-we-deploy-custom-chromium
1•Kylejeong21•10m ago•0 comments

Spotify Is Scared

https://imgur.com/a/sEqeYba
2•christosk92•11m ago•2 comments

Haru-4B: A voice AI that can listen and speak at the same time

https://blog.higurashi.ai/melte/haru4b/
1•Hasitron•12m ago•0 comments

China seeks advanced Nvidia chips for AI weapons despite US curbs, report says

https://www.msn.com/en-us/technology/tech-companies/china-seeks-advanced-nvidia-chips-for-ai-weap...
1•tiahura•12m ago•0 comments

Ben Evans AI Questions

https://www.ben-evans.com/presentations
1•xmpir•17m ago•0 comments

Today, Voyager 1 Becomes the First Spacecraft a Full Light-Day from Home

https://www.cnet.com/science/space/voyager-1-passes-one-light-day/
1•pseudolus•17m ago•0 comments

Struggling to understand why AI would harm humans? This explains it perfectly

https://the-case-for-ai-safety.vercel.app
1•isaacbitran•18m ago•0 comments

What's New in Alfred 6?

https://www.alfredapp.com/whats-new/
2•Blazing•18m ago•0 comments

AI use is up 330×. The bill is up 115×

https://www.modelcompare.ai/blog/ai-tokens-vs-spending
2•gitowiec•18m ago•0 comments

Show HN: Eventkiwi – Scheduled reports for your app's events

https://eventkiwi.com/
1•Ddel•19m ago•0 comments

Just Because You Can, Doesn't Mean You Should: Re-Evaluating Galera Node Weights

https://www.percona.com/blog/just-because-you-can-doesnt-mean-you-should-re-evaluating-galera-nod...
3•Sigmazero60•20m ago•0 comments

The Boring Company and the Future Underground

https://twitter.com/DavidGeorge83/status/2122715101300158735
3•rmason•21m ago•0 comments

Accountability Sinks (2025)

https://www.250bpm.com/p/accountability-sinks
2•elinear•22m ago•0 comments

Show HN: Robotics needs better CAD, so I wrote a B-rep kernel and 3,487 tests

https://springcraft-ai.github.io/springrep/
2•atomarch•22m ago•0 comments

DIY in-car navigation and reverse camera

https://yaky.dev/2026-11-11-chevy-volt-carputer/
2•speckx•23m ago•0 comments

OpenAleph securely store large amounts of data and make it searchable

https://darc.li/openaleph/
2•Bluestein•26m ago•0 comments

The internet is held together with shoestring and bubblegum

https://www.cnn.com/2026/11/18/tech/whats-causing-outages
2•Philadelphia•26m ago•0 comments

Gemini 4 Neon

https://aistudio.google.com/docs/models/gemini-4-neon
14•urda•30m ago•3 comments

What's new in Gemini 4 Neon

https://aistudio.google.com/docs/whats-new-gemini-4-neon
4•sync•30m ago•0 comments

Token Budgets

https://major.io/p/on-token-budgets/
1•speckx•33m ago•0 comments

Show HN: Fazor – offline electrical calculators for Android (IEC and NEC)

https://kalkansoftware.com/fazor/
1•sabahattink•35m ago•0 comments

Ask HN: Anyone Used ClickAway in Bay Area?

1•HoldOnAMinute•35m ago•0 comments

Apache Shiro security framework releases 3.0.2

https://shiro.apache.org/blog/2026/11/apache-shiro-302-released.html
3•lprimak•35m ago•1 comments

Fardesk – fast iPhone app to manage your Claude sessions

https://fardesk.franzai.com/
1•franze•35m ago•0 comments

Airmash – Multiplayer Missile Warfare HTML5 Game

https://airma.sh/
2•mashedmashity•35m ago•0 comments