frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

One week on the APNIC honeynet: 99,000 IP addresses and 173M events

https://blog.apnic.net/2026/10/26/one-week-on-the-apnic-honeynet-99000-ip-addresses-and-173-milli...
1•weinzierl•39s ago•0 comments

Vulnocalypse: Live tracker of new security vulnerabilities

https://vulnocalypse.com/
1•simonpure•42s ago•0 comments

Readers Prefer AI Trained on Copyrighted Books over Expert Human Writers

https://arxiv.org/abs/2510.13939
1•Anon84•1m ago•0 comments

Snowflake Adaptive Warehouses cut MERGE write amplification [video]

https://www.youtube.com/shorts/LeAS6TR-dxA
1•yanivleven•1m ago•0 comments

An attempt at making a Visual Place Recognition system work on Lunar surfaces

https://www.lunarsim.org/research/
1•RonInDune•1m ago•1 comments

Show HN: On Air – Press a key and a reaction plays on your webcam in calls

https://forgot.dev/on-air
1•petarjs•1m ago•0 comments

Pixtorium – a native AI image editor, not a Photoshop clone

https://pixtorium.com/
1•siberiankot•2m ago•0 comments

Microsoft is offering buyouts to around 60k employees

https://www.businessinsider.com/microsoft-is-offering-buyouts-read-the-memo-2026-10
3•nycdatasci•2m ago•0 comments

Ask HN: Who is doing distillation or fine tuning?

1•mrburton•3m ago•1 comments

DuckDuckGo Donates $25,000 to The Perl and Raku Foundation v2026

https://www.perl.com/article/duckduckgo-donates-25-000-to-the-perl-and-raku-foundation-v2026/
2•oalders•4m ago•0 comments

Moatless – App stores are dead. Buy the code

https://moatless.store/blog/announcing-moatless
4•lawik•6m ago•1 comments

The Case Against Business School

https://www.nytimes.com/2026/10/18/opinion/business-school-mba-harvard-cornell-cambridge.html
1•yarapavan•6m ago•0 comments

Bad Habits in Web Development We Should Avoid

https://blog.ifirestone.dev/bad-habits-in-web-development-we-should-avoid/
1•theanonymousone•7m ago•0 comments

Chip Wars Update: China blows up ASML's supply chain for EUV machines [video]

https://www.youtube.com/watch?v=sPjPaHmQ8JE
1•xbmcuser•7m ago•0 comments

Microsoft to Trim Workforce with Buyout Offers for 60k Staff

https://www.bloomberg.com/news/articles/2026-10-26/microsoft-to-offer-buyouts-to-60-000-workers-i...
4•helsinkiandrew•8m ago•1 comments

Show HN: Cues Video Editor

https://cues.app
1•chaitanyapandit•9m ago•0 comments

Why Just Passwords?

https://pketh.org/why-just-passwords.html
1•surprisetalk•9m ago•0 comments

Geospatial Wikidata Dataset Connects OpenStreetMap and Wikimedia for Re

https://enterprise.wikimedia.com/blog/geospatial-wikidata-dataset/
2•chippy•10m ago•0 comments

Heavenly delights of hashing numbers under EQUALP

https://turtleware.eu/posts/Heavenly-delights-of-hashing-numbers-under-EQUALP.html
1•jackdaniel•11m ago•1 comments

Show HN: Give one context across all your agents via MCP

https://make0.ai/
1•heysrb•11m ago•1 comments

Show HN: RCE in Atlantis

https://medium.com/@Vulnetic-CEO/dismissed-approval-to-rce-unreviewed-terraform-apply-in-atlantis...
2•danieltk76•12m ago•0 comments

Show HN: Cfnrain, a community fork of AWS's archived CloudFormation CLI rain

https://github.com/awesome-foundation/cfnrain
1•allixsenos•12m ago•0 comments

Show HN: Offline PDF Desk – one HTML file, redacts and merges PDFs offline

https://dowla0.gumroad.com/l/offline-pdf-desk
1•Vladenik•13m ago•0 comments

Supply chain security for open source maintainers

https://safedep.io/oss/
2•tech_solver•13m ago•0 comments

Empires of AI

https://www.foreignaffairs.com/china/empires-artificial-intelligence-niall-ferguson-eric-schmidt
1•simonebrunozzi•13m ago•0 comments

Microsoft offers mass buyouts for roughly a quarter of its workforce

https://www.seattletimes.com/business/microsoft/microsoft-offers-mass-buyouts-for-roughly-a-quart...
20•doctorzook•14m ago•10 comments

Eric Bauza, Voice of Bugs Bunny and Daffy Duck, Dies at 46

https://www.washingtonpost.com/nation/2026/10/26/eric-bauza-voice-looney-tunes-characters-bugs-bu...
5•bookofjoe•16m ago•2 comments

Lead Harbour, find people asking to buy what your online store sells

https://leadharbour.tech/
2•raysyarov•16m ago•0 comments

Ask HN: What are your creative context bombs to make AI agents pay?

1•reacharavindh•17m ago•0 comments

Matthew Butterick makes an excellent point about textbook sizes [video]

https://www.youtube.com/watch?v=W-ryv6TwQvM
1•starmftronajoll•18m ago•0 comments