frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

The Ethics Issue of AI-Assisted Creation

https://im.not.ci/ai-creator-ethic/
1•uneven9434•4m ago•0 comments

Professional cyclists can top 100 km/h. But safety has not kept pace

https://www.cbc.ca/lite/story/9.7345287
1•colinprince•7m ago•0 comments

Clean, 1P-verified Walmart and Target catalog with preserved UPCs

https://github.com/FluffyTeddyBear12/us-retail-product-dataset
1•jimmied1213•8m ago•0 comments

Line-Rate Post-Quantum Byzantine Consensus via L1D Balanced Ternary

https://github.com/leadpiperl1/ternary-consensus-mesh
1•leadpiperl1•8m ago•0 comments

Scott Jenson: Are we going to use the same Desktop UX forever? [video]

https://www.youtube.com/watch?v=V7AfAcQwLW0
2•tripdout•39m ago•1 comments

RSA-896

https://saweis.net/posts/rsa-896.html
14•madars•43m ago•2 comments

Lattice enumeration: O(R^N) complexity reduced to O(R^2) with no floating point

https://github.com/Andrew-J-Morris/orthotropic-parity-and-discrete-pi
1•MorrisAndrewJ•45m ago•0 comments

Using system-one models inside high-throughput data pipelines

https://www.southbridge.ai/blog/jev-entity-resolution
2•hrishi•48m ago•0 comments

TanStack supply-chain attack exposed ~170 private CrowdSec repos

https://www.crowdsec.net/blog/tanstack-supply-chain-attack-analysis
5•fourfire•54m ago•1 comments

Is It a Flatpak? Is It an AppImage? No It's AppJail

https://www.youtube.com/watch?v=EBSMHBC0Phc
2•DtxdF•57m ago•1 comments

AI Bubble: 'They're coming to the end of this' – Eli the Computer Guy [video]

https://www.youtube.com/watch?v=0YIczZDCgsM
3•baranul•58m ago•0 comments

Show HN: Bastardica – Create bastard web fonts

https://bastardica.mitpit.com
2•MitPitt•59m ago•0 comments

Comparing reflection capabilities of C++, Zig and C3

https://nyr24.github.io/blog/reflection-comparison/
5•ManuLinares•1h ago•2 comments

Do you separate the reviewer's window from the author's

3•Marvin_RunAI•1h ago•1 comments

The Giza Project

https://giza.fas.harvard.edu/
2•Mr_Minderbinder•1h ago•0 comments

Why are AI leaders calling for a slow down? [audio]

https://www.cbc.ca/listen/cbc-podcasts/209-front-burner/episode/16237327-why-are-ai-leaders-calli...
1•BiraIgnacio•1h ago•0 comments

End the H-1B Program

https://end-h1b.com/
15•sergiotapia•1h ago•16 comments

A2E AI – an all-in-one AI video generator for text, images and avatars

https://textideo.com/model/a2e-ai
1•Yummiy•1h ago•0 comments

Pdfcn: Beautiful pdf components, built on Takumi and Forme, by Shadcn

https://github.com/shadcn-labs/pdfcn
4•nateb2022•1h ago•1 comments

Open-source free meme generator, friendly for AI agents and humans

https://github.com/terryds/memegenscript
1•terryds•1h ago•2 comments

Pure Code: What remains with developers after AI writes the code?

https://pure-code-essay.vercel.app/
2•kofdai•1h ago•0 comments

Ask HN: Are LLMs the antithesis of Hegel's universal spirit?

1•Avicebron•1h ago•0 comments

How to handle manager adding AI bs to our codebase/designs etc.

4•LandOfMightDev•1h ago•2 comments

Lisp.md: System Instructions for Lisp

http://funcall.blogspot.com/2026/09/lispmd-system-instructions-for-lisp.html
1•prestonlibby•1h ago•0 comments

How the Berkeley Overmind won the 2010 StarCraft AI competition (2011)

https://arstechnica.com/gaming/2011/01/skynet-meets-the-swarm-how-the-berkeley-overmind-won-the-2...
2•promiseofbeans•1h ago•1 comments

Portable Fruit Blender

https://www.instructables.com/Portable-Fruit-Blender/
1•sudo_cowsay•1h ago•0 comments

Trump to Name AI Czar While Rejecting Safety Risks as a Hoax

https://www.bloomberg.com/news/articles/2026-09-19/trump-to-name-ai-czar-while-rejecting-safety-r...
4•sbulaev•1h ago•0 comments

PhotoGIMP – The Photoshop Like Experience on GIMP

https://photogimp.com/
2•the-mitr•1h ago•0 comments

Bret Victor: Inventing on Principle (2012) [video]

https://vimeo.com/906418692
1•anpep•1h ago•0 comments

The National ID Nobody Voted For

https://thedreydossier.substack.com/p/the-national-id-nobody-voted-for
5•kickofline•2h ago•0 comments