frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

JPMorgan cut off Situational Awareness lending after AI losses

https://www.ft.com/content/916eea1b-d483-49e1-9a70-53b4df8f9870
1•1vuio0pswjnm7•38s ago•0 comments

Lizard Evolution in Real Time: Field Experiments on Evolutionary Process [video]

https://www.youtube.com/watch?v=MslG1nh7JdI
1•thunderbong•57s ago•0 comments

Data races and the limits of ThreadSanitizer in C and Go

https://theconsensus.dev/p/2026/09/06/data-races-and-the-limits-of-threadsanitizer-in-c-and-go.html
1•matt_d•5m ago•0 comments

India's First AI Agentic E-Commerce Platform

https://www.youtube.com/watch?v=e-Z690c_SLA
1•Shraddha__Singh•6m ago•0 comments

Quantum O(1) Invariants: Redefining Post-Quantum Cryptography

https://zenodo.org/records/22731417
1•GeometryKernel•9m ago•0 comments

Roon: "I think open source will be banned"

https://twitter.com/tszzl/status/2098875417373634944
3•pr337h4m•13m ago•0 comments

Fenton's Reagent

https://en.wikipedia.org/wiki/Fenton%27s_reagent
2•peter_d_sherman•27m ago•0 comments

Early Earth's Aurora may have made a ion-beam reactor for prebiotic chemistry

https://phys.org/news/2026-09-early-earth-auroral-belts-natural.html
2•wglb•31m ago•1 comments

JWST finds extreme star-forming galaxies masquerading as faint quasars

https://phys.org/news/2026-09-jwst-extreme-star-galaxies-masquerading.html
2•wglb•35m ago•1 comments

Show HN: I made an alternative to the archived filebrowser

https://github.com/skidoodle/filebrowser
2•skidoodle•36m ago•1 comments

A wandering black hole caught feeding on the run

https://phys.org/news/2026-08-black-hole-caught.html
2•wglb•40m ago•1 comments

MacFileSizing – What is consuming my disk space?

https://github.com/jaccon/macfilesizing/tree/main
3•jaccon•43m ago•0 comments

Anthropic CEO says AI swarm could 'take over the Internet' in 6-12 months

https://venturebeat.com/security/anthropic-ceo-says-ai-swarm-could-take-over-the-entire-internet-...
6•pseudolus•49m ago•1 comments

Show HN: Aqqai – Every answer, checked before you see it

https://demo.aqqai.in
2•Vineetyadav2•53m ago•1 comments

Kubernetes v1.37 brings 67 enhancements. Which matter for operators?

https://thenewstack.io/kubecon-kubernetes-updates-security/
2•geoffbp•53m ago•0 comments

Every invoice in Brazil's economy runs on SOAP 1.2. We mapped it all

https://github.com/stoix-dev/sefaz-webservices-postman
3•lestx•55m ago•0 comments

The Succession Crisis That Tore England Apart

https://www.historytoday.com/archive/feature/succession-crisis-tore-england-apart
6•pepys•56m ago•0 comments

Aligned to Whom?

https://hyperbo.la/w/aligned-to-whom/
3•lopopolo•57m ago•0 comments

After Math

https://terrytao.wordpress.com/2026/09/12/after-math/
3•throwaway81523•58m ago•0 comments

Ask HN: How can DigitalOcean not afford $50, but can afford $3M to Omarchy?

14•dpmartinez•1h ago•2 comments

Backflip: Apple now wants to train AI models with user data after all

https://www.heise.de/en/news/Backflip-Apple-now-wants-to-train-AI-models-with-user-data-after-all...
3•jacquesm•1h ago•0 comments

Show HN: Astah Pro MCP – Enabling AI-Powered UML Modeling

https://github.com/takaakit/astah-pro-mcp
2•takaakit•1h ago•0 comments

Physicist does the math on Star Trek's "Picard maneuver"

https://arstechnica.com/science/2026/09/physicist-does-the-math-on-star-treks-picard-maneuver/
2•kensai•1h ago•0 comments

Code is free speech (2020)

https://hoffmang9.github.io/free-speech/the-history-code-is-free-speech.html
2•tehlike•1h ago•1 comments

Tim Berners-Lee: I'm interested in Math-what stuff don't we do in School?

https://www.w3.org/People/Berners-Lee/Kids.html
3•nxobject•1h ago•0 comments

U.S. agencies say top Chinese AI companies systematically copied American models

https://www.nbcnews.com/tech/tech-news/us-accuses-china-ai-developers-deepseek-alibaba-copying-am...
3•pseudolus•1h ago•0 comments

Trade war puts spotlight on Canada's relationship with US tech

https://www.cbc.ca/radio/justasking/canada-digital-sovereignty-just-asking-9.7337778
2•pseudolus•1h ago•0 comments

Biggest AI Rivals Agree They Need to Slow It Down

https://www.wsj.com/tech/ai/anthropic-boss-warns-ai-industry-must-slow-the-pace-a4267b56
2•bryan0•1h ago•0 comments

An interesting anecdote from our Hacker Opus work

https://www.lesswrong.com/posts/HE3Styo9vpk7m8zi4/evhub-s-shortform?commentId=fcqxeya5TCnbx5YBa
2•yurivish•1h ago•0 comments

The Interim Computer Museum

https://icm.museum/
38•mulmen•1h ago•4 comments