frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

ThinkStream – AI generates the work. We still need to understand it

https://thinkstream.app/
1•aginext•2m ago•0 comments

Running cyberpunk 2077 nativery on Vision Pro

https://github.com/Ag3497120/VXpro
1•masaton•6m ago•0 comments

AI Companies Want to Buy Your Work Files and Emails

https://www.wired.com/story/ai-companies-really-really-want-to-buy-your-work-files-and-emails/
2•benrmatthews•7m ago•1 comments

2026 ACM SIGOPS Annual Technical Conference

https://atc.sigops.org/2026/schedule.html
1•so-cal-schemer•9m ago•1 comments

Project Steadfast

https://noteflakes.com/articles/2026-11-07-introducing-project-steadfast
1•ciconia•11m ago•0 comments

Hi HN, my first post

1•roshan_m•16m ago•0 comments

Thermodynamics in Einstein's Thought(1967) [pdf]

http://rpdata.caltech.edu/courses/aph105c/2006/articles/Klein_Einstein.pdf
1•nill0•20m ago•0 comments

From the Vault to Your Library–How Seven of EA's Classic Games Were Restored

https://www.ea.com/news/from-the-vault-to-your-library
2•kderbe•20m ago•1 comments

Agentic Development Future and Current Directions – Nov 2026

https://robotpaper.ai/agentic-development-future-and-current-directions-nov-2026/
1•royosherove•22m ago•0 comments

I'm Rewriting IBM SPSS Statistics in 100% Safe Rust, Alone

https://github.com/kobaltgit/StatCraft
2•kobaltGIT•28m ago•0 comments

Deuterium's Impact on OLED Displays (2024)

https://www.oled-info.com/deuteriums-impact-oled-displays
1•zeristor•29m ago•1 comments

Samsung Put Ads on a Refrigerator You Bought

https://www.thepricer.org/samsung-put-ads-on-a-refrigerator-you-already-bought/
2•marksmark•30m ago•0 comments

AetherScope – WebGL2 codebase visualizer and <50ms SAST in Rust

https://github.com/maxxwwim/AetherScope-SAST-150-CWE-MCP
2•actheglitch•36m ago•0 comments

C# Solid/Svelte Like UI Framework Without Mono/Blazor

https://github.com/matengo/NetWasm.UI
2•zionsati•38m ago•0 comments

Agent memory needs its OpenTelemetry moment

https://www.lorekit.io/blog/open-agent-memory-format
4•mthines•42m ago•0 comments

Why Is Everyone Leaving New Zealand? [video]

https://www.youtube.com/watch?v=zIxTKc67tHU
2•TMWNN•43m ago•0 comments

Pakistani astronaut to become first foreigner on China's space station

https://www.independent.co.uk/asia/south-asia/pakistan-astronaut-china-shenzhou-space-station-b30...
2•nephihaha•47m ago•0 comments

C development for Linux without a standard library

https://kevinboone.me/shnolib.html
1•andsoitis•53m ago•0 comments

Build Software on Your Phone

https://markow.dev/writing/build-software-on-your-phone/
1•robowo•56m ago•0 comments

6th-grade Peano arithmetic broke OpenAI's $100B Yang-Mills mass gap proof

https://github.com/Dr-Logvinovich/round-square/blob/main/README.md
5•DRLogvinovich•58m ago•0 comments

The Credit Card

https://phonecardmuseum.com/articles/banking-cards/the-credit-card/
1•thunderbong•1h ago•0 comments

Being a line cook without talking to AI

https://knhash.in/no-ai-line-cook/
1•knhash•1h ago•0 comments

NASA is looking for new astronauts to help grow its Artemis program

https://www.nbcnews.com/science/space/nasa-is-looking-for-new-astronauts-rcna608025
1•TMWNN•1h ago•0 comments

Category Theory Illustrated

https://abuseofnotation.github.io/category-theory-illustrated/
2•rramadass•1h ago•0 comments

Show HN: Ferrule – copy-in React Native UI components for iOS, Android and web

https://leoanimesh.github.io/ferrule/
1•leoanimesh•1h ago•0 comments

Investing vs. gambling: how to tell the difference

https://www.cfainstitute.org/insights/articles/investing-vs-gambling
1•throwaway2037•1h ago•0 comments

The Rise of Microdramas

https://www.bbc.com/news/articles/cm87zv70jg9no
2•sarreph•1h ago•0 comments

Show HN: Hacker News Column View

https://hn.orbitalchicken.com
1•y1n0•1h ago•0 comments

The Great GOP Dummymander of 2026

https://www.nationalreview.com/corner/the-great-gop-dummymander-of-2026/
1•carabiner•1h ago•0 comments

I Won't Hire People Who Use Poor Grammar. Here's Why (2012)

https://hbr.org/2012/07/i-wont-hire-people-who-use-poo
1•arbayi•1h ago•1 comments