frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Web Search on Amazon Bedrock expands language support and country-aware search

https://aws.amazon.com/about-aws/whats-new/2026/11/web-search-amazon-bedrock/
1•yackrru•12s ago•0 comments

Notes on the discrete Fourier transform (DFT)

https://eli.thegreenplace.net/2026/notes-on-the-discrete-fourier-transform-dft/
3•kouosi•2m ago•0 comments

Show HN: App Pixel3D – Dream to 3D Reality

https://apps.apple.com/hu/app/pixel3d-dream-to-3d-reality/id6479245806
1•cflsdf•3m ago•0 comments

Postgres 19 is out: try it on Neon

https://neon.com/blog/postgres-19-is-out-try-it-on-neon
2•yackrru•3m ago•0 comments

Show HN: iOS App Dancing Particle is an interactive app

https://apps.apple.com/us/app/dancing-particle/id6444665083
1•cflsdf•4m ago•0 comments

Amazon is complaining about NYC Council on shipping labels, too

https://www.theverge.com/tech/1039564/amazon-nyc-council-packages-shipping-label
2•burnt-resistor•8m ago•0 comments

Show HN: Prompt Upgrader – a no-signup tool that scores and rewrites AI prompts

https://madgpt1.github.io/prompt-upgrader/
1•MadGPT•14m ago•0 comments

AI resolved all null pointer dereferences in C

https://kapteko.com/ai-resolved-all-null-pointer-dereferences/
1•fessguid•18m ago•1 comments

The Indignity of Makework

https://poisonandoak.wordpress.com/2026/11/21/the-indignity-of-makework/
1•wburglett•25m ago•0 comments

IronWAL: High performance, high durability, deterministic WAL

https://github.com/excsn/ironwal
1•excsn•30m ago•1 comments

How to read a CVSS score and decide what to patch

https://p99log.com/reading-cvss-scores/
1•collinstonui•33m ago•0 comments

Why agent swarms get better at optimizing code as they grow

https://frontier.replit.com/throwing-headcount-at-the-problem/
1•DonAtimator•35m ago•0 comments

Stephen Wolfram "Live CEOing" videos of Wolfram Language feature development

https://www.youtube.com/playlist?list=PLxn-kpJHbPx14mHrB5BlhImVOWo5Geg6f
1•alok-g•50m ago•0 comments

OpenRouter requests to MiniMax models may have been read

https://www.reddit.com/r/LocalLLaMA/comments/1y1we95/openrouter_requests_to_minimax_models_may_have/
2•ksec•51m ago•0 comments

AWS local emulator created by AI agents

https://aws.amazon.com/blogs/aws/test-your-applications-against-aws-locally-with-aws-emulator/
2•wenbert•58m ago•0 comments

The quantum computing race is becoming a deployment race

https://www.techradar.com/pro/the-quantum-computing-race-is-becoming-a-deployment-race
3•jonbaer•1h ago•0 comments

'I was shaking, crying, having trouble breathing': the uncharted trauma

https://www.theguardian.com/technology/ng-interactive/2026/nov/21/shaking-crying-trouble-breathin...
1•user20180120•1h ago•1 comments

Show HN: The Riemann Proof Handbook

https://github.com/tamnd/riemann-handbook
6•tamnd•1h ago•0 comments

WikiLLM: Browse language model weights like an encyclopedia

https://github.com/eagleclaw0075/wikillm/
2•havemurci•1h ago•0 comments

Show HN: Npx.tools, a keyboard-friendly index of developer tools

https://npx.tools/
1•hasnainkhagan•1h ago•0 comments

AI as a Lifestyle Choice

https://grahamdumpleton.me/posts/2026/11/ai-as-a-lifestyle-choice/
1•Karrot_Kream•1h ago•0 comments

California Nvidia Probe Covers Potential Criminal Law Violations

https://www.bloomberg.com/news/articles/2026-11-21/california-nvidia-probe-covers-potential-crimi...
2•petethomas•1h ago•0 comments

Ask HN: What made you pivot your interest to the field of AI?

4•learner_yearner•1h ago•4 comments

The Explorer Pattern for product invention and development

https://lethain.com/explorer-pattern/
1•gpi•1h ago•0 comments

Replaced PTX with MLIR, cutting asm regions from 499 to 81 across 20 kernels

https://vxlang.org/blog/handing-the-ptx-back-to-the-compiler.html
4•reshabh•1h ago•1 comments

San Francisco Braces for Record Tides as Mayor Urges Residents to Stay Put

https://kfn.one/news/san-francisco-braces-for-record-tides-as-mayor-urges-1d795047
2•reena•1h ago•0 comments

Back Pain (2021)

https://www.thomas-huehn.com/back-pain/
1•Curiositry•1h ago•0 comments

AI Supply Chain Security: What Canary Tokens Found

https://www.dragos.com/blog/ai-supply-chain-security-canary-tokens
4•kristianp•1h ago•0 comments

Replaying an agent run and what it takes

https://github.com/chizy7/tether/blob/master/docs/REPLAY.md
3•chizy7•1h ago•0 comments

Trump threatens penalties for US tech firms that build datacenters abroad

https://www.theguardian.com/us-news/2026/nov/20/trump-datacenters-white-house
4•Pxtl•1h ago•1 comments