frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

The more you study consciousness, the weirder it gets [video]

https://www.youtube.com/watch?v=hYrgLn7pWp8
1•binyu•18s ago•0 comments

Show HN: Vortole, word games for language learning at your proficiency level

https://vortole.com/
1•nohowtech•2m ago•0 comments

Turbocrypt: Universal File Encryption

https://github.com/jedisct1/turbocrypt
1•jedisct1•2m ago•0 comments

Apple detectives solved mystery of ancient tree and rewrote the history of fruit

https://www.scientificamerican.com/article/how-apple-detectives-solved-the-mystery-of-an-ancient-...
1•nkurz•2m ago•0 comments

Hightouch brings customer history from data warehouses to real-time marketing

https://hightouch.com/blog/same-session-architecture
1•mooreds•3m ago•0 comments

Signal registration without a phone number now available in Android beta

https://aboutsignal.com/news/signal-registration-without-a-phone-number-now-available/
1•bertman•4m ago•0 comments

The EU Bans Social Media for Under-13s

https://www.wired.com/story/the-eu-bans-social-media-for-under-13s/
1•AndrewDucker•4m ago•0 comments

Explaining to business people why building software is still hard

https://www.manager.dev/newsletter/cursing-the-day-lovable-was-born
1•theanonymousone•4m ago•0 comments

Qwen3.8-Flash passed 17/17 checks on a DeepSWE v1.1 task in our agent harness

https://github.com/taiheqi718-art/AIC-Evals
1•htqmike•5m ago•0 comments

Three.js game running natively on Xbox at 4K60

https://twitter.com/dashersw_TR/status/2100181560846622797
1•arbayi•5m ago•0 comments

Original Sony PlayStation 2 security chip 'broken wide open' after 26 years

https://www.tomshardware.com/video-games/playstation/26-year-old-sony-ps2-security-chip-broken-wi...
1•rbanffy•5m ago•0 comments

A previously unpublished 2006 interview with DHH, annotated 20 years on

https://www.mindmeister.com/blog/david-heinemeier-hansson-interview-2006
1•tvollmer•9m ago•0 comments

Show HN: Freeform – One click shareable AI generated apps

https://sharefreeform.com
1•ReeseEJ•12m ago•1 comments

Playing both sides of the U.S.-China AI "Cold War"

https://restofworld.org/2026/ai-us-chips-chinese-open-source-models/
2•makerdiety•12m ago•0 comments

Tomosu, scores AI generated code against your repo's own incident history

https://tomosu.ai/
1•tomosu-ai•13m ago•0 comments

Speeding up gearhash for FastCDC content-defined chunking on ARM64 NEON

https://sam.dev/blog/gearhash-on-arm64
1•fanf2•13m ago•0 comments

Canada's Bill C-22 Would Force Encryption Backdoors

https://stateofsurveillance.org/news/canada-bill-c22-lawful-access-act-encryption-backdoor-signal...
2•nickslaughter02•13m ago•0 comments

What Regulatory Capture Looks Like

https://marginalrevolution.com/marginalrevolution/2026/09/what-regulatory-capture-actually-looks-...
1•robertwiblin•13m ago•0 comments

Share files directly between browsers no cloud upload needed

1•xabd•13m ago•1 comments

What is perturbation, or reactive balance, training? (2021)

https://www.washingtonpost.com/lifestyle/wellness/perturbation-reactive-balance-athletes-stroke-f...
1•mooreds•14m ago•1 comments

Designing with Bioluminescence

https://www.colorado.edu/atlas/designing-bioluminescence
1•mooreds•14m ago•0 comments

A New Equal-Area Map for Interactive Computer Use (Natively Zooms to Mercator)

https://www.benjoffe.com/map
2•birdculture•15m ago•0 comments

Denuvo Sues Game Cracker 'Voices38' for Bypassing Its Anti-Tamper DRM

https://torrentfreak.com/denuvo-sues-game-cracker-voices38-for-bypassing-its-anti-tamper-drm/
2•cbg0•16m ago•1 comments

Uncanny and unappetizing: appetites spoil as AI images take over food menus

https://www.theguardian.com/technology/2026/sep/06/ai-food-menu-images
3•edward•16m ago•0 comments

Shell Languages and the Linearization of Syntax

http://xahlee.info/comp/shell_linear_syntax.html
2•Qem•16m ago•0 comments

DIY Thermocam

https://www.diy-thermocam.net/
3•tetris11•18m ago•0 comments

It is good Under $5 for a life time?

https://apps.microsoft.com/detail/9nl267vtkkmg?hl=en-US&gl=US
2•SolvyCode•18m ago•1 comments

How to Handle Disruptive Change

https://commoncog.com/how-to-handle-disruptive-change/
2•Tomte•19m ago•0 comments

Mirror publisher to cut 220 editorial jobs as readers turn to AI summaries

https://www.theguardian.com/business/2026/sep/16/mirror-publisher-reach-cuts-editorial-jobs-ai-su...
1•pera•20m ago•0 comments

We were missing a simple overview of all emails our SaaS sends

https://lettr.com
1•tlapi_h•22m ago•0 comments