frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Weird Web October

https://weirdweboctober.website/
1•rdmuser•33s ago•0 comments

Show HN: AgentOS – Run your coding agents from your phone, self-hosted

https://github.com/saadnvd1/agent-os
1•saadn92•1m ago•0 comments

Photocraft: An open-source, clean-room reimplementation of Adobe Photoshop

https://getartcraft.com/apps/photocraft
1•tough•8m ago•2 comments

GNU/Linux Has Risen in France Since the Order to Adopt It (In Public Services)

https://techrights.org/n/2026/10/06/GNU_Linux_Has_Risen_in_France_Since_the_Order_to_Adopt_GNU_Li...
1•amcclure•11m ago•0 comments

'Complete devastation': How NSF gutted its social sciences research

https://www.science.org/content/article/complete-devastation-how-nsf-gutted-its-social-sciences-r...
1•sbulaev•13m ago•0 comments

Hexagon

https://antieau.github.io/2026/10/05/hexagon.html
1•pfdietz•15m ago•1 comments

Mapping the Shared Infrastructure Behind Pedophile Sites

https://www.gpatricksec.com/hidden-in-plain-site/
1•sdko•18m ago•0 comments

Scott Manley – Moon to Mars [video]

https://www.youtube.com/watch?v=dmVn2DmlmgU
1•ls612•23m ago•0 comments

Stanford scientists found a way to regrow cartilage and stop arthritis

https://www.sciencedaily.com/releases/2026/10/261005011249.htm
16•kelnos•25m ago•1 comments

South Korea says AI agents appear to have been used to hack the country's banks

https://www.reuters.com/world/south-koreas-lee-says-ai-appears-have-been-used-bank-hacks-2026-10-06/
7•thoughtpeddler•29m ago•0 comments

Toronto-based VPN provider plans to quit Canada over lawful-access bill

https://www.theglobeandmail.com/politics/article-psiphon-vpn-provider-plans-to-quit-canada-over-l...
3•rdmuser•32m ago•0 comments

OpenAI releases 722 math manuscripts

https://github.com/openai/math/blob/main/CONTENTS.md
3•jumploops•38m ago•0 comments

OpenAI just dropped 700 preprints of mathematical proofs and counterexamples

https://github.com/openai/math/tree/main/preprints
36•tootie•43m ago•2 comments

Show HN: Bees – Run agentic teams on your own computer (open source)

https://bees.bot/
1•ravikapoor101•43m ago•0 comments

Show HN: Jrs – A Cargo-like build tool for Java, written in Rust

https://getjrs.dev
2•piotrwittchen•43m ago•0 comments

The Si Wealth Transfer Is Becoming the Largest Rug Pull in History

https://medium.com/@vektormemory/the-si-wealth-transfer-is-becoming-the-largest-rug-pull-in-histo...
1•vektormemory•44m ago•3 comments

David Bushell's Valley Fold website is now live

https://valleyfold.co.uk/
2•yhavin•51m ago•0 comments

AnyPS5: Port PS5 binaries to PC without emulation (87% system libraries mapped)

https://github.com/boykopovar/AnyPS5
3•Fe2O3•52m ago•1 comments

Building a Better Working Dog

https://www.science.org/content/article/can-science-build-better-working-dog
2•bucket2015•53m ago•0 comments

Do you support shutting down air travel for 2 months to control Russia plague?

4•johndavid9991•53m ago•7 comments

State of Devs 2026 survey results: developers are exhausted

https://2026.stateofdevs.com/en-US/
15•sgdesign•53m ago•6 comments

Microsite that tracks the NAV of SK Square

https://sk-square-observatory.alexdwu13.chatgpt.site/
3•alexdwu1•59m ago•0 comments

Where do we draw the line on AI in court filings?

https://lexifina.com/blog/where-to-draw-the-line-on-ai-in-court-filings
2•alansaber•59m ago•0 comments

How to restore your online sanity, one webcam at a time

https://bigthink.com/strange-maps/webcam-maps-are-back/
2•GreyWolfhead•1h ago•0 comments

Ask HN: What do you run on a $5 VPS that's worth keeping online 24/7?

1•mariocesar•1h ago•0 comments

The Plunging Price of Thought

https://epoch.ai/publications/the-plunging-price-of-thought
2•gmays•1h ago•0 comments

Show HN: Show HN: InterPoll, signed posts replicated over Gun relays/browsers

https://github.com/Interpoll1/decentralised
2•thegoodduck•1h ago•0 comments

Read the 722 new OpenAI math papers

https://hub.valency.io/collections/openai-math
2•curtis-jm•1h ago•0 comments

Integer multiplication below n log n

https://github.com/openai/math/tree/main/preprints/Integer-multiplication-below-n-log-n-September...
19•E-Reverance•1h ago•6 comments

Ask HN: What games do you religiously play on your phone browser?

2•saimiam•1h ago•5 comments