frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Noise pollution may keep bodies on alert, disrupting sleep and heart health

https://medicalxpress.com/news/2026-09-noise-pollution-bodies-disrupting-heart.html
1•mdp2021•1m ago•0 comments

MCP Client Registration: Dinner Party or Nightclub?

https://fusionauth.io/blog/cimd-vs-dcr
1•mooreds•1m ago•0 comments

How Apple Watch's Audio Intelligence features work in privacy paper

https://9to5mac.com/2026/09/09/apple-details-how-apple-watchs-new-audio-intelligence-features-wor...
2•alwillis•2m ago•0 comments

Agents Make Rebase a No-Brainer

https://home.expurple.me/posts/agents-make-rebase-a-no-brainer/
1•Expurple•4m ago•0 comments

Goodbye Sourcehut

https://timharek.no/blog/goodbye-sourcehut/
2•twapi•8m ago•0 comments

OpenAI's apparent maths breakthrough raises profound questions

https://www.economist.com/science-and-technology/2026/09/09/openais-apparent-maths-breakthrough-r...
1•ijidak•8m ago•0 comments

Show HN: Project Management for the Rest of Us

https://actual-plan.com/
2•crmasterton•9m ago•1 comments

Virtualized Conversations (Vcon)

https://datatracker.ietf.org/group/vcon/documents/
2•mindcrime•9m ago•0 comments

Schools Get 5M Complaints yet Almost No Teachers Trained to Handle Them

https://replyresearch.com/schools-get-5m-complaints-yet-almost-no-teachers-trained-to-handle-them/
1•replyresearch•9m ago•0 comments

Show HN: CantonPay – registration-free Stellar payment links

https://cantonpay.online
1•richardbertok•10m ago•0 comments

Data Access Patterns That Makes Your CPU Angry

https://blog.weineng.me/posts/slowest_add
1•fagnerbrack•10m ago•0 comments

There is no 10x RBAC

https://infisical.com/blog/folder-based-rbac
1•FinnLobsien•11m ago•0 comments

Vibe2phone: Test your vibe coded iPhone apps from anywhere on your phone

https://github.com/jystervinou/vibe2phone
1•jystervinou•12m ago•1 comments

Apple raises prices of last years iPhones

https://www.theverge.com/tech/992551/apple-iphone-17-17e-air-price-increase
1•qprofyeh•13m ago•0 comments

Building Web Layouts for Dual-Screen and Foldable Devices

https://www.smashingmagazine.com/2022/03/building-web-layouts-dual-screen-foldable-devices/
1•alwillis•13m ago•0 comments

Staggering amounts of valuable metals are ending up in the trash

https://qz.com/copper-nickel-aluminum-metal-trash-recycling-electronic-1851428445
1•behnamoh•14m ago•0 comments

Six Chinese AI firms accused of aggressively copying US frontier models

https://arstechnica.com/tech-policy/2026/09/six-chinese-ai-firms-accused-of-aggressively-copying-...
3•SegfaultSeagull•14m ago•0 comments

South Park creators rename show 'South America'

https://www.bbc.co.uk/news/articles/cp9340rg7k8o
5•hermitcrab•17m ago•0 comments

Apple Doesn't Want You to Worry About the New Apple Watch's Listening Features

https://www.wired.com/story/apple-doesnt-want-you-to-worry-about-the-new-apple-watchs-listening-f...
2•discostrings•18m ago•1 comments

I promise this Ollama replacement will give you the fastest t/s you've ever had

https://github.com/omgitsbase/llmash
2•wowitsbase•18m ago•2 comments

Open-source agentic terminal with a PTY daemon and browser access

https://github.com/hydraterm/hydra-local
1•hydraterms•19m ago•0 comments

Testing Race Conditions

https://projectzero.google/2026/09/maccconc-race-condition.html
1•alpaylan•20m ago•0 comments

Secret DHS Unit Pulling People over Based on Their Financial Data

https://newrepublic.com/post/215177/secret-dhs-unit-predictive-policiing-people-based-financial-data
8•devonnull•20m ago•0 comments

Benchmark: MariaDB vs. MemCP drop-in replacement WordPress

https://www.memcp.org/wiki/Benchmark_MemCP_vs._MariaDB_on_Wordpress#Host_PHP_directly%3A_remove_a...
2•carli2•22m ago•0 comments

EU and Canada Plan Deal to Boost Trade, Security as US Ties Fray

https://www.bloomberg.com/news/articles/2026-09-08/eu-and-canada-plan-far-reaching-alliance-to-st...
3•doener•26m ago•0 comments

Australia to impose digital duty of care on tech companies to reduce online harm

https://www.thetimes.com.au/world/36212-australia-will-impose-a-digital-duty-of-care-on-tech-comp...
2•like_any_other•27m ago•1 comments

Ask HN: Does Gusto drop dependents randomly for anyone else?

1•QuadmasterXLII•30m ago•0 comments

Exposing a global AI slop empire ruining the internet for profit [video]

https://www.youtube.com/watch?v=GEHHTh5OTnQ
2•neom•33m ago•0 comments

The U.S. just had its hottest summer on record

https://www.ncei.noaa.gov/news/national-climate-202608
1•sphyrna-029•34m ago•0 comments

I am obsessed with two ads

https://bryananthonio.com/blog/shift-from-ml-to-ai-engineering/
1•skyberrys•37m ago•0 comments