frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Americans bought 12% less soda under new SNAP restrictions

https://www.statnews.com/2026/08/24/snap-restrictions-12-percent-drop-soda-purchases/
1•elo2000•26s ago•0 comments

The Durable Shape of Product Engineering

https://juanloco.dev/posts/durable-shape-of-product-engineering/
1•juanloco•1m ago•0 comments

Best Coffee Will Be Harder to Get as Downpours Hit Brazil's Trees

https://www.bloomberg.com/news/articles/2026-08-23/brazil-s-heavy-rains-hit-arabica-quality-squee...
1•blondie9x•2m ago•0 comments

Show HN: Undercover – Hire top talent through games

https://undercover.games/play
1•arpit_bansal•3m ago•0 comments

Prairie Fires Restore Water to Soil and Why Prairies Need to Burn [video]

https://www.youtube.com/watch?v=HDVcfSYcxc0
1•simonebrunozzi•3m ago•0 comments

Experiments with Plotter Art

https://sometimes.digital/posts/experiments-with-plotter-art/
1•surprisetalk•4m ago•0 comments

Farewell Golioth and Hello Nordic

https://danielmangum.com/posts/farewell-golioth-hello-nordic/
1•hasheddan•4m ago•0 comments

Moderna and Merck's cancer vaccine triumph

https://www.statnews.com/2026/08/24/inside-moderna-and-merck-cancer-vaccine-triumph/
1•elo2000•5m ago•0 comments

ICT 1301 – A 1960's Computer (2022)

https://www.i-programmer.info/history/9-machines/4972-a-1960-computer-the-ict-1301-flossie-.html
1•mooreds•5m ago•0 comments

Postmortem for the Lean Kernel Soundness Bug Hunt

https://leodemoura.github.io/blog/2026-8-24-postmortem-for-the-kernel-soundness-bug-hunt/
1•EvgeniyZh•5m ago•0 comments

What my dad taught me about AI coding in the 90s

https://askmike.org/articles/ai-coding-lessons-in-the-90s-from-my-dad/
1•askmike•6m ago•0 comments

Show HN: A public record of open-source software health

https://inspect.software/
1•Nayjest•6m ago•0 comments

Show HN: Alignr – Does pre-AI reflection preserve cognitive independence?

https://alignr.streamlit.app
1•synthrakx•6m ago•0 comments

AI Stock Research Assistant · Streamlit

https://ai-stock-research-kiaan.streamlit.app
1•KiaanKothari•8m ago•0 comments

PDF field detection: what broke across 23 real forms

https://pdf2fill.com/blog/pdf-field-detection-real-forms.html
1•hackerfory•8m ago•0 comments

Indoor Farming Market

https://www.grandviewresearch.com/industry-analysis/indoor-farming-market
2•Rutujad•8m ago•0 comments

Computer Aided Engineering Market (2026 – 2033)

https://www.grandviewresearch.com/industry-analysis/computer-aided-engineering-cae-market
1•Rutujad•9m ago•0 comments

Show HN: A techno machine in one HTML file, with verifiable renders

https://ssx360.github.io/rack-02/?src=hn
1•ssx360•9m ago•0 comments

Why all the fuss about bond yields is happening now

https://www.cnbc.com/2026/08/24/why-all-the-fuss-about-bond-yields-is-happening-now.html
1•mooreds•9m ago•0 comments

Not just Allow|Deny... Google Beyond Zero Introduces "Challenge"

https://gluufederation.medium.com/allow-deny-yes-2c429220b9f4
1•idm_guru•10m ago•0 comments

Graduate job vacancies drop by almost 50% in a year, survey suggests

https://www.bbc.co.uk/news/articles/crerd8l3pw5o
1•lifeisstillgood•11m ago•0 comments

Emacs 31 has been released

https://lists.gnu.org/archive/html/emacs-devel/2026-08/msg00760.html
3•frou_dh•12m ago•1 comments

Ask ChatGPT to pick a number between 1 and 30. It'll always say 17 or 23

https://twitter.com/lebed2045/status/2091875850702504288
4•lebed2045•12m ago•3 comments

Fat Marmot Week

https://coloradosun.com/2026/08/24/fat-marmot-week-onlymarms-onlymarms-science-research-gothic-co...
1•mooreds•12m ago•0 comments

We Went to Wall Street's Exclusive Wilderness Camp. Everyone Was Spooked by AI

https://www.wsj.com/finance/investing/we-went-to-wall-streets-exclusive-wilderness-camp-everyone-...
2•newswasboring•12m ago•1 comments

An interactive introduction to the spanning tree protocol

https://vincent.bernat.ch/en/blog/2026-spanning-tree
1•vbernat•14m ago•1 comments

Xiaomi AI Cube and Xring O100: 1.22 TB/S, 330 Tokens/S and 120B Local AI

https://aicybr.com/blog/xiaomi-ai-cube-xring-o100-local-ai
3•qb•14m ago•2 comments

Sorry, Pluto's still not a planet

https://www.scientificamerican.com/article/sorry-plutos-still-not-a-planet/
2•beardyw•14m ago•0 comments

Lark: Open-source realtime database, Firebase SDK compatible

https://lark.sh
1•silverlight•16m ago•0 comments

Don't Let AI Dull Your Software Engineering Edge

https://www.awongcm.io/blog/2026/04/25/don-t-let-ai-dull-your-software-engineering-edge/
1•conwy•17m ago•0 comments