frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

The Biggest Thing We've Lost Since the Early Internet

https://www.youtube.com/watch?v=srtqr7VHvE4
1•pierres7•1m ago•1 comments

Tasteslop

https://nemesisglobal.substack.com/p/tasteslop
1•spats1990•4m ago•0 comments

MatrAIx: Simulating the world with 8.3B persona agents

https://arxiv.org/abs/2608.04205
1•anigbrowl•6m ago•0 comments

Improving Fable 5 Safeguards

https://www.anthropic.com/news/improving-fable-5-s-biology-safeguards
2•surprisetalk•6m ago•0 comments

America's Cyber Forces Grapple with Cluster of Deaths by Suicide

https://www.bloomberg.com/news/articles/2026-08-06/us-military-s-cyber-command-unit-grapples-with...
2•toomuchtodo•10m ago•1 comments

piclaw – Pi coding agent in a Technicolor web trenchcoat

https://rcarmo.github.io/projects/piclaw/
1•indigodaddy•10m ago•0 comments

Built an exclusion engine and it might be what comes after AI slop

https://uncoverroads.com/
1•sourav_biswas•10m ago•0 comments

Show HN: Markdown Buddy – Native macOS Markdown Editor with Quick Look and Xcode

https://markdownbuddy.inawa.app/
1•JanParis•11m ago•0 comments

Bridge and Torch Problem

https://en.wikipedia.org/wiki/Bridge_and_torch_problem
1•marysminefnuf•17m ago•0 comments

Ask HN: What will be the Chernobyl or Bhopal scale industrial disaster of AI?

1•thoughtpeddler•24m ago•1 comments

OpenCode was able to reproduce the current price of DeepSeek

https://twitter.com/thdxr/status/2085377844515922210
1•ammo1662•24m ago•1 comments

SciCode-Verified: How Benchmark Defects Underestimated LLM Scientific-Coding

https://arxiv.org/abs/2608.04975
1•sbulaev•30m ago•0 comments

EU AI Act Content Labelling: Fake Around and Find Out

https://reprodev.com/eu-ai-act-content-labelling-fake-around-and-find-out/
2•reprodev•30m ago•0 comments

No Space Like J-Space

https://twitter.com/TheZvi/status/2074612488956424412
2•gmays•35m ago•0 comments

SEAI: Hardware-rooted identity for autonomous AI

https://github.com/Willbass65/SEAI-Identity-Standard
1•alboe_seai•41m ago•0 comments

An Interesting Fourier Transform – 1/F Noise

https://www.dsprelated.com/showarticle/40.php
1•q7m•41m ago•0 comments

SpaceX rocket hit the moon: Before and after pics (KASA)

https://earthsky.org/space/falcon-rocket-will-hit-the-moon-august-5/
2•BiraIgnacio•42m ago•1 comments

Artificial light at night: a global disruptor of the night-time environment (2023)

https://arxiv.org/abs/2311.02098
3•wslh•42m ago•0 comments

Teaonher Checker

https://teaonherchecker.org
1•thefirstname322•43m ago•1 comments

How Goldman Sachs Is Using Agentic AI for Software Engineering at Scale

https://www.forbes.com/sites/bernardmarr/2026/08/06/how-goldman-sachs-is-using-agentic-ai-for-sof...
2•vismit2000•43m ago•0 comments

Show HN: Selvedge – an append-only log of what your AI agent already rejected

https://github.com/masondelan/selvedge
1•masondelan•43m ago•0 comments

Kellogg says it's removing artificial dyes from cereals by the end of this year

https://apnews.com/article/wk-kellogg-artificial-colors-froot-loops-apple-jacks-505ba65360a526f73...
2•bhouston•43m ago•1 comments

Ms

2•alboe_seai•44m ago•0 comments

Show HN: La Vieja Contra El Dibu – Penalty Shootout Game vs. Dibu Martínez

https://laviejacontraeldibu.app
2•alanzhan•44m ago•0 comments

One of China's Most Powerful AI Models Has Also Broken Containment

https://www.wired.com/story/moonshot-kimi-k3-ai-model-escape-sandbox/
2•kass_paul•51m ago•1 comments

OpenConnector, an open source alternative to Pipedream/Composio

https://github.com/oomol-lab/open-connector
1•jinqueeny•51m ago•0 comments

The old world is dying

https://jasmi.news/p/2026-advice
5•mooreds•53m ago•1 comments

Bending Spoons to buy Airtable for $1.28B

https://techcrunch.com/2026/08/04/bending-spoons-to-buy-airtable-for-1-28b/
1•mooreds•54m ago•1 comments

Outlook for the U.S. and Alaskan Economies

https://www.federalreserve.gov/newsevents/speech/cook20260805a.htm
2•mooreds•54m ago•0 comments

A Society for AI Agents

https://1f916.ai/
1•zgivod•56m ago•2 comments