frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Towards a Theory of Bugs: The Ruliology of the Unexpected

https://writings.stephenwolfram.com/2026/07/towards-a-theory-of-bugs-the-ruliology-of-the-unexpec...
1•Brajeshwar•24s ago•0 comments

I Built a Private Genomics Study with Stoffel MPC

https://vishakh.blog/2026/07/21/i-built-a-private-genomics-study-with-stoffel-mpc/
2•vishakh82•3m ago•0 comments

OpenAI Models Escaped and Hacked a Company in Cybersecurity Test Gone Wrong

https://www.wsj.com/tech/ai/openai-models-escaped-and-hacked-a-company-in-cybersecurity-test-gone...
2•flippyhead•4m ago•0 comments

Show HN: DataParade – generate dataflow diagrams from code for risk assessments

https://github.com/DataParade-io/dataparade-cli
3•dpdave•4m ago•0 comments

Most Americans Say "Not in My Backyard" to AI Data Centers

https://www.redfin.com/news/ai-data-centers-opposition-education-benefit/
2•toomuchtodo•4m ago•0 comments

OpenNode – Bitcoin Payment Processor

https://opennode.com/
2•gurjeet•4m ago•0 comments

A conversation becomes an AI agent's memory

https://squidler.io/blog/agent-memory-2-capture
2•tidbeck•6m ago•0 comments

How many Tokens are you worth?

https://howmanytokensareyouworth.com/
2•theshaun•6m ago•0 comments

Rescuing satellites is harder than it looks

https://theconversation.com/rescuing-satellites-is-harder-than-it-looks-a-growing-space-junk-prob...
2•speckx•7m ago•0 comments

How to Read a Painting

https://sheets.works/data-viz/how-to-read-a-painting/
3•darshi7331•7m ago•0 comments

Show HN: Cosyra – run cloud coding agents from your phone

https://cosyra.com/
2•adamisnotroman•8m ago•0 comments

DesignStudio: The AI-native code editor and computational design IDE

https://www.spatialbound.com/ide
4•mibrahimSB•8m ago•0 comments

Tahr Security Skills

https://www.skills.sh/tahr-security/tahr-security-skills
2•zilbon•10m ago•0 comments

Show HN: Foomchat – an AI chat where the interface is whatever you want

https://foomchat.com
2•scrygl•10m ago•0 comments

A $6.49 Cloud VM Became One of Our Highest-Ranked Clusters

https://webbynode.com/articles/bang-for-buck-1-how-a-6-49-cloud-vm-became-one-of-our-highest-rank...
3•gsgreen•11m ago•0 comments

Raspberry Pi, Picos, Hats Humble Book Bundle

https://www.humblebundle.com/books/picos-hats-and-more-raspberry-pi-press-books
3•teleforce•12m ago•0 comments

Tdd.cat

https://tdd.cat
4•arpitbbhayani•13m ago•0 comments

I was reporter #11 for a WPForms PayPal webhook vulnerability

https://blog.himanshuanand.com/2026/07/reporter-11-10-people-found-the-wpforms-paypal-bug-before-...
3•unknownhad•13m ago•0 comments

Passkeys were invented by engineers with zero understanding of consumer brain

https://twitter.com/nikitabier/status/2079787406300266743
4•ksec•14m ago•0 comments

WASM TeX Engines (PdfLaTeX/XeLaTeX/LuaLaTeX)

https://github.com/corca-ai/wasmtex
3•amichail•14m ago•0 comments

Rapid Word Collection: An updated approach to dictionary creation (2012)

https://www.sil.org/enterprise-news/rapid-word-collection-updated-approach-dictionary-creation
3•yorwba•16m ago•0 comments

Securing AI Using Zero Trust Principles

https://www.ciscopress.com/store/securing-ai-using-zero-trust-principles-9780138363321
3•teleforce•16m ago•0 comments

Show HN: Dejavu – stop showing coding agents the same command output twice

https://github.com/Salnika/dejavu
2•salnika•17m ago•0 comments

Non-performant software and its incentives

https://iainschmitt.com/post/non-performant-software-and-its-incentives
2•surprisetalk•18m ago•0 comments

The speech engine built into macOS 26 nearly ties Nvidia's best on-device model

https://get-inscribe.com/blog/parakeet-moss-apple-speech-benchmark.html
2•get-inscribe•18m ago•0 comments

PyPI Blog: Releases now reject new files after 14 days

https://blog.pypi.org/posts/2026-07-22-releases-now-reject-new-files-after-14-days/
2•miketheman•18m ago•0 comments

Show HN: Ingot, evidence-gated optimization and version control for agent skills

https://github.com/SlanchaAI/ingot
4•laul_pogan•19m ago•0 comments

Show HN: Wi-Fi Remote for My AC on an M5StickC, in Rust

https://github.com/mnaza/condition-control
2•mnaza•19m ago•0 comments

When Is NVLink Worth It?

https://platform-fools.com/posts/2026-04-27-nvlink/
2•ak_t•21m ago•0 comments

Quality non-fiction books are the antithesis of AI slop

https://resobscura.substack.com/p/quality-non-fiction-books-are-the
1•benbreen•21m ago•0 comments