frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Contextual web personalization and inspection engine on Fastly's edge stack

https://cheaply-joint-goshawk.edgecompute.app/
1•Fcuervo•40s ago•0 comments

The evolution of AI-assisted software engineering paradigms

https://pasqualepillitteri.it/en/news/182/evolution-ai-software-engineering-paradigms-agentic-loop
1•teleforce•1m ago•0 comments

Using AI to write better code more slowly

https://nolanlawson.com/2026/05/25/using-ai-to-write-better-code-more-slowly/
1•signa11•2m ago•0 comments

Garden Grove chemical tank cools, risk of catastrophic explosion eliminated

https://ktla.com/news/orange-county/garden-grove-chemical-tank-crack-explosion-risk/
2•Bender•4m ago•0 comments

I built an interactive job application that talks back

https://firstdeploy.ai/
1•AgentHive•5m ago•0 comments

Chatbot Has a Long Memory. That Isn't Always a Good Thing

https://www.wsj.com/tech/ai/ai-memory-cd1de7f4
3•lucaspauker•7m ago•0 comments

US's big bet on quantum computing may not be legal

https://arstechnica.com/tech-policy/2026/05/uss-big-bet-on-quantum-computing-may-not-be-entirely-...
1•Bender•8m ago•0 comments

Citing Gandalf, Pope Leo says we must "disarm" AI

https://arstechnica.com/tech-policy/2026/05/citing-gandalf-pope-leo-says-we-must-disarm-ai/
1•Bender•8m ago•0 comments

Offshore finance is thriving despite crackdowns

https://www.economist.com/finance-and-economics/2026/05/25/offshore-finance-is-thriving-despite-c...
1•petethomas•9m ago•0 comments

Cox Media fined after bragging it spied on users through their phones

https://www.theverge.com/policy/937027/cox-media-marketing-ai-powered-phone-spying-ads-ftc-fine
1•sbulaev•9m ago•0 comments

Solving the Board Game Quoridor

https://grantslatton.com/solving-quoridor
1•cjlm•11m ago•0 comments

EDR transparency study (Cisco, Kaspersky, Microsoft top the list)

https://av-comparatives.org/independent-study-highlights-transparency-and-data-practices-in-leadi...
1•AnnaKoro453•21m ago•0 comments

Builders Fallacy

https://davidgu.com/bf.html
2•benswerd•27m ago•1 comments

DAAF: Rigorous+responsible data analysis/research with Claude Code (open-source)

https://daaf.openaugments.org/
1•brhkim•27m ago•0 comments

Interview with Sam Conman

https://zhenyi.gibber.blog/interview-with-sam-conman
1•zhenyi•28m ago•0 comments

Mec builds first High-NA EUV-fabricated quantum dot qubit

https://www.tomshardware.com/tech-industry/semiconductors/imec-builds-worlds-first-high-na-euv-fa...
1•sbulaev•29m ago•0 comments

Type.lol

https://type.lol/
1•bookofjoe•29m ago•0 comments

Show HN: Nerve – self hosted runtime for AI agents

https://github.com/ClickHouse/nerve
2•animetyan•32m ago•2 comments

What Is a Direct Attach Copper (DAC) Cable

https://www.servethehome.com/what-is-a-direct-attach-copper-dac-cable/
1•teleforce•35m ago•0 comments

Every Frontier AI Is INTJ

https://zonted.com/posts/every-ai-is-intj/
1•bernardjhuang•36m ago•1 comments

PDFearn free $3 method daily pdf

https://pdfearn.blogspot.com/2026/05/free-pdf-earn-3-per-day-by.html
1•iLzKii•36m ago•1 comments

Canada losing top talent as workers head to the U.S.

https://www.bnnbloomberg.ca/investing/market-outlook/2026/05/25/market-outlook-canada-losing-top-...
22•leopoldj•36m ago•8 comments

Ask HN: Laptops with good Linux support and good build quality?

1•asxndu•38m ago•5 comments

Pope Leo's 'Magnifica humanitas': AI must serve humanity not concentrate power

https://www.vaticannews.va/en/pope/news/2026-05/pope-leo-xiv-encyclical-magnifica-humanitas-ai.html
2•SebastianSosa•39m ago•0 comments

How Shamir's Secret Sharing Works

https://ente.com/blog/how-shamirs-secret-sharing-works/
1•subract•42m ago•0 comments

Is 2027 the Next Year?

https://bsky.app/profile/davis.social/post/3mmpcff4cdc2r
2•hansmayer•42m ago•0 comments

Route 4: Reconstructing Execution Continuity in EVM Environments

https://blog.bridgexapi.io/route-4-reconstructing-execution-continuity-in-evm-environments
1•Bridgexapi•43m ago•0 comments

American journalist charged with serving as unregistered agent for China

https://www.politico.com/news/2026/05/25/american-journalist-unregistered-agent-china-00935518
1•cwwc•45m ago•0 comments

Agentic Patterns

https://veso.ai/research/agentic-patterns/
2•kinlan•46m ago•0 comments

The Virgin Unicorns

https://www.geekwire.com/2026/etzioni-on-ai-the-virgin-unicorns/
2•jkuria•48m ago•0 comments