frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Maxwell's Ghosts

https://verfassungsblog.de/maxwells-ghosts/
1•jruohonen•4m ago•0 comments

Every Windows 11 app should kill Electron, and Discord just showed why

https://www.windowslatest.com/2026/11/06/every-windows-11-app-should-kill-electron-and-discord-ju...
2•thunderbong•5m ago•0 comments

Nordic AI Health Map

https://healthmap.newnordics.ai/
1•madspindel•6m ago•0 comments

New Gamification Event App

https://boothhop.ing/
1•bjbeehler•9m ago•0 comments

ChatGPT business hub spotted showing daily mentions and clicks

https://mojodojo.io/blog/chatgpt-business-hub-mentions-clicks
2•zenincognito•15m ago•0 comments

The cyber range builder for red, blue and purple teams.

https://www.purpleedge.io
1•TrojanJockey•17m ago•0 comments

Show HN: First iOS personal agent that executes on device

https://apps.apple.com/us/app/result-your-personal-agent/id6825805595
1•aaryankushwah•19m ago•0 comments

US air traffic control enters the 21st century, starts to abandon floppy disks

https://www.theregister.com/public-sector/2026/11/06/us-air-traffic-control-enters-the-21st-centu...
1•nephihaha•19m ago•0 comments

Ask HN: If you use Notion or Obsidian, what features should be added?

1•anragyadev•23m ago•0 comments

The Pentagon wants to know who checks code when AI writes it

https://about.gitlab.com/blog/department-of-war-instruction-for-ai-generated-code/
1•qtqtqt•24m ago•0 comments

The Shared Cache; A short novel written by Opus 5.5 based on a true story

https://khaledez.net/blog/the-shared-cache/
1•khaledez•25m ago•0 comments

Show HN: Fermi Poker, a combination of poker betting mechanics with estimation

https://fermi.org
1•danielfetz•25m ago•0 comments

Mini-Manual of Informational Insurgency

https://drive.google.com/drive/folders/1pnjYduytGSPTioRcnA_Ni2X5Tr1wk1HB
1•Tomte•29m ago•0 comments

NASA-Funded Study Details One of Oldest Mars Meteorites Ever Found

https://www.jpl.nasa.gov/news/nasa-funded-study-details-one-of-oldest-mars-meteorites-ever-found/
1•ricksunny•34m ago•1 comments

How many frames does a scroll animation need? (and how big should each be)

https://beta.scrollsequence.com/blog/how-many-frames-scroll-animation
4•hellofromalki•34m ago•0 comments

AARE: A proof-of-concept open-source implementation of Android Auto

https://github.com/prototux/AARE
3•edward•36m ago•0 comments

Layoffs that smells like conspiracy, hard to digest

https://www.shuffle-on.com/blog/ai-layoff-wave-2023-2026
1•lisneanucristia•40m ago•0 comments

Call is being recorded – and broadcast to the internet

https://groundup.org.za/article/your-call-is-being-recorded-and-broadcast-to-the-internet/
2•SkillBeatsAll•42m ago•0 comments

Microcorruption: Classic Web-Based Assembly Reverse Engineering Game

https://microcorruption.com/
2•0x737368•43m ago•0 comments

The vi Editor Turns 50: Interview with Bill Joy (1984)

https://computeradsfromthepast.substack.com/p/unix-review-interviews-sun-co-founder
1•so-cal-schemer•44m ago•3 comments

What happens if all the lights go out? This is the plan for a 'Black Sky' event

https://www.bbc.com/news/articles/ck5ynnj05z8no
1•geox•44m ago•0 comments

Clawdcursor > Computer-Use

https://clawdcursor.com
1•AmDab•46m ago•0 comments

Tamizdat Project: Banned Books from the Cold War to the Present

https://tamizdatproject.org/
1•jruohonen•46m ago•0 comments

Trace – Crash-safe durable Sagas for autonomous AI agents

https://github.com/orikami048/trace-agent-lang
1•orikamiii•48m ago•0 comments

Greece launches semiconductor and microelectronics strategy

https://hccc.org.gr/greece-opens-a-new-chapter-in-microelectronics-and-semiconductors/
2•greekanalyst•51m ago•0 comments

Show HN: Retex, a Faster LaTeX Engine

https://gitlab.com/severin-lemaignan/retex
1•skadge•53m ago•0 comments

Show HN: One-script installer for TRELLIS.2 on Nvidia Blackwell under WSL2

https://github.com/Creepybits/trellis2-blackwell-wsl
1•creepybits•55m ago•0 comments

Acceleration and Resonance [pdf]

https://journals.sagepub.com/pb-assets/cmscontent/ASJ/Acceleration_and_Resonance.pdf
1•jruohonen•56m ago•0 comments

Postcrossing Spotlight: DrHyde from the UK

https://www.postcrossing.com/blog/2026/11/07/postcrossing-spotlight-drhyde-from-the-uk
1•Tomte•57m ago•0 comments

The Verse Programming Language

https://verselang.github.io/book/00_overview/
1•elephantum•1h ago•0 comments