frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Baltimore County schools phase out AI reading program

https://www.thebanner.com/education/k-12-schools/county-schools-artificial-intelligence-453DCFYJL...
1•biker142541•3m ago•0 comments

UPS cargo plane collides with passenger jet at Miami International Airport

https://www.gulfcoastnewsnow.com/article/planes-collide-at-miami-international-airport/74431861
1•thunderbong•4m ago•0 comments

Mirepoix

https://en.wikipedia.org/wiki/Mirepoix
1•tosh•5m ago•0 comments

Reading JSON at 277 GB/s in Python

https://lemire.me/blog/2026/11/14/reading-json-at-277-gb-s-in-python/
1•chmaynard•6m ago•0 comments

Show HN: IndexFast – see which of your pages search engines actually know about

https://indexfast.co
1•sh20raj•6m ago•0 comments

Show HN: Cshoal – A school of fish, hunted by predators, in your terminal

https://github.com/mcthomas/cshoal
1•Bondi_Blue•14m ago•0 comments

Book list for streetfighting computer scientists

https://nick-black.com/dankwiki/index.php?title=Book_list_for_streetfighting_computer_scientists
1•num42•34m ago•0 comments

ICC stops probe into US troops, continues investigating Taliban

https://www.newarab.com/news/icc-stops-probe-alleged-crimes-us-troops-afghanistan
1•cowlevel•40m ago•1 comments

I tested an AI dance edit on five seconds of footage, then tried the whole clip

https://medium.com/@wangjiayiliuyan/i-tested-an-ai-dance-edit-on-five-seconds-of-footage-then-i-t...
1•visiohex•44m ago•0 comments

Show HN: ShadowDiff – Shadow testing and SQL diffing for AI-migrated back ends

https://github.com/vishalrajofficial/ShadowDiff
1•vishalraj1•48m ago•0 comments

China's COMAC electric plane completes first crewed flight

https://www.reuters.com/video/watch/idRW841714112026RP1/
3•xbmcuser•49m ago•0 comments

Show HN: Hello Triangle, a puzzle game where you build a GPU

https://hellotriangle.icedlatte.ca/
2•icedlatte•50m ago•0 comments

PDF tools that run in the browser – nothing is uploaded

https://privacypdftools.com/
1•sareefirshan•52m ago•0 comments

Show HN: Offline quoting, receipts, and expense tracking for entrepreneurs

https://play.google.com/store/apps/details?id=com.companyname.moneyacc&hl=en_US
1•nowizzville•53m ago•0 comments

Electricity Prices Fall Across Australia as Renewables Build Momentum

https://cleantechnica.com/2026/06/01/electricity-prices-fall-across-australia-as-renewables-build...
2•xbmcuser•54m ago•0 comments

Hyperclay: Where your team's HTML files belong

https://hyperclay.com/
2•orangea•54m ago•0 comments

Jaab – AI Job Hunt Copilot

https://chromewebstore.google.com/detail/jaab-ai-job-hunt-copilot/anpjlacmlihooopakbogefcdffpibpll
1•cheikhdev•1h ago•0 comments

"Why Tailscale? (Open-sourcing my cover letters)"

https://thoward37.me/blog/articles/why-tailscale/
3•thoward37•1h ago•0 comments

The Coming Patent Storm in AI Hardware

https://www.troutman.com/insights/the-coming-patent-storm-in-ai-hardware-what-the-capital-flows-t...
1•peter_d_sherman•1h ago•0 comments

From Object to Infrastructure: Apple's Rhetorical Canon

https://medium.com/@smoking2man/from-object-to-infrastructure-apples-rhetorical-canon-and-the-str...
1•Aldus551•1h ago•0 comments

Ask HN: Dropbox privacy policy, cause for concern?

4•herodoturtle•1h ago•0 comments

Remote work increases sleep and reduces physical activity

https://www.utu.fi/en/news/press-release/remote-work-increases-sleep-and-reduces-physical-activit...
3•rohanm93•1h ago•1 comments

Patch clock now starts before disclosure

https://buttondown.com/nclawdev/archive/your-patch-clock-now-starts-before-disclosure/
1•nadiasora•1h ago•0 comments

Free the Software: M68K Genesis ROM Tracing and CC0 Album

https://archive.org/details/full_album
3•Assembly_LKE•1h ago•1 comments

Lawyer upgrades eight-V100 private AI server to run 80% of DeepSeek v4.1 Flash

https://www.tomshardware.com/tech-industry/artificial-intelligence/lawyer-upgrades-eight-v100-pri...
1•peter_d_sherman•1h ago•0 comments

Stonebrook Quill: full-featured AI-authored fantasy font

https://swordcoastmap.com/font
1•elliotbnvl•1h ago•0 comments

Show HN: Quilt – a bright, modern take on identicons

https://quilt.id/
2•carlsverre•1h ago•0 comments

IBM Spyre AI Accelerator Card (75W PCIe Card with 128GB of LPDDR5)

https://www.ibm.com/docs/en/systems-hardware/zsystems/9175-ME1?topic=introduction-spyre-accelerator
1•peter_d_sherman•1h ago•0 comments

Made a Firefox addon to swap and inspect fonts

https://addons.mozilla.org/en-US/firefox/addon/typeshift-font-inspector/
1•DarthSisyphus•1h ago•0 comments

My Quest to Find the Crispest Apple in America

https://www.wsj.com/arts-culture/food-cooking/crisp-apple-varieties-test-c12940ba
4•impish9208•1h ago•1 comments