frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•12mo ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

I gave Claude Code live social media data

https://fridayaiclub.com/how-to-give-claude-code-social-media-data/
1•magneticbrains•42s ago•0 comments

India to shrink zones around nuclear reactors to free up land, sources say

https://economictimes.indiatimes.com/industry/energy/power/india-to-shrink-zones-around-nuclear-r...
1•rustoo•1m ago•0 comments

How to Mark Issues in a Property Inspection Report Before Signing

https://boldsign.com/blogs/property-inspection-report-markup-before-signing/
1•Rachel_Atieno•1m ago•0 comments

OP's script shuts down every single computer in the company

https://www.reddit.com/r/sysadmin/s/7kD2rPS6yV
1•_s•1m ago•0 comments

Extremely Low Frequencies

https://computer.rip/2026-05-09-extremely-low-frequencies.html
1•sohkamyung•5m ago•0 comments

Show HN: I built a planner with workspaces, tasks, notes, calendars, journals

https://nerali.app
1•Multipassionate•5m ago•2 comments

WhatsApp Plus

https://faq.whatsapp.com/1480290710396618/?cms_platform=web
1•xethos•6m ago•0 comments

BaseLedger: An open-source API quota firewall for AI agents

https://github.com/baseledger-io/baseledger
1•minjibir•7m ago•0 comments

Show HN: Importing resources into tfstate is no longer annoying

https://tfimport.coolapso.sh/
1•coolapso•8m ago•0 comments

Content for Content's Sake

https://lucumr.pocoo.org/2026/5/4/content-for-contents-sake/
1•mooreds•9m ago•0 comments

Sony's failed war against Internet piracy may doom other copyright lawsuits

https://arstechnica.com/tech-policy/2026/05/sonys-failed-war-against-internet-piracy-may-doom-oth...
2•duxup•9m ago•0 comments

Agile in the Age of AI

https://miren.dev/blog/agile-in-the-age-of-ai
1•mooreds•10m ago•0 comments

Patterns for Reducing Friction in AI-Assisted Development

https://martinfowler.com/articles/reduce-friction-ai/
1•mooreds•11m ago•0 comments

National Academy of Sciences experts denounce Trump's NSF board purge

https://www.scientificamerican.com/article/national-academy-of-sciences-experts-denounce-trumps-n...
2•beardyw•11m ago•0 comments

I Am the VP of Workforce Transformation

https://xcancel.com/gothburz/status/2052901772520288370
1•zimpenfish•12m ago•0 comments

Show HN: Studis – Turn product photos into social media ads with AI

https://studis.io/
1•marjanatanasov•16m ago•0 comments

Analysing the Urban Attack: Insights from Soviet doctrine as a 'model checklist'

https://researchcentre.army.gov.au/library/land-power-forum/analysing-urban-attack-insights-sovie...
1•omnibrain•17m ago•0 comments

From Today, Software Engineering Is Dead

https://building138.com/from-today-software-engineering-is-dead
10•usernamed7•19m ago•3 comments

Forget the AI job apocalypse. AIs real threat is worker control and surveillance

https://www.theguardian.com/technology/2026/may/11/ai-worker-control-surveillance
3•beardyw•21m ago•1 comments

Open weights are quietly closing up – and that's a problem

https://martinalderson.com/posts/open-weights-are-quietly-closing-up/
2•birdculture•21m ago•0 comments

Rockstar fit a city into PlayStation 2 memory [video]

https://www.youtube.com/watch?v=cIbCxbrBCys
2•brandrick•22m ago•0 comments

Notes from a Gopher Hole

https://brookjeynes.dev/writings/2026/notes-from-a-gopher-hole/
1•chooky•25m ago•0 comments

An Immigrant's Love Letter to the West by Konstantin Kisin

https://www.sandordargo.com/blog/2026/05/09/an-immigrant-s-love-letter-by-kisin
1•ibobev•28m ago•0 comments

Using AI for just 10 minutes might make you lazy and dumb

https://www.wired.com/story/using-ai-negative-impact-thinking-problem-solving-study/
6•nottorp•29m ago•1 comments

Benchmarking Claude Opus 4.6 Vulnerability Detection

https://github.com/ZeroPathAI/opus-benchmark
1•jviide•29m ago•0 comments

What AI harnesses should learn from OAuth

https://ryanhiebert.com/oauth-for-ai-harnesses/
2•ryanhiebert•29m ago•1 comments

Concurrent, atomic MSI hash tables

https://nullprogram.com/blog/2026/05/06/
1•ibobev•29m ago•0 comments

Atomic Queue

https://uvdn7.github.io/atomic-queue/
1•ibobev•29m ago•0 comments

Bashunit 0.36.0 – Branch coverage, NPM distribution, and faster reports

https://github.com/TypedDevs/bashunit/releases/tag/0.36.0
1•Chemaclass•30m ago•0 comments

Wagering on War – How Insider Trading Destroys Armies [video]

https://www.youtube.com/watch?v=6lz3vTUbClc
2•mattashii•32m ago•0 comments