frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Show HN: I built a YC data scraper in under 5 minutes

https://www.autonoly.com/blog/682212a2b65a68f26d0c10a4/how-to-scrape-complete-y-combinator-startup-data-in-3-minutes-without-writing-a-single-line-of-code
2•dpacman•1y ago
Hi HN,

I'm an indie hacker who built Autonoly solo over the past 3.5 months. I essentially vibe coded the entire platform based on automation needs I encountered in my own work. I wanted to share a practical example of what it can do - creating a Y Combinator data scraper in just a few minutes without writing any traditional code.

The technical approach is straightforward but effective:

1. Browser automation navigates to YC's company directory 2. For YC's infinite scroll pagination, I implemented a progressive scroll function that iterates about 150 times with calibrated delays (ensuring all ~1000+ companies load) 3. Data extraction uses XPath selectors to identify and capture the structural pattern of each company listing 4. The system then extracts specific data points (company name, description, location, etc.) into a structured CSV

The trickiest parts were getting the XPath patterns right (the DOM structure varies slightly between different company entries) and fine-tuning the scroll timing to ensure complete loading without timeout issues.

What makes this approach effective is that it works with the site's intended user experience. The browser automation renders JavaScript properly, handles dynamic loading, and interacts with elements in a natural way.

While this YC scraper example is specific, I built Autonoly to automate virtually any digital task - data processing, content creation, file management, business workflows, and more. As an indie developer, I kept encountering processes that were tedious to do manually but didn't justify hiring someone or spending weeks on custom code.

I'd love to hear feedback from the HN community, especially from those who've built similar systems or have different approaches to workflow automation. Happy to answer any technical questions about the implementation or discuss the challenges of building automation tools as a solo founder.

Built 160 micro calculator tools and the keyword data genuinely surprised me

https://www.indiehackers.com/post/built-160-micro-calculator-tools-and-the-keyword-data-genuinely...
1•julian-vix•42s ago•0 comments

Forbes Thinks AI Created a New Profession. History Has Seen It Before

https://futurehangover.substack.com/p/forbes-thinks-ai-created-a-new-profession
2•DefNotAiForSure•5m ago•1 comments

Cronstable, a cron replacement with retries, DAGs and a TUI/web dashboard

https://github.com/ptweezy/cronstable
1•ptweezy•6m ago•0 comments

A new Intel Itanium (IA-64) emulator that boots Windows

https://raymii.org/s/blog/Intel_Itanium_IA-64-Emulator_that_boots_Windows.html
2•jandeboevrie•17m ago•1 comments

Americans are angry about data centers. Politicians are feeling the pressure

https://www.reuters.com/world/us/americans-are-angry-about-data-centers-politicians-are-feeling-p...
2•baranul•18m ago•0 comments

From Enlightenment to Alignment

https://smolnero.com/posts/from-enlightenment-to-alignment
1•andsoitis•18m ago•0 comments

Why It's So Hard to Add a Column in the Middle of a PostgreSQL Table

https://www.bytebase.com/blog/why-its-hard-to-add-a-column-in-the-middle-of-postgres-table/
1•thunderbong•21m ago•0 comments

Moore's Law for Everything

https://moores.samaltman.com/
1•dtj1123•26m ago•0 comments

I built an AI operating system after getting tired of repetitive work

https://lynx.apex7ai.com
1•levymartins•27m ago•0 comments

Data Science Weekly – Issue 660

https://datascienceweekly.substack.com/p/data-science-weekly-issue-660
1•sebg•30m ago•0 comments

Is the determinant of this "Fibonacci sum" indicator matrix always -1, 0 or 1?

https://mathoverflow.net/questions/513340/is-the-determinant-of-this-fibonacci-sum-indicator-matr...
1•philipfweiss•31m ago•0 comments

Russian drones spotted using screwed-on magnetic compasses as navigation aids

https://www.tomshardware.com/tech-industry/drones/russian-drones-spotted-using-screwed-on-magneti...
2•rmason•32m ago•1 comments

Mefo Bill

https://en.wikipedia.org/wiki/Mefo_bill
4•handfuloflight•40m ago•0 comments

How to soothe thumb pain when texting and scrolling

https://apnews.com/article/trigger-thumb-de-quervains-tenosynovitis-carpal-tunnel-35728b0142d310c...
3•devonnull•41m ago•0 comments

Tine: A new editor for Jai, Zig and C++

https://travisdp.itch.io/tine
1•travismd•41m ago•0 comments

Heavy TV watching associated with smaller brain structures, study finds

https://dornsife.usc.edu/news/stories/heavy-tv-watching-associated-with-smaller-brain-structures/
45•mashally•42m ago•16 comments

Wall of Optimism – I have reasons to believe the future is beautiful, and you?

https://wallofoptimism.com
3•nikitafaesch•45m ago•0 comments

Can LLMs write Base64 as well as they read it?

https://arvidsu.github.io/encode_bench/index.html
2•ArvidSu•48m ago•0 comments

HMD Fusion easy to repair smartphone

https://www.hmd.com/en_int/hmd-fusion
2•savolai•49m ago•1 comments

Show HN: A schema you change by talking to it, without the model writing SQL

https://github.com/leandrobon/mutable-crm
2•leandrobon•49m ago•0 comments

Prime Flow Field Background Animation

https://www.brt.fyi/posts/prime-flow-field/
4•maxbrt•52m ago•0 comments

Is someone Into process mining? Let's talk in this thread

1•FrancescoMassa•56m ago•0 comments

The Windows laptop market is so bad I'm considering a MacBook

https://old.reddit.com/r/laptops/comments/1uy4hj0/ive_officially_hit_rock_bottom_the_windows_laptop/
3•ksec•57m ago•0 comments

Eric Schmidt tried to convert Google to Java

https://www.youtube.com/watch?v=ceCy2_FRxxo
5•mashally•58m ago•1 comments

Barbarians at the Gateways (2013)

https://spawn-queue.acm.org/doi/10.1145/2523426.2536492
2•tosh•1h ago•0 comments

Pyinfra Is Underrated

https://pyinfra.com
5•zxspectrumk48•1h ago•0 comments

Why Argentina Has Almost No Black People [video]

https://www.youtube.com/watch?v=FiPSZ_eaRPo
6•baranul•1h ago•0 comments

Trend Has Russian Men Smashing Their iPhones for a Manlier Look

https://www.odditycentral.com/videos/bizarre-trend-has-russian-men-smashing-their-iphones-for-a-m...
11•jethronethro•1h ago•1 comments

On Claude's Clotted Writing Style

https://blog.kierangill.xyz/clotted-claude
3•kierangill•1h ago•0 comments

The Newest Vegas Loop Stations Will Blow Your Mind [video]

https://www.youtube.com/watch?v=e7vFCP3PtuA
2•Topfi•1h ago•0 comments