It needs those three things to unlock that sweet free crowd talent pool of volunteers and curious learners that have been at the core of IT innovation for decades.
The rigs are becoming more expensive, and good content is becoming more scarce. I don't see a way to reverse this trend.
We are already past the "NeXT point" (a revolutionary rig that is very expensive but pays off). If I had invested in a super multi-GPU rig 5 years ago (beginning of the LLM craze), it would have been useless by now. If I buy one now (NeXT computer money but adjusted to today's price), it's already obsolete for LLM training. I need to go for multiple server rigs to "see it".
Too fast to brew worthy competitors. All big players products are roughly the same, cannibalizing each other's ideas. Tech needs the free competition volunteers, haven't you guys figured that out yet?
quintes•8mo ago