Or we just develop it a bit more slowly. Wait 10 years and the amount of energy and data center capacity to do training runs will be substantially lower than it is today, plus the software will also achieve substantial efficiency gains. Spending too much on hardware today that will be obsolete for such purposes in 10 years seems like a mistake, and unlike the fibre built during the .com boom, there will be little residual value left in 10 year old GPUs.
toomuchtodo•2mo ago