It won't pay off if LLMs efficiency gets good enough to make those data centers obsolete.
It's a huge gamble.
brainwad•3m ago
Or: increasing resource efficiency may encourage even more usage, as happened with coal, oil and photovoltaics.
Insanity•1m ago
Given how heavily subsidized it is at the moment, the efficiency isn’t as important. Typically efficiency would give you more at lower cost, but with token prices so removed from actual cost that plays less of a role here.
pingou•1m ago
Wouldn't improving LLMs efficiency make them even more useful across the board, then they can enjoy the nice economies of scale?
The plan is to have LLMs working completely autonomously, in that case, the more resources you have, the better.
Perhaps people would use their local LLMs to ask questions, but that's not where to money would be made.
elmer2•29m ago
It's a huge gamble.
brainwad•3m ago
Insanity•1m ago
pingou•1m ago
The plan is to have LLMs working completely autonomously, in that case, the more resources you have, the better. Perhaps people would use their local LLMs to ask questions, but that's not where to money would be made.