I don't like these products. I have several negative opinions on them. To the extent they work and there is a customer base what marketing could you /possibly/ be engaged in? Doesn't the product sort of market itself? Or another way is this a product that you can market to expand your MAUs?
It's so polarizing I can't imagine how that $5.7B is being spent.
If I were really forced to.
LLMs provide me about the same value as a car does.
We have benchmarks on our domain and it does there are models that are 2x to 10x cheaper for a small drop in percentage points in accuracy
This is because people here are quietly realizing that they fell for the "token-maxxing" marketing drive which was complete BS for you to gamble more money on tokens as the big AI labs gave heavily subsidized token prices they cannot afford.
Jevon's paradox does not exist at those companies, but it certainly exists at the Chinese AI Labs at Deepseek, Alibaba, z.AI and Xiaomi.
Good callout. All these "trends" in AI were definitely from the AI companies themselves in order to push the sales of more tokens. What's after agent orchestration? Whatever it is, it will involve a big spend.
Some of my coworkers even use Sonnet (the default in Claude Code for the 20 USD subscription) and see no reason to change even though that model is definitely "outdated" compared to current SOTA.
If it's not materials, not energy or taxes, not manufacturing, not licensing or rental fees, then I can only think of R&D.
Look, for coding and a lot of other things, AI is awesome.
But the here's the killer. I have a dinky 16gb VRAM card, and that's kind of the sweet spot for the level of AI I actually want. I don't want it doing too much, I'd rather create slowly than have it one shot something that I have to then pore over later.
Feels like a company investing kazillions in, i don't know, air-conditioning or building wi-fi. Yes, it's going to be around, and also no one's gonna need THAT MUCH.
When I bought my last GPU, running AI models locally was a consideration though not the only one, and I have it set up but haven't used it much yet. I mostly use the free tiers of ChatGPT or Google to write the occasional script for me. I guess they're going to have to inject a truly unfathomable number of ads to get their money's worth.
I have a feeling my experience is closer to an average persons' than a dev, but it doesn't seem like they'll be able to monetize just from devs even if each one is spending thousands a month.
Don't give up just keep trying you can truly build personally life changing things. Don't look at it purely from a how do I sell this lense, just empower yourself with these tools while the getting is good
For work, it depends, but if I have to spend more than a few hundreds bucks probably I'll start looking for alternatives (local models, Chinese providers, ecc)
PS: I'm in Italy, I guess in several parts of the world these figures are even smaller.
Anyway: Zero, as of right now.
I fully expect to be able to run useful LLMs on a machine I can justify buying for other reasons. I already can on the secondhand kit I own, and I don’t expect the cost-benefit analysis of local LLMs to ever really get worse.
If I ever need to pay for it, it will likely be to shift some of the capacity into the cloud for either business or pragmatic personal reasons (so I can just carry an iPad etc.)
I fully intend my expenditure to be negligible. Because once one realises that outspending others is impossible, only spending minimisation makes sense.
I foresee it potentially making sense for me to move some mature tools off a local LLM to openrouter, maybe. But probably to the same or similar models.
It may put me at a disadvantage when it comes to quickly slop something together? But so far the free-to-use chat bots do as well for my needs.
R&D costs are hurting profit side and while you can cut that one just becomes irrelevant overnight in this space if you do, hence the problem.
simonw•1h ago