It's too bad Altman already blew his wad with the whole Dyson sphere thing. It's hard to top that. Maybe he can promise them a paperclip universe? That's gotta be worth a few more trillion.
When I first heard of tokenmaxxing, I thought it had to be a joke. But no, it turned out to be a widespread phenomenon. I still cannot believe that was a thing.
What I keep saying in internal meetings is: "I am so glad these people are this bad at deploying these tools." It really leaves the door open for folks like us.
We did a 90 day push and identified where we found value and where we didn’t. Our tools teams really upped their game, more than expected, and it would have been unlikely to have been funded if they tried to justify the budget as an individual initiative.
There’s a spectrum of people - some folks are building rando apps for fun with LLMs, and many don’t really know what’s possible becuase they don’t or can’t invest in the subscription to really use the tools at home.
So by default you'd be better with one of the Chinese models if you're American.
Chinese models have government-enforced censorship, while American models have security and legal restrictions.
Given how big AI is, and how those two are pretty much the only players (in comparison aws is 1/3 market share), that seems about right.
It's a far cry from "nobody's going to be writing any code, and ai will do all the things in 6 months".
Well, that is unless the burst also brings a general collapse. Some are seeing similarities with 2008.
If you don't have the flexibility to regularly push your context to 1M, or do elaborate xhigh planning sessions, your opinion won't reflect reality.
Many of the most successful applications of LLMs are fields that were already terrible. For example, LLMs are a natural fit for customer support. And somehow, it's also a natural fit for software engineering, which I suppose is an indictment of our field... who cares if a model comes up with a bad architecture or a product that only kinda-works, that's how we always rolled.
Agree, but only partially.
When I said "provide services previously not possible," it was just due to the fact that finding and allocating the talent to do analysis on Topic X, would have previously made many products too expensive and non-tech complex to provide.
Even if you just consider LLMs + harnesses to be an improved search tool, there is a lot you can make with a better search tool.
Can’t do that with OAI and Claude
https://marketplace.visualstudio.com/items?itemName=sst-dev....
If the CCP actually gave a shit about how the West sees them they should lean in on this but the difference between the USSR and China is that the Chinese don't secretly crave acceptance.
From actually using these models, I disagree. The open weight models are nice for lower cost tasks, but having spent time with a lot of models I cannot agree that the open weight models are roughly the same performance.
Most of us use subscription plans for personal work, which makes the price difference to the hosted open weights models smaller or negligible. I’d rather spend a little more if it reduces the time I have to spend reworking or restarting with new prompts.
Kimi K3 might be close, but it’s not actually open weight yet. They’ve just committed to releasing the weights. The only provider you can get it from is Moonshot. I haven’t spent too much time with it, but from what I’ve seen it’s not actually Fable level even though some benchmarks say that.
The reasons are:
1. A less valid reason but (iirc) its their clients who believe that American models are safer in that context. Fighting their client about that demand is really hard given the really sensitive work that they deal with.
2. Their system actually makes it so from my understanding that even the employes couldn't access the private data itself or have some really hard lockdowns. They use some sort of service provided by Azure for that with GPT models.
IMO, the thing that they were worried about were more the deprecation of previous models and they reluctantly have to switch models and the models censorship which is a real pressing concern for them
The previous gpt model that they were on (I think 4o/5 I am not sure) was more willing to answer their questions. The recent models are more like "let me stop you just right there" and other censorship.
With models switching and being forced to change to models which aren't as effective for use cases, a point comes where they might change from it altogether into open-weights model hosted on nearby servers, but I think that they are waiting to see how things pan out really
tyleo•1h ago
6stringmerc•30m ago
The other, more complex one would be “what benefit” are you talking about? Clearly there are some differences in performance regarding speed and token cost, but industry news indicates not a single one has solved the inherent hallucination problem which makes the reliability akin to an untreated schizophrenic research or coding assistant.
notfromhere•27m ago
officialchicken•24m ago
lazide•24m ago
cmiles74•21m ago