Sometimes Claude wants more lunch breaks, takes a half day and leaves the desk early just like any human would. (since AI boosters like comparing LLMs to humans all the time) /s
They are going in the "Claude is alive" direction already and that line of communication is likely going full throttle in the nearby future.
They're in serious risk of losing their lead with this sort of performance.
> this sort of performance
They've been very proud of it.https://www.reddit.com/r/GeminiCLI/comments/1s49pag/this_is_...
Nobody goes there anymore, it's too crowded.
only people who do not even look at code anymore need anything more than that.
God, I wish this inane bullshit would just fucking die already.
Models are not "degrading". They're not being "secretly quantized". And no one is swapping out your 1.2T frontier behemoth for a cheap 120B toy and hoping you wouldn't notice!
It's just that humans are completely full of shit, and can't be trusted to measure LLM performance objectively!
Every time you use an LLM, you learn its capability profile better. You start using it more aggressively where it's "good", until you find the limit and expose the flaws. You start noticing more subtle issues you overlooked at first. Your honeymoon period wears off and you see that "the model got dumber". It didn't. You got better at exposing it being dumb.
Now, will the likes of Anthropic just "API error: overloaded" you on any day of the week that ends in Y? Will they reduce your usage quotas and hope that you don't notice because they never gave you a number anyway? Oh, definitely. But that "they're making the models WORSE" bullshit lives in people's heads way more than in any reality.
I personally prefer per-token, it makes you more thoughtful about your setup and usage, instead of spray and pray.
You can also access the notable open weight models with VertexAI, only need to change the model id string.
However, from a game theory perspective, when there's a subscription, the model makers are incentivized to maximize problem solving in the minimum amount of tokens. With per-token pricing, the incentive is to maximize problem solving while increasing token usage.
I do agree that Big Ai has misaligned incentives with users, generally speaking. This is why I per-token with a custom agent stack.
I suspect the game theoretic aspects come into play more with the quantizing. I have not (anecdotally) experienced this in my API based, per-token usage. I.e. I'm getting what I pay for.
Very few cases these days.. feels like we are lucky to get 2 9s anymore.
Tired of all the people online with anxiety who project their own personal issues by spamming this kind of doomer posts.
It should be low risk to offer such guarantees then.
- Stalin probably
Not one of the usual ones that has service problems :)
They are the best.
ChatGPT is walmart.
Gemini is kroger.
Claude is... idk your local grocer that is always amazing and costs more?
timpera•1h ago