I fully expect token vendors to go the way of mobile data providers. Increasing throughput and efficiency, yet commoditized and not reaping the massive rewards of the economic gains their technologies enable.
Can't wait for the unlimited plans we will have in due time.
Iolaum•49m ago
They will not come. You can only spend so much time speaking on the phone.
But if you get unlimited tokens, with scheduled/automated jobs and subagents you will burn a LOT of money.
verdverm•46m ago
Mobile video data and tethered devices would tell a different story. Usage growth has been significant.
I expect they will be "unlimited" in the same sense the mobile / ISPs do that 99% of people never reach the limits.
We could have "unlimited" electricity too, if we choose, by printing solar panels (like the Chinese) and hopefully fusion before long.
ModernMech•40m ago
> You can only spend so much time speaking on the phone.
Tell that to my dial up modem as I played Active Worlds in 1996.
boredatoms•29m ago
Yeu were still limited to about 4GiB/month usage as a time/bandwidth ceiling
Skunkleton•34m ago
"Unlimited" for a consumer will probably take a form like limited parallel agents at max intelligence for X amount of tokens, followed by either single threaded agents or nerfed intelligence or both.
This is the same mechanism used in unlimited mobile internet for example.
cicko•13m ago
I rarely use more than 25% of my subscription's weekly allowance. So, it's already unlimited.
JumpCrisscross•32m ago
> if you get unlimited tokens, with scheduled/automated jobs and subagents you will burn a LOT of money
Maybe, maybe not. There could be a saturation point of compute demand from ordinary consumers. (See: hot-water analogy.)
bikvfeee•30m ago
> Can't wait for the unlimited plans we will have in due time.
I don't see how this can happen. The cost of serving a model grows linearly with use (energy). The cost of serving a mobile data plan is approximately zero.
buckleyourshoe•38m ago
Competition drives prices down. We tried Kimi and GLM models after hitting 'cybersecurity' blocks on OpenAI and Anthropic. We found them to be much cheaper to access and helped us complete our work without 'cybersecurity' refusals blocking us.
soupfordummies•12m ago
I wouldn’t be surprised if US “bans” access to the Chinese models by the end of the year
bethekidyouwant•10m ago
How?
ApolloFortyNine•5m ago
If you are a legally operating company in the US just saying it's banned is enough, the threat of enforcement is enough pressure.
You and I obviously can just use a VPN, but 99% of usage is likely as part of a company.
rcstank•5m ago
What harness are you all using? OpenCode?
gum_wobble•37m ago
Because they have found a way that cost them less to have you use a lesser capable model o less expensive
hauntingseaweed•28m ago
Price war. Duh. There is no moat. Also them chinese competition. It’s going to be race to the bottom. It’s gonna be ugly for the stock market. Good for consumers though!
SugarReflex•25m ago
Can they do the same thing with fuel prices?
dwattttt•22m ago
If you make it easy for lots of people to make the fuel, yes. EVs and smaller scale power generation anyone?
YetAnotherNick•22m ago
Yes if China somehow gets the fuel and subsidize it to sell it for cheaper in the global world, even the gulf state price will go down.
dymk•16m ago
Solar panels (which continue get cheaper every year) on my house makes charging my low-TCO EV free in 5 years
3eb7988a1663•24m ago
Just wait until the government ban on the dangerous open models materializes.
Kuyawa•12m ago
Duh, China?
bhu8•10m ago
It’s probably more efficient caching methods and smaller models (6 sol is actually 6 terra and opus 5.5 is smaller than 5.1 etc). Don’t overthink this please
chakintosh•9m ago
It’s a race to the bottom to see who blinks first and goes bankrupt. It’s not sustainable.
verdverm•52m ago
Can't wait for the unlimited plans we will have in due time.
Iolaum•49m ago
But if you get unlimited tokens, with scheduled/automated jobs and subagents you will burn a LOT of money.
verdverm•46m ago
I expect they will be "unlimited" in the same sense the mobile / ISPs do that 99% of people never reach the limits.
We could have "unlimited" electricity too, if we choose, by printing solar panels (like the Chinese) and hopefully fusion before long.
ModernMech•40m ago
Tell that to my dial up modem as I played Active Worlds in 1996.
boredatoms•29m ago
Skunkleton•34m ago
This is the same mechanism used in unlimited mobile internet for example.
cicko•13m ago
JumpCrisscross•32m ago
Maybe, maybe not. There could be a saturation point of compute demand from ordinary consumers. (See: hot-water analogy.)
bikvfeee•30m ago
I don't see how this can happen. The cost of serving a model grows linearly with use (energy). The cost of serving a mobile data plan is approximately zero.