Sort of. Big fan of 404media usually, but they need to "look through the bubble" to understand this can and likely will be replicated on device when local models and inference catch up, which they will eventually (Apple Intelligence, Hermes, OpenClaw, etc). Slap iCloud and Google Storage sync on the app, and you've got your own character bots in your device ecosystem.
nemomarx•16m ago
It seems harder to sell on device ai as a subscription, I would guess? although the much lower inference costs mean maybe you could just sell it as a one time purchase
DoctorOW•10m ago
Isn't the majority of AI compute training and not inference? Saying "It doesn't matter if the AI companies fold because I can run models on my computer" is like saying "I don't care if the farm closes because I get my food from the grocery store"
quxbar•7m ago
It's more like saying 'I don't care if monsanto goes under because I will save my own seeds to plant next year's crops'.
sublinear•3m ago
I think it's much more like consumer culture doesn't and never will care about any of these details.
Specifically with regard to AI, the consumers aren't even aware of the "grocery store" either. They're being served from a silver platter.
tripleee•6m ago
By on device you mean running locally on a mobile device like an iPhone? If so we're a really long way from a chatbot that's engaging to talk to. There's just not enough processing power to do it
No-one's going to want to talk to a 7B model for more than 3 minutes
toomuchtodo•24m ago
nemomarx•16m ago
DoctorOW•10m ago
quxbar•7m ago
sublinear•3m ago
Specifically with regard to AI, the consumers aren't even aware of the "grocery store" either. They're being served from a silver platter.
tripleee•6m ago
No-one's going to want to talk to a 7B model for more than 3 minutes