Folks are concerned that nvidia won't support these efforts if it gets models running on competing hardware. Two responses:
- The projects started without HF/nvidia involvement and were massively successful BECAUSE folks want to run models on their own devices.
- With highly capable agents, "hard to implement" should be less of a barrier. The inference market should in some sense become more efficient, as agents should make it easier to transition between software and hardware solutions. Sure there might be less training data for integration platforms, but if we've learned anything in the past few weeks, it's that agents can be remarkably persistent.
cyanydeez•9m ago
While true, enshittification should be mourned every time it's renewed until some real kind of block (regulatory changes to the industry) exists.
This is like a company buying your local public pool, and you trying to convince everyone that things won't slowly turn to crap.
qrtas•22m ago
Translation: Gervanov's ggml.ai was acquired by Huggingface in Feb 2026, so he is now "excited about the journey" after the Huggingface acquisition by Nvidia.
Can we take this as an official statement that Nvidia supports local models?
Why would Nvidia increase GPU efficiency for local models? Surely they'll operate like athletes and only establish a new record from time to time when necessary.
credit_guy•1m ago
Why would they not? The cost to do that is 0.000001% of whatever numbers they usually work with. The upside is that it creates a community of hobbyists, most of whom will us (consummer grade) Nvidia GPUs. Which are not a significant source of revenue for Nvidia anymore, but it’s nice to have a bit of insurance.
spindump8930•25m ago
- The projects started without HF/nvidia involvement and were massively successful BECAUSE folks want to run models on their own devices.
- With highly capable agents, "hard to implement" should be less of a barrier. The inference market should in some sense become more efficient, as agents should make it easier to transition between software and hardware solutions. Sure there might be less training data for integration platforms, but if we've learned anything in the past few weeks, it's that agents can be remarkably persistent.
cyanydeez•9m ago
This is like a company buying your local public pool, and you trying to convince everyone that things won't slowly turn to crap.