Clem, cofounder and ceo of Hugging Face here.
Wanted to share our new collaboration with Google Cloud. Every day, over 1,500 terabytes of open models and datasets are downloaded and uploaded between Hugging Face and Google cloud by millions of AI builders. We suspect it generates over a billion dollars of cloud spend annually already.
So we’re excited to announce today a new partnership to:
- reduce Hugging Face model & dataset upload and download times through Vertex AI and Google Kubernetes Engine thanks to a new gateway for Hugging Face repositories that will cache directly on Google Cloud
- offer native support for TPUs on all open models sourced through Hugging Face
- provide a safer experience through Google Cloud’s built-in security capabilities.
Ultimately, our intuition is that the majority of cloud spend will be AI related and based on open-source (rather than proprietary APIs) as all technology builders will become AI builders and we're trying to make this easier.
clmnt•2mo ago
So we’re excited to announce today a new partnership to: - reduce Hugging Face model & dataset upload and download times through Vertex AI and Google Kubernetes Engine thanks to a new gateway for Hugging Face repositories that will cache directly on Google Cloud - offer native support for TPUs on all open models sourced through Hugging Face - provide a safer experience through Google Cloud’s built-in security capabilities. Ultimately, our intuition is that the majority of cloud spend will be AI related and based on open-source (rather than proprietary APIs) as all technology builders will become AI builders and we're trying to make this easier.
Questions, comments, feedback welcome!