What is the minimum hardware to run 671B DeepSeek 3.1
2•roscas•5mo ago
URL for Ollama is https://ollama.com/library/deepseek-v3.1/tags
So has anyone put this model to run and with what hardware?
Comments
bigyabai•5mo ago
There is no minimal hardware besides the basic requirements of being able to store/load the weights for inference.
roscas•5mo ago
Error: 500 Internal Server Error: model requires more system memory (34.1 GiB) than is available (27.2 GiB)
This is ollama run deepseek-r1:70b with size of 43gb.
32GB desktop.
magicalhippo•5mo ago
Yes, as GP said you'll need enough memory to load the weights (and KV cache).
Beyond that it's just how fast you want to go. Pure CPU will be slow, but will work. There has been a few stories and comments here[1] about people running this model.
bigyabai•5mo ago
roscas•5mo ago
This is ollama run deepseek-r1:70b with size of 43gb.
32GB desktop.
magicalhippo•5mo ago
Beyond that it's just how fast you want to go. Pure CPU will be slow, but will work. There has been a few stories and comments here[1] about people running this model.
[1]: https://hn.algolia.com/?q=671B+DeepSeek