Ask HN: Why use Ollama for Containerized on-prem PROD use?
2•dcreater•9h ago
I see ollama being used for production applications via a containerized on-prem deployment. Why would ollama be a good solution instead of straight llama.cpp or something more industrial grade like vLLM? I see Ollama's use case as individuals running stuff on laptop/home setups.