You can run it locally on your computer via electron app + docker compose, but you can take the same stack and run it in cloud/k8s and/or on prem as it is built with scale in mind (it also has an observability stack built in). So in that sense it is more like Ollama + Ollama Cloud :)
Currently it supports whisper, qwen asr, nemotron asr and parakeet tdt and I am adding other models. I am also adding Kserve+Triton integration for the batch transcriptions so as the MLOps can be abstracted away.
Last couple of years I have been consulting for some organizations that work with sensitive data and have to keep them in air gapped environments and based on those experiences I built and open-sourced nanosamur.ai
The easiest place to start is the main repo: https://github.com/nanosamurai/nanosamurai
It is a docker compose starter setup, there are couple of services it uses, all are linked in the documentation; I used python for the voice ai services (see the xamurai monorepo) and java / clojure / clojurescript for the UI/BFF and some other services (yes, it is pg's fault i love lisps).
Appreciate any feedback! Esp. from people working with speech infrastructure, self hosted AI etc. Also it currently sits at 6 stars, so feel free to star the repos if you like them :)