As we are lucky to have great open weight models these days, I was wondering what is the recommended way to run these models locally, while staying with open source software that doesn't track you etc?

The only tool I've really tested is Ollama, but learned recently that it is pivoting into a less open direction, I'm not so sure about using it anymore, and was interested to hear your opinions and experiences.