Anyone compare to ollama? I had good success with latest ollama with ROCm 7.4 on 9070 XT a few days ago
iugtmkbdfil834•6m ago
Seconded. Currently on ollama for local inference, but I am curious how it compares.
9dc•6m ago
so... what does it do? i dont get it Lol
syntaxing•6m ago
Wow this is super interesting. This is more or less a generative AI aggregator where it installs multiple services for different gen modes. I’m excited to try this out on my strix halo. The biggest issue I had is image and audio gen so this seems like a great option.
nijave•10m ago
iugtmkbdfil834•6m ago