If you want to use local models, it's more ergonomic than fussing with GGUFs or using LM Studio as a server host and setting up the link to an agent yourself. Although, the model selector is the same as with LM Studio itself which can be overwhelming if you don't know what to look for.

Built to work with lmstudio, one of the leading easy to use local model servers. LMStudio is the closest to plug-and-play without sacrificing play that I've seen; a harness that works well with it is nothing to sniff at. Its not earth shattering either.

And? Is that a scandal?

i agree.

i believe that for most people on the street, for most tasks, a Chat GPT 3.5 era LLM is sufficient enough. sprinkle in tool calling and other things, and that becomes enough. if you can prioritize that level of a model on-device (baking it in etc), then you can bifurcate AI users between those unwilling to pay and those who are willing to pay A LOT for frontier model performance.