About 9 months ago, I created a simple program to facilitate structured dialogues among local LLMs from the terminal. I’ve been iterating on it since. It now has an app UI, supports both local models and cloud models, and has a shared memory system. Today it requires API keys for cloud models and has no tool use. I’m working to support pre-existing cloud subscriptions and tools-use. If I publish it, would you pay for it? If so, how much and in what form (e.g. one-time purchase, subscription, per-use)? If not, what would you want to see before adopting it?

It’s been a lot of fun to develop and use. I’d love to see others benefit and hear feedback.

If you’re already using a system like this, what are you using?