If you can switch LLMs internally with a unified interface, wouldn't it be more convenient to dynamically switch LLMs in the chat method rather than having to instantiate them each time? You could also have a sendMessage method in the Thread class that dynamically switches LLMs internally.
rhyizm•3h ago
That's a great idea! I implemented it with per-LLM instantiation thinking it would be a more intuitive interface, but having Thread with dynamic LLM switching methods could indeed create both an intuitive and convenient API. Thanks for the excellent feedback!
shigechiyo•4h ago
rhyizm•3h ago