Existing agentic LLM frameworks didn't quite give me the mix of parallelization, modularity and control I wanted, so I decided to write my own. The structure I came up with is good for having many small LLM runners and more deterministic components interact with one another in a deliberate, resource-managed way using concurrency groups.
I ended up adding a lot of docstrings in case I have to step away from my hobbies and dust this code off at a later point, but maybe the framework can be useful for someone else in the meantime? I've added demos and put it up under the MIT license should you wish to try it out.
I apologize in advance if the framework is difficult to get running - my testing options are limited. The GUI works, but is basically vibecoded because I don't know React, so forgive me if that component is particularly temperamental. Ideally, I would like to continue servicing this code and improving my own skills, so any comments on this project - both positive and excoriating- are greatly appreciated.
dibrale•2h ago
I ended up adding a lot of docstrings in case I have to step away from my hobbies and dust this code off at a later point, but maybe the framework can be useful for someone else in the meantime? I've added demos and put it up under the MIT license should you wish to try it out.
I apologize in advance if the framework is difficult to get running - my testing options are limited. The GUI works, but is basically vibecoded because I don't know React, so forgive me if that component is particularly temperamental. Ideally, I would like to continue servicing this code and improving my own skills, so any comments on this project - both positive and excoriating- are greatly appreciated.