So I built a CLI tool and a Python SDK to make it easy to connect your Wandb projects and runs to your agent (clawed or otherwise). The cli tool works by allowing you to import your wandb projects and structures your runs in a way that makes it easy for agents to get a sense of the solution space of your research project.
When projects are imported, only the configs and metrics are analyzed to index and store your runs. When an agent samples from this index, only the most high performing experiments are returned which reduces context rot. You can also change the behavior of the index and your agent to trade-off exploration with exploitation.
Open sourcing the cli along with the python sdk to make it easy to use it with any agent. Would love feedback and critique from the community!
Github: https://github.com/mylucaai/cadenza Docs: https://myluca.ai/docs Pypi: https://pypi.org/project/cadenza-cli