Many projects and addons exists to reduce the verbosity on standard bash / git /npm etc. Commands that agents pass regularly as tools to LLMs. (eg. rtk, headroom, lean-ctx). Tool output compression does yield good token savings. Though it can lead to increased turns - effectively nullifying the per turn token savings. This is the current topology. Are we going to see a class of products and libraries that structure o/p to what models want to see?
Comments
bonigv•2h ago
Clarifying - I am not suggesting headroom and lean-ctx are only doing the tool compression. It runs elaborate subsystems towards a noble objective of saving tokens. RTK on the otherhand is focused purely on the compression. At the sametime, platforms - the providers - especially Anthropic and and Open AI have transparently absorbed many of the big ticket token saving items these tools are cleverly managing. That is a different discussion.
bonigv•2h ago