It works as proxy by replacing the traditional base_url with the CacheCore gateway.

Gateway is built in Rust and there are 2 levels of caching (L1 and L2). There is a automatic mechanism for dependency invalidation.

Compared to other tools: most solutions require you to change the code logic and don't have dependency invalidation.

I started testing on the Legal and Health domains where context reuse is high and query costs add up fast.