And what use is similar query caching - so you (very often! if actually cost effective, maybe half the time) get a response to a query that was different from yours. Including for when you have a lot of context input already. You’re going to get trash.

This might only work in constrained domains like customer service where there’s tolerance for generic answers. For technical work?