This is an interesting layer. And how does it handle the ever growing context? Do you run embeddings or what?

The license is a mess. Starts with "GNU AFFERO GENERAL PUBLIC LICENSE" then goes into "then distribute that combined work under the terms of your choice" and then adds a non commercial clause "does not grant to you, the right to Sell the Software" ("including without limitation fees for hosting or consulting/support services").

Just chuck a nc on there and be done with it, no point in going 3 ways into a license just to confuse matters.

So is it an improved RAG, where RAG information is analyzed and compressed before being introduced in the LLM?

If so, the context window is still a problem, no?