Look at Claude code's "automemory" for example, they don't use a vector database or anything complex. Its just simple markdown files on the local filesystem along with grep for retrieval and it works great for me.
For many simpler use cases, simple techniques like context summarisation are good enough.