For anyone doing local (or not) RAG: I built Xtriever, the retrieval half of the problem, designed to run on the device with no server.

Usable from Rust, Python, Swift and Kotlin. There are demo apps for iOS and Android and a Python CLI.

It’s not production ready yet so for now build from source only.

Android is measured only on the emulator, and there's no learned ranker yet.

This thing is purely vibecoded.