Hey there, nice one. Care to share a bit what is under the hood? What are the challenges of local AI? It is RAG-ging? What small models do you use?
jmathai•20h ago
To avoid misquoting scripture it’s using a couple techniques including tool calls for grounding and a client-side parsing layer to find and replace citations.
It currently uses deepseek flash. We’ll evaluate local models in the future.
ernsheong•22h ago
jmathai•20h ago
It currently uses deepseek flash. We’ll evaluate local models in the future.