- Cloud Integration: Connect to OpenAI, Anthropic, Mistral, Groq, and others

- Privacy First: Everything runs locally when you want it to

All of them, or this one specifically? I've developed a bunch of tiny apps for my own usage (on Linux) with Tauri (maybe largest is just 5-6K LoC) and always felt snappy to me, mostly doing all the data processing with Rust then the UI part with ClojureScript+Reagent.

I stumbled upon Jan.ai a couple of months ago when I was considering a similar app approach. I was curious because Jan.ai went way beyond what I considered to be limitations.

I haven’t tried Jan.ai yet, I see it as an implementation not a solution.

I met the team late last year. They’re based out of Singapore and Vietnam. They ghosted me after promising to have two follow-up meetings, and were unresponsive to any emails, like they just dropped dead.

Principles and manifestos are a dime a dozen. It matters if you live by them or just have them as PR pieces. These folks are the latter.

… which seems particularly strange considering the size of the cloned GitHub repository to be 1.8GiB which swells up to 4.8GiB after running «make build» – I tried to build it locally (which failed anyway).

It is startling that a relatively simple UI frontend can add 3Gb+ of build artefacts alone – that is the scale of a Linux kernel build.

I first used Jan some time ago and didn’t really like it but it has improved a lot so I encourage everyone to try it, it’s a great project

Can't make it work with ollama endpoint

this seems to be the problem but they're not focusing on it: https://github.com/menloresearch/jan/issues/5474#issuecommen...

I captured loopback and noticed Ollama returning an HTTP 403 forbidden message to Jan.

The solution was set environment variables:

    OLLAMA_HOST=0.0.0.0
    OLLAMA_ORIGINS=*

- Jan > Settings > Model Providers

- Add new provider called "Ollama"

- Set API key to "ollama" and point to http://localhost:11434/v1

- Ensure variables above are set

- Click "Refresh" and the models should load

Note: Even though an API key is not required for local Ollama, Jan apparently doesn't consider it a valid endpoint unless a key is provided. I set mine to "ollama" and then it allowed me to start a chat.