A lightweight HTTP proxy that translates OpenAI /v1/chat/completions requests to Ollama's native /api/chat API and back.
Ollama's OpenAI-compatible endpoint (/v1/chat/completions) has serious runtime configuration limitations.
Without custom model files, parameters such as context size cannot be centrally controlled. Requests through the OpenAI compatibility layer may run with Ollama defaults instead of the desired runtime settings.
This proxy uses Ollama's native /api/chat endpoint directly, where runtime parameters are explicitly supported.
MK2k•27m ago
Ollama's OpenAI-compatible endpoint (/v1/chat/completions) has serious runtime configuration limitations.
Without custom model files, parameters such as context size cannot be centrally controlled. Requests through the OpenAI compatibility layer may run with Ollama defaults instead of the desired runtime settings.
This proxy uses Ollama's native /api/chat endpoint directly, where runtime parameters are explicitly supported.
One .env file configures all models centrally.