Show HN: GoModel – an open-source AI gateway in Go; 44x lighter than LiteLLM

47•santiago-pl•2h ago

Hi, I’m Jakub, a solo founder based in Warsaw.

I’ve been building GoModel since December with a couple of contributors. It's an open-source AI gateway that sits between your app and model providers like OpenAI, Anthropic or others.

I built it for my startup to solve a few problems:

  - track AI usage and cost per client or team
  - switch models without changing app code
  - debug request flows more easily
  - reduce AI spendings with exact and semantic caching

How is it different?

  - ~17MB docker image
    - LiteLLM's image is more than 44x bigger ("docker.litellm.ai/berriai/litellm:latest" ~ 746 MB on amd64)
  - request workflow is visible and easy to inspect    
  - config is environment-variable-first by default

I'm posting now partly because of the recent LiteLLM supply-chain attack. Their team handled it impressively well, but some people are looking at alternatives anyway, and GoModel is one.

Website: https://gomodel.enterpilot.io

Any feedback is appreciated.

Comments

anilgulecha•1h ago

how does this compare to bifrost - another golang router?

santiago-pl•1h ago

First of all, GoModel doesn't have a separate private repository behind a paywall/license.

It's more lightweight and simpler. The Bifrost docker image looks 4x larger, at least for now.

IMO GoModel is more convenient for debugging and for seeing how your request flows through different layers of AI Gateways in the Audit Logs.

anilgulecha•58m ago

That would be valuable if there's a commitment to never have a non-opensource offering under GoModel? If so, you can document it in the repo.

santiago-pl•54m ago

I would love to keep it open source forever, but I can't promise that for now. I've written a whole doc page about it if you're curious: https://gomodel.enterpilot.io/docs/about/license

Talderigi•1h ago

Curious how the semantic caching layer works.. are you embedding requests on the gateway side and doing a vector similarity lookup before proxying? And if so, how do you handle cache invalidation when the underlying model changes or gets updated?

giorgi_pro•48m ago

Hey, contributor here. That's right, GoModel embeds requests and does vector similarity lookup before proxying. Regarding the cache invalidation, there is no "purging" involved – the model is part of the namespace (params_hash includes the LLM model, path, guardrails hash, etc). TTL takes care of the cleanup later.

pjmlp•1h ago

Expectable, given that LiteLLM seems to be implemented in Python.

However kudos for the project, we need more alternatives in compiled languages.

santiago-pl•57m ago

Agree and thank you! Please let us know if you'd like to give it a try and if you miss any feature in GoModel.

tahosin•40m ago

This is really useful. I've been building an AI platform (HOCKS AI) where I route different tasks to different providers — free OpenRouter models for chat/code gen, Gemini for vision tasks. The biggest pain point has been exactly what you describe: switching models without changing app code.

One thing I'd love to see is built-in cost tracking per model/route. When you're mixing free and paid models, knowing exactly where your spend goes is critical. Do you have plans for that in the dashboard?

santiago-pl•30m ago

This comment looks like AI-generated.

However IIUC what you're asking for - it's already in the dashboard! Check the Usage page.

indigodaddy•28m ago

Any plans for AI provider subscription compatibility? Eg ChatGPT, GH Copilot etc ? (Ala opencode)

santiago-pl•3m ago

You are not the first person who has asked about it.

It looks like a useful feature to have. Therefore, I'll dig into this topic more broadly over the next few days and let you know here whether, and possibly when, we plan to add it.

rvz•17m ago

I don't see any significant advantage over mature routers like Bifrost.

Are there even any benchmarks?

Original GrapheneOS responses to WIRED fact checker

Laws of Software Engineering

As Oceans Warm, Great White Sharks Are Overheating

Tim Cook's Impeccable Timing

Fusion Power Plant Simulator

John Ternus to become Apple CEO

Show HN: GoModel – an open-source AI gateway in Go; 44x lighter than LiteLLM

Show HN: VidStudio, a browser based video editor that doesn't upload your files

Running a Minecraft Server and More on a 1960s Univac Computer

A type-safe, realtime collaborative Graph Database in a CRDT

Tindie store under "scheduled maintenance" for days

Clojure: Transducers

Your favorite brands got worse on purpose

MNT Reform is an open hardware laptop, designed and assembled in Germany

Anthropic says OpenClaw-style Claude CLI usage is allowed again

Anthropic takes $5B from Amazon and pledges $100B in cloud spending in return

Leonardo, Borgia, and Machiavelli: A Fateful Collusion

Slava's Monoid Zoo

Kasane: New drop-in Kakoune front end with GPU rendering and WASM Plugins

Salmon exposed to cocaine and its main byproduct roam more widely

A Roblox cheat and one AI tool brought down Vercel's platform

The Beauty of Bonsai Styles

Less human AI agents, please

Colorado River disappeared record for 5M years: now we know where it was

High-Fidelity KV Cache Summarization Using Entropy and Low-Rank Reconstruction

Apple ignores DMA interoperability requests and contradicts own documentation

Louis Zocchi, games industry pioneer, has died

Qwen3.6-Max-Preview: Smarter, Sharper, Still Evolving

How to make a fast dynamic language interpreter

Vera C. Rubin Observatory has Discovered 11,000 New Asteroids

Show HN: GoModel – an open-source AI gateway in Go; 44x lighter than LiteLLM

Comments

Original GrapheneOS responses to WIRED fact checker

Laws of Software Engineering

As Oceans Warm, Great White Sharks Are Overheating

Tim Cook's Impeccable Timing

Fusion Power Plant Simulator

John Ternus to become Apple CEO

Show HN: GoModel – an open-source AI gateway in Go; 44x lighter than LiteLLM

Show HN: VidStudio, a browser based video editor that doesn't upload your files

Running a Minecraft Server and More on a 1960s Univac Computer

A type-safe, realtime collaborative Graph Database in a CRDT

Tindie store under "scheduled maintenance" for days

Clojure: Transducers

Your favorite brands got worse on purpose

MNT Reform is an open hardware laptop, designed and assembled in Germany

Anthropic says OpenClaw-style Claude CLI usage is allowed again

Anthropic takes $5B from Amazon and pledges $100B in cloud spending in return

Leonardo, Borgia, and Machiavelli: A Fateful Collusion

Slava's Monoid Zoo

Kasane: New drop-in Kakoune front end with GPU rendering and WASM Plugins

Salmon exposed to cocaine and its main byproduct roam more widely

A Roblox cheat and one AI tool brought down Vercel's platform

The Beauty of Bonsai Styles

Less human AI agents, please

Colorado River disappeared record for 5M years: now we know where it was

High-Fidelity KV Cache Summarization Using Entropy and Low-Rank Reconstruction

Apple ignores DMA interoperability requests and contradicts own documentation

Louis Zocchi, games industry pioneer, has died

Qwen3.6-Max-Preview: Smarter, Sharper, Still Evolving

How to make a fast dynamic language interpreter

Vera C. Rubin Observatory has Discovered 11,000 New Asteroids