Show HN: MCP Gateway – Unifying Access to MCP Servers Without N×M Integrations

https://www.truefoundry.com/mcp-gateway

7•supreetgupta•48m ago

Many teams connecting LLMs to external tools eventually encounter the same architectural issue: as more tools and agents are added, the integration pattern becomes an N×M mesh of direct connections. Each agent implements its own auth, retries, rate limiting, and logging; each tool needs credentials distributed to multiple places and observability becomes fragmented.

We built LLM gateway with this goal to provide a single place to manage authentication, authorization, routing, and observability for MCP servers, with a path toward a more general agent-gateway architecture in the future.

The system includes a central MCP registry, support for OAuth2/DCR integration, Virtual MCP Servers for curated toolsets, and a playground for experimenting with tool calls.

Resources -

Architecture Blog – Covers the N×M problem, gateway motivation, design choices, auth layers, Virtual MCP Servers, and the overall model.

https://www.truefoundry.com/blog/introducing-truefoundry-mcp...

Tutorial – Step-by-step guide to writing an MCP server, adding Okta-based OAuth, and integrating it with the Gateway.

https://docs.truefoundry.com/docs/ai-gateway/mcp-server-oaut...

Feedback on gaps and edge cases is welcome.

https://www.truefoundry.com/mcp-gateway

Comments

deeptishukla22•38m ago

One of the trickiest parts of MCP in practice has been auth propagation. As soon as the agent backend invokes the MCP server instead of the client, the original user’s auth context disappears—tools that require the user's session_id (or equivalent) suddenly only see a generic token. We ended up needing a pattern for:

- M2M-issued short-lived tokens for backend → MCP calls

- Per-request user metadata injection so tool calls can still act on behalf of the user

- Consistent OAuth2 / Okta validation so both layers trust each other

Was looking for this standarization.

supreetgupta•14m ago

A bit more context: this Gateway is part of a progression from an LLM Gateway - MCP Gateway - a future Agent Gateway. The intent is to provide a consistent control plane for tool access, authentication, and policies around agent execution. MCP offers a clean interoperability layer, so the Gateway focuses on security, observability, and operational consistency rather than tool-specific logic.

There are areas still evolving (more granular budget/rate controls, extended tool composition inside Virtual MCP Servers, richer audit traces). Input from people who’ve built multi-tool agent systems or worked with MCP at scale would be especially useful.

Refer to our roadmap here - https://www.truefoundry.com/roadmap

Audio and the C++ Standard with Timur Doumler [video]

Learn Cloud Architecture Through a Tower Defense Game

Show HN: Visualize Your Thinking Patterns as a Graph

Building an AI agent that grills you on your dev tickets

Apple's AI Troubles Are Fading. Just Look at the Stock

Steam Deck lead reveals Valve is funding ARM compatibility of Windows games

2025 Q3 DDoS threat report – including Aisuru, the apex of botnets

Cloudflare WAF proactively protects against React vulnerability

AI Safety Index Winter 2025 Edition

Can AI keep particle accelerators in line?

Show HN: ApiRealTest Beta – Test APIs Through Real User Scenarios

Ams NanEyeC Integrated Camera Module CMOS Image Sensors

Google Cloud's Managed Cross-Cloud Network with AWS

Claude for Nonprofits \ Anthropic

What is Bending Spoons? Everything to know about Eventbrite's acquirer

JWST Discovers a Milky Way-Like Spiral Galaxy Where It Shouldn't Exist

How to measure the accuracy of forecasts (2016)

Show HN: Elements as Linear Combinations

Show HN: Synthome – TypeScript SDK for building composable AI media pipelines

Neo-Luddism

Higher Education and AI: Some Musings

Trump calls Somali immigrants 'garbage' as US reportedly targets Minnesota

Vulkan SDK now ships with SDL3

Flint Artifacts and Roman Altar Fragment Found Beneath Houses of Parliament

Zillow Removes Climate Risk Scores

Curlie web directory download – 2.9M editor approved websites for your AI

Django 6.0 Released

AI infrastructure is being built on a mountain of new DEBT

Extending yeast lifespan boosts biosynthetic output of valuable compounds

Show HN: Aim-Style Instant Messaging in VSCode