AI workloads are evolving fast, and Envoy AI Gateway’s integration of the Model Context Protocol (MCP) is a major leap for organizations leveraging modern, production-scale AI systems.
Jointly developed by Bloomberg, Tetrate, and other industry leaders, this integration leverages the trusted Envoy Proxy data plane to provide secure, policy-driven, and observable connections for AI agents accessing diverse tools and external data.
Why MCP Changes the Game for AI Gateways
The Model Context Protocol is rapidly emerging as the foundational standard for enabling AI agents to interact with external resources and context providers. As enterprises shift toward dynamic, agent-based AI architectures, the need for consistent security, governance, and visibility is more pressing than ever. By weaving MCP directly into its architecture, Envoy AI Gateway empowers organizations to:
- Enable seamless interoperability: connect AI agents with cloud-based language models, enterprise services, and third-party tools effortlessly.
- Enforce robust security and governance: apply granular authentication and authorization to every transaction and data request.
- Accelerate development: support agent workflows natively on existing Envoy infrastructure, reducing the need for custom integration code.
MCP Implementation Highlights
The initial rollout of MCP in Envoy AI Gateway is built for reliability, security, and adherence to the latest protocol specification. Noteworthy features include:
- Streamable HTTP transport: stateful sessions and multi-part JSON-RPC messaging over persistent HTTP, aligning with the June 2025 MCP standard.
- OAuth authorization: native OAuth support ensures secure tool access and compatibility with existing authorization protocols.
- Advanced routing and filtering: the gateway intelligently routes calls, aggregates tools based on policy, and merges streams for unified agent access.
- Secure upstream authentication: credential injection and validation use familiar Envoy patterns for trusted connections to MCP servers.
- Comprehensive protocol coverage: all core MCP features are implemented: tool calls, notifications, prompts, resources, and robust session management with reconnection.
- Developer-friendly experience: features work out-of-the-box in standalone mode and scale seamlessly in Kubernetes environments.
- Real-world validation: thorough testing with providers like GitHub and agents such as Goose ensures ecosystem compatibility.
Design Philosophy and Technical Approach
The team prioritized efficiency and extensibility in their approach. Rather than adding complexity, the MCP Proxy acts as a lightweight Go server, multiplexing streams and bridging JSON-RPC with Envoy’s extension mechanisms. Core design principles include:
- Minimal architectural overhead with no unnecessary components are introduced.
- Optimized for Envoy’s strengths include connection management, load balancing, and observability are handled natively.
- Decoupled iteration since the MCP Proxy can rapidly adapt to protocol changes while relying on Envoy for core networking.
Quick Start: Harnessing MCP in Your Environment
Adopting MCP is straightforward. Developers can launch Envoy AI Gateway locally in standalone mode, simply specifying MCP servers like GitHub or Context7. Agents such as Claude or Goose can connect directly to the gateway, unlocking all MCP features without extra setup.
For advanced deployments, the MCPRoute API enables detailed routing, tool filtering, and authentication management. This API supports both local and Kubernetes environments, allowing for OAuth, selective tool exposure, and secure upstream connections. Once configured locally, settings can be promoted directly to production clusters for a seamless transition.
Looking Ahead
This milestone is only the beginning for MCP support in Envoy AI Gateway. As agent-based AI architectures advance, the Envoy team is committed to expanding protocol support, adding features, and maintaining a reliable, policy-driven gateway. Community input is welcomed to guide the roadmap, and collaboration opportunities abound for organizations ready to shape the future of AI connectivity.
Envoy AI Gateway Ushers in a New Era with MCP Integration