Vendors

Alibaba Group is a Chinese multinational technology company whose open-source arm maintains Higress, a cloud-native AI and API gateway. Higress is built on Istio and Envoy with two years of production experience inside Alibaba.

Archestra is an open-source, enterprise-grade platform that lets non-technical users run AI agents and MCP servers safely. It provides deterministic guardrails against prompt-injection risks, a private MCP registry with governance, Kubernetes-native orchestration, cost monitoring, and OpenTelemetry observability.

BerriAI is the Y Combinator-backed company behind LiteLLM, an LLM gateway that gives platform teams a unified OpenAI-format API over 100+ language models with cost tracking, budgets, rate limits, and automatic fallbacks. Customers cited on the site include Netflix and Lemonade.

Danny Avila is the creator and maintainer of LibreChat, an open-source ChatGPT clone that supports agents, MCP, and models from Anthropic, AWS, OpenAI, Azure, Groq, Mistral, OpenRouter, Vertex AI, Gemini, and others. The project is funded through GitHub Sponsors.

The Envoy Project is a CNCF-graduated open-source community maintaining Envoy Proxy and Envoy AI Gateway. The AI Gateway uses Envoy Gateway to handle traffic between application clients and generative AI services, routing across Anthropic, AWS Bedrock, Azure OpenAI, Cohere, DeepSeek, Google Gemini, Mistral, OpenAI, and more, with Model Context Protocol support and OAuth authentication. Adopters include Bloomberg, Tencent Cloud, Nutanix, LY Corporation, and Tetrate.

Helicone is an open-source AI gateway and LLM observability platform used by AI companies to route, debug, and analyze their applications. It covers OpenAI, Anthropic, Google Gemini, DeepSeek, Together AI, Mistral, Groq, and OpenRouter, and is self-hostable via Docker Compose.

Kong Inc. is the company behind the Kong open-source API gateway and its commercial products, including Kong AI Gateway, Kong API Gateway, Kong Event Gateway, Kong Konnect (SaaS), Kong Insomnia, and Kong Agent Gateway. The NGINX-based engine handles 50K+ transactions per second per node.

LangDB builds an enterprise AI gateway written in Rust, with unified access to 250+ LLM models and real-time observability for AI agents. The platform supports LangChain, Google ADK, OpenAI, and other major frameworks.

Langfuse is an open-source LLM engineering platform for debugging, analyzing, and iterating on LLM applications. The platform is used by 19 of the Fortune 50 and 63 of the Fortune 500 and covers tracing, prompt management, evaluations, and datasets via SDK instrumentation or gateway integration.

LangGenius is the company behind Dify, an open-source platform for building agentic workflows, RAG pipelines, and LLM applications. Notable users include Volvo Cars and Ricoh.

The Linux Foundation hosts Agent Gateway, an open-source proxy built on AI-native protocols (Model Context Protocol and Agent-to-Agent) for connecting and securing agent-to-LLM, agent-to-tool, and agent-to-agent communication. The project was originally donated by Solo.io and receives contributions from Microsoft, Apple, Alibaba, Adobe, AWS, Cisco, Salesforce, Huawei, and Amdocs.

Maxim AI builds Bifrost, an open-source enterprise AI gateway (Apache 2.0) written in Go. Bifrost is a drop-in replacement for OpenAI, Anthropic, Vercel AI SDK, LangChain, and LiteLLM SDKs, with built-in MCP gateway, guardrails, budgets, SSO, audit logs, and OpenTelemetry support.

MCPJungle is an open-source gateway and registry for Model Context Protocol servers. It validates registered MCP endpoints, supports HTTP and stdio transports, and persists backend resources via the v0 API. The project is maintained by utafrali and duaraghav8 under MPL-2.0.

MetaMCP is an open-source management platform for MCP (Model Context Protocol) servers. It lets users install, configure, and proxy multiple MCP servers from a single GUI and exposes them to any compatible MCP client, including Claude Desktop, Cursor, Cline, and Windsurf.

Open WebUI is a self-hosted AI interface that connects to Ollama, OpenAI, Anthropic, and any OpenAI-compatible model, either locally or in the cloud. The project is community-maintained and ships with a plugin system for prompts, tools, and Python function pipelines.

Portkey (Portkey, Inc.) is a control panel for production AI that helps teams observe, govern, and optimize LLM applications across an organization. The platform includes an AI gateway, observability, guardrails, prompt engineering studio, agents runtime, MCP gateway, and enterprise security controls. The company is based in San Francisco.

QuantumNous is the GitHub organization behind new-api, an open-source next-generation LLM gateway and AI asset management system. The project is a derivative of One API, adding support for image generation, multi-model routing, and additional channel types.

songquanpeng is the solo maintainer of One API, an open-source LLM API management and key redistribution system that unifies 20+ providers under a single OpenAI-compatible API. The project is MIT-licensed with official Docker images.

TensorZero builds an open-source LLMOps platform that unifies an LLM gateway, observability, evaluations, optimization, and experimentation behind a single API. The company is based in New York.

Traefik Labs is the company behind Traefik, an open-source application proxy used for API gateway and API management in cloud-native environments. It serves DevOps and platform engineering teams at enterprises including NASA, Siemens, eBay, and Expedia.

Zitadel AG is a Swiss company building ZITADEL, an open-source identity infrastructure platform that combines authentication, authorization, and multi-tenant B2B user management behind gRPC and REST APIs. Deployment options include a hosted cloud service and self-hosted installs.