Built together. Built in the open.
Envoy AI Gateway is the result of the community coming together to address GenAI traffic handling needs using Envoy.
v0.3 Release now available
The v0.3 Release of Envoy AI Gateway is now available. See the release notes for more information.
Get involved in the community
Join our community on Slack, join the conversation on GitHub, and attend our Thursday community meetings. See links in footer.
Supported LLM Providers
With the latest version of Envoy AI Gateway you can route traffic to these LLM providers, displayed alphabetically, out of the box.
For more information and the most up-to-date provider integrations, check out our provider documentation.
Anthropic
AWS Bedrock
Azure OpenAI
Cohere
DeepInfra
DeepSeek
Google Gemini
Grok
Groq
Hunyuan
Mistral
OpenAI
SambaNova
Tetrate Agent Router Service
Together AI
Vertex AI