Skip to main content
Envoy AI Gateway

Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to GenAI services.

Built together. Built in the open.

Built together. Built in the open.

Envoy AI Gateway is the result of the community coming together to address GenAI traffic handling needs using Envoy.

v0.2 Release now available

v0.2 Release now available

The v0.2 Release of Envoy AI Gateway is now available. See the release notes for more information.

Get involved in the community

Get involved in the community

Join our community on Slack, join the conversation on GitHub, and attend our Thursday community meetings. See links in footer.

Supported LLM Providers

With the latest version of Envoy AI Gateway you can route traffic to these LLM providers out of the box. For more information and the most up-to-date provider integrations, check out our provider documentation.

OpenAI logo
OpenAI
AWS Bedrock logo
AWS Bedrock
Azure OpenAI logo
Azure OpenAI
Google Gemini logo
Google Gemini
Groq logo
Groq
Mistral logo
Mistral
Cohere logo
Cohere
Together AI logo
Together AI
DeepInfra logo
DeepInfra
DeepSeek logo
DeepSeek
Hunyuan logo
Hunyuan
SambaNova logo
SambaNova
Grok logo
Grok
Vertex AI logo
Vertex AI
Coming Soon