Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to GenAI services.
Built together. Built in the open.
Envoy AI Gateway is the result of the community coming together to address GenAI traffic handling needs using Envoy.
Get involved in the community
Join our community on Slack, join the conversation on GitHub, and attend our Thursday community meetings. See links in footer.
Coming February 2025
The v0.1 Release of Envoy AI Gateway coming in February 2025. Including features such as Unified LLM API and LLM token usage limiting.