Skip to main content
Version: latest

Installation

This guide will walk you through installing Envoy AI Gateway and its required components.

Installing Envoy AI Gateway​

The easiest way to install Envoy AI Gateway is using the Helm charts. You need to install the CRDs first, followed by the AI Gateway controller.

Step 1: Install AI Gateway CRDs​

First, install the CRD Helm chart (ai-gateway-crds-helm) which manages all Custom Resource Definitions:

helm upgrade -i aieg-crd oci://docker.io/envoyproxy/ai-gateway-crds-helm \
  --version v0.0.0-latest \
  --namespace envoy-ai-gateway-system \
  --create-namespace

Step 2: Install AI Gateway Resources​

After the CRDs are installed, install the AI Gateway Helm chart:

helm upgrade -i aieg oci://docker.io/envoyproxy/ai-gateway-helm \
  --version v0.0.0-latest \
  --namespace envoy-ai-gateway-system \
  --create-namespace

kubectl wait --timeout=2m -n envoy-ai-gateway-system deployment/ai-gateway-controller --for=condition=Available
tip

Note that you are browsing the documentation for the main branch version of Envoy AI Gateway, which is not a stable release. We highly recommend you replace v0.0.0-latest with v0.0.0-${commit hash of https://github.com/envoyproxy/ai-gateway} to pin to a specific version. Otherwise, the controller will be installed with the latest version at the time of installation, which can be unstable over time due to ongoing development (the latest container tags are overwritten).

If you are experiencing network issues with docker.io, you can install the helm charts from the code repo ai-gateway-crds-helm and ai-gateway-helm instead.

Verify Installation

Check the status of the pods. All pods should be in the Running state with Ready status.

Check AI Gateway pods:

kubectl get pods -n envoy-ai-gateway-system
Upgrading from Previous Versions

If you installed AI Gateway with only ai-gateway-helm previously, first install the CRD chart with --take-ownership to transfer CRD ownership, then upgrade the main chart:

helm upgrade -i aieg-crd oci://docker.io/envoyproxy/ai-gateway-crds-helm --version v0.0.0-latest --namespace envoy-ai-gateway-system --take-ownership
helm upgrade -i aieg oci://docker.io/envoyproxy/ai-gateway-helm --version v0.0.0-latest --namespace envoy-ai-gateway-system

Next Steps​

After completing the installation: