Skip to main content
Version: 0.3

Getting Started with Envoy AI Gateway

Welcome to the Envoy AI Gateway getting started guide!

This guide will walk you through setting up and using Envoy AI Gateway, a tool for managing GenAI traffic using Envoy.

Guide Structure​

This getting started guide is organized into several sections:

  1. Prerequisites

    • Setting up your Kubernetes cluster
    • Installing required tools
    • Setting up Envoy Gateway

  2. Installation

    • Installing Envoy AI Gateway
    • Configuring the gateway
    • Verifying the installation

  3. Basic Usage

    • Deploying a basic configuration
    • Making your first request
    • Understanding the response format

  4. Connect Providers

    • Setting up OpenAI integration
    • Configuring AWS Bedrock
    • Managing credentials securely

Need Help?​

If you run into any issues: