aigw-contrib-architecture

Clarify Envoy AI Gateway architecture and two-level ExtProc flow.

3|Updated Mar 8, 2026
One-click install
npx skills add https://github.com/missBerg/envoy-skills --skill aigw-contrib-architecture
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: aigw-contrib-architecture
Source: https://github.com/missBerg/envoy-skills/tree/main/ai-gateway/contributors/skills/aigw-contrib-architecture
Command: npx skills add https://github.com/missBerg/envoy-skills --skill aigw-contrib-architecture

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Clarifies Envoy AI Gateway architecture and two-level ExtProc flow.

Core Features & Use Cases

  • Two-level ExtProc design (Router ExtProc before routing, Upstream ExtProc after routing) enables model-based routing and seamless schema translation.
  • File-based control-to-data-plane communication (controller writes YAML to a Secret, ExtProc watches the file) supports reproducible testing and local development.
  • CRDs and reconcilers map AI backends, routes, and policies to Envoy Gateway configurations, enabling end-to-end AI traffic management.

Quick Start

Review the architecture diagram and CRD layout to start tracing data and control flow.

Frequently Asked Questions about aigw-contrib-architecture

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How does the Envoy AI Gateway architecture handle routing and schema translation?▼

The Envoy AI Gateway architecture uses a two-level ExtProc design: a Router ExtProc before routing for model-based selection, and an Upstream ExtProc after routing for seamless schema translation.

How do controllers communicate with ExtProc sidecars in the AI Gateway data plane?▼

Controllers communicate with ExtProc sidecars using a file-based approach where the controller writes YAML configurations to a Secret, and the ExtProc watches this file to enable reproducible testing and local development.

How do CRDs map AI backends and routes to Envoy Gateway configurations?▼

Custom Resource Definitions and reconcilers map AI backends, routes, and policies directly to Envoy Gateway configurations, enabling end-to-end AI traffic management across the data plane.

What is the two-level ExtProc flow in Envoy AI Gateway deployments?▼

The two-level ExtProc flow consists of a Router ExtProc that executes before routing to enable model-based routing, and an Upstream ExtProc that executes after routing to handle schema translation.

Do I need to understand CRDs and reconcilers to navigate the envoyproxy/ai-gateway repository?▼

Yes, understanding the CRD layout, reconcilers, and key design types is required to effectively trace data and control flow within the envoyproxy/ai-gateway repository structure.

Can I use file-based control-to-data-plane communication for local AI Gateway development?▼

Yes, the AI Gateway supports file-based control-to-data-plane communication where controllers write YAML to a Secret and ExtProc watches the file, specifically enabling reproducible testing and local development.