Overview

Plano is delivery infrastructure for agentic apps. A models-native proxy server and data plane designed to help you build agents faster, and deliver them reliably to production.

Plano pulls out the rote plumbing work (the “hidden AI middleware”) and decouples you from brittle, ever‑changing framework abstractions. It centralizes what shouldn’t be bespoke in every codebase like agent routing and orchestration, rich agentic signals and traces for continuous improvement, guardrail filters for safety and moderation, and smart LLM routing APIs for UX and DX agility. Use any language or AI framework, and ship agents to production faster with Plano.

Built by core contributors to the widely adopted Envoy Proxy, Plano gives you a production‑grade foundation for agentic applications. It helps developers stay focused on the core logic of their agents, helps product teams shorten feedback loops for learning, and helps engineering teams standardize policy and safety across agents and LLMs. Plano is grounded in open protocols (de facto: OpenAI‑style v1/responses, de jure: MCP) and proven patterns like sidecar deployments, so it plugs in cleanly while remaining robust, scalable, and flexible.

In this documentation, you’ll learn how to set up Plano quickly, trigger API calls via prompts, apply guardrails without tight coupling with application code, simplify model and provider integration, and improve observability — so that you can focus on what matters most: the core product logic of your agents.

../_images/plano_network_diagram_high_level.png

High-level network flow of where Plano sits in your agentic stack. Designed for both ingress and egress traffic.

Get Started

This section introduces you to Plano and helps you get set up quickly:

Overview

Overview of Plano and Doc navigation

overview.html
Intro to Plano

Explore Plano’s features and developer workflow

intro_to_plano.html
Quickstart

Learn how to quickly set up and integrate

quickstart.html

Concepts

Deep dive into essential ideas and mechanisms behind Plano:

Agents

Learn about how to build and scale agents with Plano

../concepts/agents.html
Model Providers

Explore Plano’s LLM integration options

../concepts/llm_providers/llm_providers.html
Prompt Target

Understand how Plano handles prompts

../concepts/prompt_target.html

Guides

Step-by-step tutorials for practical Plano use cases and scenarios:

Guardrails

Instructions on securing and validating prompts

../guides/prompt_guard.html
LLM Routing

A guide to effective model selection strategies

../guides/llm_router.html
State Management

Learn to manage conversation and application state

../guides/state.html

Build with Plano

End to end examples demonstrating how to build agentic applications using Plano:

Build Agentic Apps

Discover how to create and manage custom agents within Plano

../get_started/quickstart.html#build-agentic-apps-with-plano
Build Multi-LLM Apps

Learn how to route LLM calls through Plano for enhanced control and observability

../get_started/quickstart.html#use-plano-as-a-model-proxy-gateway