deploying-scalable-agents

Configure production-ready agent deployments with observability, evaluation gates, and scalable infrastructure patterns.

73.6k|24.3k|Updated Nov 28, 2024
One-click install
npx skills add https://github.com/microsoft/ai-agents-for-beginners --skill deploying-scalable-agents
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: deploying-scalable-agents
Source: https://github.com/microsoft/ai-agents-for-beginners/tree/main/.agents/skills/deploying-scalable-agents
Command: npx skills add https://github.com/microsoft/ai-agents-for-beginners --skill deploying-scalable-agents

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill addresses the gap between building a functional agent prototype and maintaining a reliable, cost-effective, and observable production service.

Core Features & Use Cases

  • Deployment Patterns: Implement client-hosted, hosted-agent, or agent-workflow architectures using Microsoft Foundry.
  • Operational Controls: Configure model routing, response caching, and human-in-the-loop approval workflows to manage cost and trust.
  • Production Readiness: Integrate OpenTelemetry for tracing and automated evaluation gates to ensure quality before deployment.

Quick Start

Use the deploying-scalable-agents skill to configure an evaluation gate and smoke test for my production agent deployment.

Frequently Asked Questions about deploying-scalable-agents

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I deploy an agent to Microsoft Foundry?▼

Deploy an agent by selecting a deployment pattern such as hosted-agent or agent-workflow, then configuring the agent with managed identity and scoped RBAC within the Foundry environment.

What is an evaluation gate in agent deployment?▼

An evaluation gate is an automated quality check that runs an agent against an offline test set, ensuring it meets a defined pass-rate threshold before it is promoted to production.

How can I optimize agent costs in production?▼

Optimize costs by right-sizing models, implementing model routing to use smaller models for simple tasks, and utilizing response caching to avoid redundant model calls.

Does this skill support local agent development?▼

No, this skill is specifically for production-grade deployments on Microsoft Foundry; for local on-device agent development, refer to the local-ai-agents resources.

How do I monitor agent performance in production?▼

Monitor performance by instrumenting the agent with OpenTelemetry tracing to capture request spans, routed model information, and customer-specific attributes for observability.