databricks-model-serving

Manage Databricks Model Serving endpoints, traffic routing, and AI Gateway operations.

4|1|Updated May 22, 2026
One-click install
npx skills add https://github.com/ThomazRossito/ai-data-agents --skill databricks-model-serving-thomazrossito
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-model-serving
Source: https://github.com/ThomazRossito/ai-data-agents/tree/main/plugins/ai-data-agents/skills/databricks-model-serving
Command: npx skills add https://github.com/ThomazRossito/ai-data-agents --skill databricks-model-serving-thomazrossito

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Operating Databricks Model Serving endpoints involves many error-prone details: correct CLI syntax, readiness states, traffic routing for zero-downtime version swaps, and AI Gateway configuration. This Skill provides the exact commands, JSON payloads, and gotchas needed to manage the full endpoint lifecycle without guessing. ## Core Features & Use Cases - Endpoint Lifecycle Management: Create, query, update, and delete serving endpoints via the Databricks CLI or the MLflow Deployments Python client, with correct readiness polling on both state.ready and state.config_update. - Traffic Routing & Version Swaps: Configure A/B and canary deployments with traffic percentages, and perform zero-downtime model version swaps by updating both the UC alias and the endpoint config. - Observability & Governance: Retrieve OpenAPI schemas, build and runtime logs, Prometheus metrics, permissions, and AI Gateway rate limits; discover Foundation Model API endpoints at runtime. - Use Case: You need to roll a production chatbot endpoint to a new Llama model version without downtime. The Skill guides you to repoint the alias, call update_endpoint with matching traffic_config, and poll both state fields until the swap completes. ## Quick Start Ask the agent to create a Databricks serving endpoint for a Foundation Model and wait until it reports READY before querying it.

Frequently Asked Questions about databricks-model-serving

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create a Databricks Model Serving endpoint?▼

Use `databricks serving-endpoints create <NAME> --json '{...}'` with served_entities referencing a Unity Catalog model and a traffic_config routing 100% to that entity. Run `databricks serving-endpoints -h` first to discover exact flags for your endpoint type.

How to do a zero-downtime model version swap on a serving endpoint?▼

Repoint the Unity Catalog alias to the new version AND call update_endpoint with the new served_entities plus a matching traffic_config. Doing only one half is the common bug; poll both state.ready and state.config_update afterward.

Why does my Databricks endpoint query return 404 or 503?▼

The endpoint is likely still provisioning. Check `state.ready` via `databricks serving-endpoints get <NAME>` and wait until it shows READY; provisioned throughput endpoints can take up to 30 minutes.

Can I stream from Databricks AI Gateway outside Databricks Apps?▼

Yes, use Vercel AI SDK v6 with createOpenAI pointed at the AI Gateway /mlflow/v1 path and a token from the Databricks SDK Config helper. The references file covers server routes, client useChat patterns, and embeddings.

How do I find available Foundation Model API endpoints in my workspace?▼

List endpoints at runtime with `databricks serving-endpoints list` and filter for names starting with `databricks-` whose served entity is in `system.ai.*`. Never hard-code model names since new models land regularly.

When should I not use this Skill for Databricks ML work?▼

This Skill is ops-focused on existing endpoints. For training, MLflow autologging, UC registration, or custom PyFunc authoring use databricks-ml-training; for evaluation use databricks-mlflow-evaluation.