databricks-platform-operations

Operate Databricks platforms with runbooks for workspaces, onboarding, Terraform, and Unity Catalog.

Updated Dec 13, 2024
One-click install
npx skills add https://github.com/neo-picasso-2112/dotfiles --skill databricks-platform-operations
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: databricks-platform-operations
Source: https://github.com/neo-picasso-2112/dotfiles/tree/main/.claude/backup/.claude/skills/databricks-platform-operations
Command: npx skills add https://github.com/neo-picasso-2112/dotfiles --skill databricks-platform-operations

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Databricks platform operations can be complex and error-prone without a centralized, repeatable runbook and governance patterns.

Core Features & Use Cases

  • Complete runbooks for adding workspaces, onboarding business units, and safely modifying shared modules
  • Terraform patterns for remote state, module-vs-stack decisions, and semantic versioning
  • Unity Catalog design guidance (centralized metastore, catalog-per-BU-per-environment) and 3-dimensional RBAC to enforce governance

Quick Start

Follow the complete operational runbooks to deploy a new workspace or onboard a business unit using the defined 5-layer deployment pattern.

Frequently Asked Questions about databricks-platform-operations

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I structure Unity Catalog for multi-environment Databricks governance?▼

Structure Unity Catalog using a centralized metastore with a catalog-per-business-unit-per-environment approach. This design enforces governance boundaries and isolates data access across different deployment tiers.

What is the best way to manage Terraform state for Databricks workspace deployments?▼

Manage Terraform state for Databricks workspaces using remote state patterns. Define module-versus-stack decisions and apply semantic versioning to safely modify shared infrastructure modules.

How do I onboard a new business unit to a Databricks platform?▼

Onboard a new business unit by following a structured runbook within a 5-layer deployment model. This process governs the safe addition of workspaces, business units, and shared module modifications.

How does 3D RBAC work for Databricks platform operations?▼

3D RBAC enforces Databricks governance workflows by managing permissions across multiple operational dimensions. It integrates with Unity Catalog to restrict access based on business unit and environment contexts.

Can I use Terraform stacks instead of modules for Databricks workspace provisioning?▼

Yes, operational guidance covers Terraform module-versus-stack decisions for Databricks workspace provisioning. Choose modules for isolated resources or stacks for grouped deployments using semantic versioning controls.

What are the limitations of modifying shared Databricks modules without a runbook?▼

Modifying shared Databricks modules without a runbook risks breaking existing architecture decisions and state management workflows. Use documented patterns and semantic versioning to prevent errors.