gcp-pipeline-resource-provisioning

Provision GCP pipeline resources from a deployment.yaml file.

Updated Jun 10, 2026
One-click install
npx skills add https://github.com/AubreyHan/SKILL_Repo --skill gcp-pipeline-resource-provisioning-aubreyhan
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: gcp-pipeline-resource-provisioning
Source: https://github.com/AubreyHan/SKILL_Repo/tree/main/gcp-pipeline-resource-provisioning
Command: npx skills add https://github.com/AubreyHan/SKILL_Repo --skill gcp-pipeline-resource-provisioning-aubreyhan

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill removes the manual overhead of provisioning environment-specific GCP pipeline resources by centralizing definitions in a single deployment.yaml file.

Core Features & Use Cases

  • Declarative Provisioning: Define BigQuery, Dataform, Dataproc, and DTS resources in a consistent YAML format.
  • Environment Management: Maintain separate dev, staging, and prod configurations while keeping shared configuration together.
  • Safe Resource Setup: Enforce required labels, secret references, and validation steps before deployment.
  • Use Case: A data platform engineer can update one deployment.yaml file to create a dataset, configure a DTS transfer, and deploy the full setup for a specific environment.

Quick Start

Use this skill to create or update deployment.yaml for the target environment and deploy the supported GCP resources.

Frequently Asked Questions about gcp-pipeline-resource-provisioning

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate provisioning GCP pipeline resources across dev, staging, and prod?▼

Automate GCP pipeline resource provisioning by defining BigQuery, Dataform, Dataproc, and DTS resources in a single deployment.yaml file to deploy across dev, staging, and prod environments.

Can I deploy BigQuery datasets and Dataproc clusters from a single configuration file?▼

Yes, you can deploy BigQuery datasets and Dataproc clusters together by defining them declaratively in one deployment.yaml file, which centralizes environment-specific setup and shared configurations.

What is required to set up Dataform and BigQuery Data Transfer Service resources declaratively?▼

Setting up Dataform and DTS resources declaratively requires validated resource definitions, explicit datacloud labels, secret references, and orchestration-pipelines deployment support in your configuration.

Does declarative GCP provisioning enforce required labels and validation before deployment?▼

Yes, declarative GCP provisioning enforces safe resource setup by validating resource definitions, requiring explicit datacloud labels, and checking secret references before applying any environment-specific deployment.

What is the best way to manage environment-specific configurations for GCP data pipelines?▼

The best way to manage GCP pipeline configurations is using a single deployment.yaml file to maintain separate dev, staging, and prod environments while keeping shared configuration centralized.

Why do I need explicit datacloud labels and secret references in my deployment.yaml?▼

Explicit datacloud labels and secret references are required in deployment.yaml to enforce safe resource setup, ensure proper validation steps, and maintain consistent orchestration-pipelines deployment support across environments.