What problem does it solve? Building Dataform pipelines for BigQuery requires precise SQLX syntax, correct incremental configurations, and valid DAG dependencies. This Skill guides an AI to generate, compile, and validate Dataform pipeline code correctly, including source declarations, GCS ingestion, and incremental table operations. ## Core Features & Use Cases - Pipeline Generation: Creates SQLX actions, source declarations, and workflow_settings.yaml configurations for new or existing Dataform repositories. - Validation & Compilation: Runs dataform compile, dry-run executions, and bq query checks to catch syntax and dependency errors before deployment. - Automatic Cleaning & Optimization: Applies data cleaning protocols and BigQuery SQL optimizations to every transformation by default. - Use Case: You need to ingest CSV files from GCS into an existing BigQuery table. The Skill creates an external table operations file, an incremental SQLX action matching the target schema, and validates everything with a dry run. ## Quick Start Ask the AI to create a Dataform pipeline that loads data from a GCS bucket into an existing BigQuery table using incremental append.
