What problem does it solve? Building Dataform pipelines for BigQuery requires precise SQLX syntax, correct incremental configurations, and careful validation, and mistakes lead to broken DAGs or failed runs. This Skill guides the creation, modification, and validation of Dataform pipelines with enforced best practices. ## Core Features & Use Cases - Pipeline Generation: Creates SQLX actions, source declarations, and GCS ingestion operations following Dataform conventions for BigQuery. - Automatic Cleaning and Optimization: Applies data cleaning protocols and BigQuery SQL optimizations to every transformation, with summary sections in each response. - Validation Workflow: Compiles pipelines with dataform compile and validates with dry runs, handling credential setup and fallback verification via bq query. - Use Case: You need to ingest CSV files from GCS into an existing BigQuery table. The Skill creates an external table operations file, an incremental SQLX action matching the target schema, and validates everything with dataform compile and a dry run. ## Quick Start Create a Dataform pipeline that loads my CSV files from GCS into BigQuery and appends the cleaned results to my existing analytics table.
