What problem does it solve? When building data pipelines on Google Cloud, teams often don't know whether data ingestion is already handled by an existing BigQuery Data Transfer Service (DTS) configuration, leading to duplicate transfers or misconfigured pipelines. This Skill discovers existing DTS transfer configs, extracts their metadata, and guides the declarative provisioning of new transfers. ## Core Features & Use Cases - Transfer Discovery: Lists and inspects existing DTS transfer configurations in a target project and region using bq CLI commands. - Data Source Parameter Discovery: Runs a Python script against the BigQuery Data Transfer REST API to enumerate available data sources and their required parameters, including OAuth authorization URL generation for Google data sources. - Declarative Provisioning Enforcement: Ensures all new transfer configs are created via a deployment.yaml resource provisioning framework rather than imperative CLI commands, with mandatory user confirmation of parameters. - Run Verification: Triggers manual transfer runs and polls for completion with a 5-minute timeout rule before proceeding with downstream pipeline work. - Use Case: A data engineer asked to "ingest Google Ads data into BigQuery" uses this Skill to check for an existing transfer, discover required data source parameters, obtain OAuth authorization, and verify a successful run before building downstream transformations. ## Quick Start Ask the assistant to check whether a BigQuery Data Transfer Service config already exists for your data source in your GCP project and region before creating a new ingestion pipeline.
