What problem does it solve? Querying data stored in remote catalogs like Databricks Unity or AWS Glue from Google Cloud engines normally requires complex cross-cloud setup involving secrets, IAM roles, and trust policies. This Skill guides the entire federation workflow so you can query remote Iceberg data directly from BigQuery or Spark without moving it. ## Core Features & Use Cases - Databricks Unity Federation: Creates regional Secret Manager credentials and a federated BigLake Iceberg catalog pointing to a Unity Catalog instance. - AWS Glue Federation: Walks through IAM role creation with placeholder trust policies, scoped Glue/S3 permissions, catalog creation, and trust policy updates using the Google service account ID. - Region Pairing Guidance: Recommends optimal GCP regions paired with AWS regions to minimize cross-cloud query latency. - Validation & Troubleshooting: Verifies the federation by listing namespaces via the bq CLI and proposes meaningful analytical queries on the discovered data. - Use Case: A data team keeps tables in AWS Glue but wants analysts to query them in BigQuery. This Skill sets up the federated catalog, configures IAM trust, and validates that BigQuery can list and query the remote tables. ## Quick Start Ask the assistant to federate your lakehouse catalog to Databricks Unity or AWS Glue so you can query that data from BigQuery.
