gcp-composer-troubleshooting

Diagnoses Cloud Composer and Airflow DAG failures using gcloud logs and remote code analysis.

Updated Aug 16, 2026
One-click install
npx skills add https://github.com/1919114514yasenpai-maker/focus-quest --skill gcp-composer-troubleshooting-1919114514yasenpai-maker
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: gcp-composer-troubleshooting
Source: https://github.com/1919114514yasenpai-maker/focus-quest/tree/main/.gemini/skills/gcp-composer-troubleshooting
Command: npx skills add https://github.com/1919114514yasenpai-maker/focus-quest --skill gcp-composer-troubleshooting-1919114514yasenpai-maker

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Failed Cloud Composer (Apache Airflow) pipelines are hard to debug because logs, remote DAG code, and environment configuration are scattered across GCP services. This Skill guides an evidence-based Root Cause Analysis (RCA) workflow that correlates logs with the actual code running in the Composer environment. ## Core Features & Use Cases - Log-Based Evidence Gathering: Uses gcloud logging read with filters on severity, environment name, and DAG ID to locate failures and stack traces. - Remote Code Retrieval: Downloads the actual DAG code from the environment's GCS bucket to ensure analysis matches what is really running, not stale local copies. - Structured RCA Reports: Pinpoints the exact failing line or configuration, proposes a fix, and generates a saved RCA report. - Pipeline Template Validation: Provides compliant templates for declarative deployment.yaml and orchestration-pipeline.yaml files covering dbt, PySpark, and BigQuery actions. - Use Case: A user's daily_sales_agg DAG failed yesterday; the Skill fetches error logs, downloads the remote DAG, identifies a KeyError on line 45, and produces an RCA report with a recommended fix. ## Quick Start Ask the assistant to troubleshoot a failed DAG in your Composer environment by providing the DAG ID and approximate failure time, and request a root cause analysis report.

Frequently Asked Questions about gcp-composer-troubleshooting

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I troubleshoot a failed Cloud Composer DAG?▼

Provide the DAG ID and approximate failure time, then use gcloud logging read with filters on resource.type=cloud_composer_environment and severity>=ERROR to find the failure. Download the remote DAG code from the environment's GCS bucket and correlate the log errors with the code to identify the root cause.

How to generate a root cause analysis report for Airflow pipeline failures?▼

Gather evidence from Composer logs, retrieve the actual running DAG code from the GCS bucket, and pinpoint the exact failing line or configuration. Then document the root cause with cited log entries and code snippets, propose a fix, and save the RCA report to a file.

What gcloud commands are used to debug Composer environments?▼

Use gcloud composer environments list with the --locations flag to find environments, gcloud composer environments run with dags list-runs to inspect runs, gcloud logging read for error logs, and gcloud storage cp to download DAG files from the environment bucket.

Why does my local DAG code not match the Composer environment?▼

The remote environment is the source of truth for failures, and local files may be outdated or unsynced. Always download the remote DAG from the GCS bucket before analysis, or ask whether to sync the local version to the environment and retry the run.

Can this skill automatically fix my broken Airflow DAG?▼

No, the workflow is read-only first: it analyzes logs and code to prove the root cause and proposes a fix, but does not modify code unless you explicitly ask. This prevents unverified changes to production pipelines.