gcp-composer-troubleshooting

Diagnoses Cloud Composer and Airflow DAG failures using gcloud logs and remote code analysis.

1|Updated Jul 4, 2026
One-click install
npx skills add https://github.com/trungenglish/SHOPWISE --skill gcp-composer-troubleshooting-trungenglish
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: gcp-composer-troubleshooting
Source: https://github.com/trungenglish/SHOPWISE/tree/main/.agents/skills/gcp-composer-troubleshooting
Command: npx skills add https://github.com/trungenglish/SHOPWISE --skill gcp-composer-troubleshooting-trungenglish

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? When a Cloud Composer (Apache Airflow) pipeline or DAG fails, finding the root cause requires digging through scattered logs and verifying which code version actually ran. This Skill guides an evidence-based Root Cause Analysis (RCA) workflow so failures are explained with concrete log entries and code references instead of guesswork. ## Core Features & Use Cases - Log-Based Evidence Gathering: Uses gcloud logging read with severity, environment, and DAG ID filters to locate failures and stack traces. - Remote Code Verification: Downloads the actual DAG code from the environment's GCS bucket to ensure analysis targets the code that really ran, not stale local copies. - Structured RCA Reports: Correlates logs with code, pinpoints the failing line or configuration, proposes a fix, and generates a saved RCA report. - Declarative Pipeline Templates: Provides compliant deployment.yaml and orchestration-pipeline.yaml structures for DBT, PySpark, and BigQuery actions. - Use Case: A user reports that the daily_sales_agg DAG failed yesterday at 2pm. The Skill fetches error logs, downloads the remote DAG, identifies a KeyError on a missing 'region' field at line 45, and produces an RCA report with a recommended fix. ## Quick Start Ask the assistant to troubleshoot why your Cloud Composer DAG failed and generate a root cause analysis report, providing the DAG ID and approximate failure time.

Frequently Asked Questions about gcp-composer-troubleshooting

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I troubleshoot a failed Cloud Composer DAG?▼

Use gcloud logging read with filters like resource.type="cloud_composer_environment", severity>=ERROR, and the DAG ID to find failure logs. Then download the actual DAG code from the environment's GCS bucket and correlate the traceback with the code to identify the root cause.

How to generate a root cause analysis report for Airflow pipeline failures?▼

Gather the DAG ID, run ID, and task ID, retrieve error logs via gcloud logging, and fetch the remote DAG code as the source of truth. Correlate the stack trace with specific code lines, explain the cause, propose a fix, and save the findings as an RCA report file.

Why does my local DAG code differ from what runs in Cloud Composer?▼

The Composer environment runs code from its GCS bucket, which may not match your local files if deployments are out of sync. Always download the remote DAG with gcloud storage cp before analysis, or sync your local version to the environment and retry the run.

What gcloud commands list Composer environments and DAG runs?▼

Use gcloud composer environments list with the --locations flag to list environments, and gcloud composer environments run <env> --location <region> dags list-runs -- -d <dag_id> to list DAG runs. Always include the location flag for accurate results.

Can this skill automatically fix my broken Airflow DAG code?▼

No, it follows a read-only-first approach: it analyzes logs and remote code to prove the root cause and proposes a fix, but does not modify code unless you explicitly ask. This prevents unverified changes to production pipelines.