query-dag-failure-debugger

Identifies root buckets for Airflow DAG failures and outputs structured triage with confidence and next steps.

31|4|Updated Aug 24, 2021
One-click install
npx skills add https://github.com/razorpay/trino-gateway --skill query-dag-failure-debugger
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: query-dag-failure-debugger
Source: https://github.com/razorpay/trino-gateway/tree/main/.agents/skills/query-dag-failure-debugger
Command: npx skills add https://github.com/razorpay/trino-gateway --skill query-dag-failure-debugger

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Triages and investigates Airflow DAG failures across Spark/EMR and Trino/Presto, providing a bucketed classification, concise root-cause reasoning, and live investigation options using MCP data sources.

Core Features & Use Cases

  • Classifies failures into 9 buckets (Airflow orchestration, upstream data, SPARK_RESOURCE, SPARK_RUNTIME, SQL_FAILURE, QUERY_ENGINE_TRANSIENT, PERMISSION_ACCESS, INFRASTRUCTURE, UNKNOWN)
  • Pulls evidence from Coralogix, Friday MCPs (AWS, K8s), and Grafana to inform triage
  • Performs Phase 1 classification quickly from the DAG code and task logs, with an optional Phase 2 live investigation
  • Suitable for Airflow-backed DAGs spanning Spark/EMR and Trino/Presto workloads

Quick Start

Paste an Airflow task error or log snippet to initialize a triage for the target DAG.

Frequently Asked Questions about query-dag-failure-debugger

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I troubleshoot Airflow DAG failures automatically?▼

To investigate Airflow DAG failures, paste an Airflow task error or log snippet to initialize a triage. The Skill classifies the failure into categories like SPARK_RESOURCE or SQL_FAILURE using DAG code, task logs, and metadata to provide root cause evidence and next steps.

What causes Airflow DAG failures on Spark and Trino?▼

Airflow DAG failures on Spark and Trino are categorized into 9 buckets including SPARK_RESOURCE, SPARK_RUNTIME, SQL_FAILURE, and QUERY_ENGINE_TRANSIENT. The Skill evaluates task logs and DAG code to identify the specific root cause bucket with confidence levels.

Can I investigate Airflow task logs using Coralogix and Grafana?▼

Yes, you can investigate Airflow task logs using Coralogix and Grafana. The Skill pulls live evidence from Coralogix, Friday MCPs for AWS and Kubernetes, and Grafana to inform Phase 2 live investigation and root-cause reasoning.

How do I classify Airflow task errors into root cause buckets?▼

To classify Airflow task errors, the Skill performs fast Phase 1 classification using DAG code and task logs to identify the root bucket. It outputs a bucket classification, confidence score, root cause reasoning, and concrete next steps for resolution.

Does Airflow DAG triage work with Spark EMR and Presto workloads?▼

Yes, Airflow DAG triage works with Spark EMR and Presto workloads. The Skill is specifically designed for Airflow-backed DAGs spanning Spark/EMR and Trino/Presto, evaluating failures across orchestration, Spark runtime, and SQL query engine backends.

Why is my Airflow DAG failing with UNKNOWN errors?▼

Your Airflow DAG may return an UNKNOWN bucket classification when task logs and DAG code lack sufficient evidence to categorize the failure into defined buckets like SPARK_RESOURCE or PERMISSION_ACCESS. The Skill outputs this classification with low confidence and suggests escalation to Phase 2 live investigation.