query-dag-failure-debugger

Identifies root buckets for Airflow DAG failures and outputs structured triage with confidence and next steps.

31|4|Updated Aug 24, 2021
One-click install
npx skills add https://github.com/razorpay/trino-gateway --skill query-dag-failure-debugger
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: query-dag-failure-debugger
Source: https://github.com/razorpay/trino-gateway/tree/main/.agents/skills/query-dag-failure-debugger
Command: npx skills add https://github.com/razorpay/trino-gateway --skill query-dag-failure-debugger

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Triages and investigates Airflow DAG failures across Spark/EMR and Trino/Presto, providing a bucketed classification, concise root-cause reasoning, and live investigation options using MCP data sources.

Core Features & Use Cases

  • Classifies failures into 9 buckets (Airflow orchestration, upstream data, SPARK_RESOURCE, SPARK_RUNTIME, SQL_FAILURE, QUERY_ENGINE_TRANSIENT, PERMISSION_ACCESS, INFRASTRUCTURE, UNKNOWN)
  • Pulls evidence from Coralogix, Friday MCPs (AWS, K8s), and Grafana to inform triage
  • Performs Phase 1 classification quickly from the DAG code and task logs, with an optional Phase 2 live investigation
  • Suitable for Airflow-backed DAGs spanning Spark/EMR and Trino/Presto workloads

Quick Start

Paste an Airflow task error or log snippet to initialize a triage for the target DAG.

Frequently Asked Questions about query-dag-failure-debugger

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I troubleshoot Airflow DAG failures automatically?

To investigate Airflow DAG failures, paste an Airflow task error or log snippet to initialize a triage. The Skill classifies the failure into categories like SPARK_RESOURCE or SQL_FAILURE using DAG code, task logs, and metadata to provide root cause evidence and next steps.

What causes Airflow DAG failures on Spark and Trino?

Airflow DAG failures on Spark and Trino are categorized into 9 buckets including SPARK_RESOURCE, SPARK_RUNTIME, SQL_FAILURE, and QUERY_ENGINE_TRANSIENT. The Skill evaluates task logs and DAG code to identify the specific root cause bucket with confidence levels.

Can I investigate Airflow task logs using Coralogix and Grafana?

Yes, you can investigate Airflow task logs using Coralogix and Grafana. The Skill pulls live evidence from Coralogix, Friday MCPs for AWS and Kubernetes, and Grafana to inform Phase 2 live investigation and root-cause reasoning.

How do I classify Airflow task errors into root cause buckets?

To classify Airflow task errors, the Skill performs fast Phase 1 classification using DAG code and task logs to identify the root bucket. It outputs a bucket classification, confidence score, root cause reasoning, and concrete next steps for resolution.

Does Airflow DAG triage work with Spark EMR and Presto workloads?

Yes, Airflow DAG triage works with Spark EMR and Presto workloads. The Skill is specifically designed for Airflow-backed DAGs spanning Spark/EMR and Trino/Presto, evaluating failures across orchestration, Spark runtime, and SQL query engine backends.

Why is my Airflow DAG failing with UNKNOWN errors?

Your Airflow DAG may return an UNKNOWN bucket classification when task logs and DAG code lack sufficient evidence to categorize the failure into defined buckets like SPARK_RESOURCE or PERMISSION_ACCESS. The Skill outputs this classification with low confidence and suggests escalation to Phase 2 live investigation.