des-airflow-orchestration

What problem does it solve?

This Skill solves the problem of turning DES data-engineering design artifacts into production-ready Apache Airflow orchestration that is scheduled, retry-safe, validation-gated, observable, and evidence-producing.

Core Features & Use Cases

• Design Airflow DAG boundaries that coordinate DES phase outputs into executable task graphs without embedding heavy transformation logic.
• Implement robust operational controls including schedules, retries, timeouts, backfills/catchup behavior, and idempotent reruns.
• Integrate common data-stack components such as dlt ingestion, dbt transformations, Provero validation gates, DuckDB profiling, and Fabric job/notebook execution with lineage and alerting plans.
• Produce operational evidence to support DES “Done” gates, release readiness, troubleshooting, and handoff.

Quick Start

Use the des-airflow-orchestration skill to design an Airflow DAG that schedules ingestion and runs Bronze→Silver→Gold with Provero/dbt gates, lineage planning, alerts, and an evidence pack for the target environment.