airflow_dag_factory

Generate Apache Airflow DAGs declaratively from YAML using dag-factory.

14|1|Updated May 5, 2026
One-click install
npx skills add https://github.com/ivanshamaev/de-agent-skills --skill airflow-dag-factory
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: airflow_dag_factory
Source: https://github.com/ivanshamaev/de-agent-skills/tree/main/skills/airflow_dag_factory
Command: npx skills add https://github.com/ivanshamaev/de-agent-skills --skill airflow-dag-factory

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill eliminates repetitive, error-prone boilerplate when creating and maintaining many Apache Airflow DAGs by letting you define them declaratively in YAML instead of writing large amounts of Python.

Core Features & Use Cases

  • Declarative DAG authoring with YAML: Define DAGs, tasks, task groups, dependencies, schedules, retries, and metadata in a consistent config format.
  • Production-ready scaling patterns: Generate many similar DAGs from one template, reuse defaults hierarchically, and support large fleets while keeping YAML maintainable with DRY patterns (anchors).
  • Advanced Airflow capabilities in config form: Use dynamic task mapping (partial/expand), dataset-aware scheduling (outlets/inlets and datasets), callbacks, TaskFlow-style decorators, environment-variable expansion, and Jinja2 templating.

Quick Start

Use the airflow_dag_factory skill to generate an Airflow DAG that loads YAML-defined tasks and schedules for multiple similar pipelines in a single project.

Frequently Asked Questions about airflow_dag_factory

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate Apache Airflow DAGs from YAML configs?

You can generate Apache Airflow DAGs from YAML configs declaratively using dag-factory. By defining tasks, dependencies, schedules, and metadata in YAML, you eliminate repetitive Python boilerplate and streamline large-scale DAG fleet management.

What is the best way to manage a large fleet of repetitive Airflow DAGs?

The best way to manage repetitive Airflow DAGs is defining them declaratively in YAML. This approach supports hierarchical defaults reuse and DRY patterns like YAML anchors, keeping large-scale DAG fleets maintainable without duplicating Python code.

Can I use dynamic task mapping and dataset-aware scheduling in YAML-defined Airflow DAGs?

Yes, YAML-defined Airflow DAGs support advanced capabilities including dynamic task mapping via partial/expand, dataset-aware scheduling with outlets and inlets, callbacks, and TaskFlow-style decorators directly within the configuration.

Does dag-factory work with custom Airflow operators and Jinja2 templating?

Yes, dag-factory works with custom and provider operators by specifying correct import paths in YAML. It also supports Jinja2 templating, environment-variable expansion, and typed fields to satisfy operator configuration requirements.

What do I need to set up before converting Airflow DAGs to YAML definitions?

Before converting Airflow DAGs to YAML, you need a dag-factory v1.0+ project setup with an Airflow YAML loader. You must also explicitly install required provider packages and ensure YAML definitions match operator import paths and dependency topology.

Why should I use YAML instead of Python to author Airflow DAGs?

You should use YAML instead of Python to author Airflow DAGs to eliminate error-prone boilerplate. Declarative YAML configuration enforces consistent DAG structures, makes repetitive pipelines easier to maintain, and supports advanced features like TaskFlow decorators without complex Python.