airflow_dag_factory

Generate Apache Airflow DAGs declaratively from YAML using dag-factory.

14|1|Updated May 5, 2026
One-click install
npx skills add https://github.com/ivanshamaev/de-agent-skills --skill airflow-dag-factory
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: airflow_dag_factory
Source: https://github.com/ivanshamaev/de-agent-skills/tree/main/skills/airflow_dag_factory
Command: npx skills add https://github.com/ivanshamaev/de-agent-skills --skill airflow-dag-factory

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill eliminates repetitive, error-prone boilerplate when creating and maintaining many Apache Airflow DAGs by letting you define them declaratively in YAML instead of writing large amounts of Python.

Core Features & Use Cases

  • Declarative DAG authoring with YAML: Define DAGs, tasks, task groups, dependencies, schedules, retries, and metadata in a consistent config format.
  • Production-ready scaling patterns: Generate many similar DAGs from one template, reuse defaults hierarchically, and support large fleets while keeping YAML maintainable with DRY patterns (anchors).
  • Advanced Airflow capabilities in config form: Use dynamic task mapping (partial/expand), dataset-aware scheduling (outlets/inlets and datasets), callbacks, TaskFlow-style decorators, environment-variable expansion, and Jinja2 templating.

Quick Start

Use the airflow_dag_factory skill to generate an Airflow DAG that loads YAML-defined tasks and schedules for multiple similar pipelines in a single project.

Frequently Asked Questions about airflow_dag_factory

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I generate Apache Airflow DAGs from YAML configs?▼

You can generate Apache Airflow DAGs from YAML configs declaratively using dag-factory. By defining tasks, dependencies, schedules, and metadata in YAML, you eliminate repetitive Python boilerplate and streamline large-scale DAG fleet management.

What is the best way to manage a large fleet of repetitive Airflow DAGs?▼

The best way to manage repetitive Airflow DAGs is defining them declaratively in YAML. This approach supports hierarchical defaults reuse and DRY patterns like YAML anchors, keeping large-scale DAG fleets maintainable without duplicating Python code.

Can I use dynamic task mapping and dataset-aware scheduling in YAML-defined Airflow DAGs?▼

Yes, YAML-defined Airflow DAGs support advanced capabilities including dynamic task mapping via partial/expand, dataset-aware scheduling with outlets and inlets, callbacks, and TaskFlow-style decorators directly within the configuration.

Does dag-factory work with custom Airflow operators and Jinja2 templating?▼

Yes, dag-factory works with custom and provider operators by specifying correct import paths in YAML. It also supports Jinja2 templating, environment-variable expansion, and typed fields to satisfy operator configuration requirements.

What do I need to set up before converting Airflow DAGs to YAML definitions?▼

Before converting Airflow DAGs to YAML, you need a dag-factory v1.0+ project setup with an Airflow YAML loader. You must also explicitly install required provider packages and ensure YAML definitions match operator import paths and dependency topology.

Why should I use YAML instead of Python to author Airflow DAGs?▼

You should use YAML instead of Python to author Airflow DAGs to eliminate error-prone boilerplate. Declarative YAML configuration enforces consistent DAG structures, makes repetitive pipelines easier to maintain, and supports advanced features like TaskFlow decorators without complex Python.