domains / families / data / airflow-dag-patterns

airflow-dag-patterns

authentic

Build production Apache Airflow DAGs with best practices for operators, sensors, testing, and deployment. Use when creating data pipelines, orchestrating workflows, or scheduling batch jobs.

When to use

• Creating data pipeline orchestration with Airflow
• Designing DAG structures and dependencies
• Implementing custom operators and sensors
• Testing Airflow DAGs locally
• Setting up Airflow in production
• Debugging failed DAG runs

When not to use

• You only need a simple cron job or shell script
• Airflow is not part of the tooling stack
• The task is unrelated to workflow orchestration

Skill page

Source