Airflow Dynamic Task Mapping
Jump to navigation
Jump to search
External
- https://airflow.apache.org/docs/apache-airflow/stable/concepts/dags.html#dynamic-dags
- https://airflow.apache.org/docs/apache-airflow/stable/concepts/dynamic-task-mapping.html
- https://airflow.apache.org/docs/apache-airflow/stable/howto/dynamic-dag-generation.html
Internal
Overview
A workflow can create a number of tasks at runtime, based upon current data, rather than the DAG author having to know in advance how many tasks would be needed.