Airflow Dynamic Task Mapping
Jump to navigation
Jump to search
External
- https://airflow.apache.org/docs/apache-airflow/stable/concepts/dags.html#dynamic-dags
- https://airflow.apache.org/docs/apache-airflow/stable/concepts/dynamic-task-mapping.html
- https://airflow.apache.org/docs/apache-airflow/stable/howto/dynamic-dag-generation.html
Internal
Overview
A workflow can create a number of tasks at runtime, based upon current data, rather than the DAG author having to know in advance how many tasks would be needed.
Organizatorium
TO PROCESS:
- https://www.astronomer.io/guides/dynamic-tasks/
- https://airflow.apache.org/docs/apache-airflow/2.3.0/concepts/dynamic-task-mapping.html