Airflow Dynamic Task Mapping: Difference between revisions
Jump to navigation
Jump to search
(Created page with "=External= * https://airflow.apache.org/docs/apache-airflow/stable/concepts/dags.html#dynamic-dags * https://airflow.apache.org/docs/apache-airflow/stable/concepts/dynamic-tas...") |
No edit summary |
||
| Line 2: | Line 2: | ||
* https://airflow.apache.org/docs/apache-airflow/stable/concepts/dags.html#dynamic-dags | * https://airflow.apache.org/docs/apache-airflow/stable/concepts/dags.html#dynamic-dags | ||
* https://airflow.apache.org/docs/apache-airflow/stable/concepts/dynamic-task-mapping.html | * https://airflow.apache.org/docs/apache-airflow/stable/concepts/dynamic-task-mapping.html | ||
* https://airflow.apache.org/docs/apache-airflow/stable/howto/dynamic-dag-generation.html | |||
=Internal= | =Internal= | ||
Revision as of 00:44, 14 July 2022
External
- https://airflow.apache.org/docs/apache-airflow/stable/concepts/dags.html#dynamic-dags
- https://airflow.apache.org/docs/apache-airflow/stable/concepts/dynamic-task-mapping.html
- https://airflow.apache.org/docs/apache-airflow/stable/howto/dynamic-dag-generation.html
Internal
Overview
A workflow can create a number of tasks at runtime, based upon current data, rather than the DAG author having to know in advance how many tasks would be needed.