Airflow Dynamic Task Mapping: Difference between revisions
Jump to navigation
Jump to search
| Line 12: | Line 12: | ||
TO PROCESS: | TO PROCESS: | ||
* https://www.astronomer.io/guides/dynamic-tasks/ | * https://www.astronomer.io/guides/dynamic-tasks/ | ||
* https://airflow.apache.org/docs/apache-airflow/2.3.0/concepts/dynamic-task-mapping.html | |||
</font> | </font> | ||
Revision as of 03:26, 18 July 2022
External
- https://airflow.apache.org/docs/apache-airflow/stable/concepts/dags.html#dynamic-dags
- https://airflow.apache.org/docs/apache-airflow/stable/concepts/dynamic-task-mapping.html
- https://airflow.apache.org/docs/apache-airflow/stable/howto/dynamic-dag-generation.html
Internal
Overview
A workflow can create a number of tasks at runtime, based upon current data, rather than the DAG author having to know in advance how many tasks would be needed.
Organizatorium
TO PROCESS:
- https://www.astronomer.io/guides/dynamic-tasks/
- https://airflow.apache.org/docs/apache-airflow/2.3.0/concepts/dynamic-task-mapping.html