Airflow Dynamic Task Mapping: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
|||
| Line 8: | Line 8: | ||
=Overview= | =Overview= | ||
A workflow can create a number of tasks at runtime, based upon current data, rather than the DAG author having to know in advance how many tasks would be needed. | A workflow can create a number of tasks at runtime, based upon current data, rather than the DAG author having to know in advance how many tasks would be needed. | ||
=Organizatorium= | |||
<font color=darkkhaki> | |||
TO PROCESS: | |||
* https://www.astronomer.io/guides/dynamic-tasks/ | |||
</font> | |||
Revision as of 03:24, 18 July 2022
External
- https://airflow.apache.org/docs/apache-airflow/stable/concepts/dags.html#dynamic-dags
- https://airflow.apache.org/docs/apache-airflow/stable/concepts/dynamic-task-mapping.html
- https://airflow.apache.org/docs/apache-airflow/stable/howto/dynamic-dag-generation.html
Internal
Overview
A workflow can create a number of tasks at runtime, based upon current data, rather than the DAG author having to know in advance how many tasks would be needed.
Organizatorium
TO PROCESS: