Airflow Dynamic Task Mapping

From NovaOrdis Knowledge Base
Jump to navigation Jump to search

External

Internal

Overview

A workflow can create a number of tasks at runtime, based upon current workflow instance state, rather than the DAG author having to know in advance how many tasks would be needed. However, the tasks can be created in the DAG definition itself. Tasks cannot create dynamic tasks.

Questions

  • Can dependencies be declared on dynamic tasks?