Airflow TaskFlow

External

• https://airflow.apache.org/docs/apache-airflow/stable/concepts/taskflow.html
• https://airflow.apache.org/docs/apache-airflow/stable/tutorial_taskflow_api.html

Internal

• Airflow Concepts

Programming Model

from airflow.decorators import dag, task
from datetime import datetime


@dag(
    [...]
)
def some_dag():
    @task
    def task_a():
        print(">>> A")

    @task
    def task_b():
        print(">>> B")

    task_a() >> task_b()

Context

https://airflow.apache.org/docs/apache-airflow/stable/concepts/taskflow.html#context

https://airflow.apache.org/docs/apache-airflow/stable/templates-ref.html#templates-variables

Logging

https://airflow.apache.org/docs/apache-airflow/stable/concepts/taskflow.html#logging