Airflow: Difference between revisions
Jump to navigation
Jump to search
Line 4: | Line 4: | ||
=Overview= | =Overview= | ||
Airflow is a platform to programmatically author, schedule and monitor workflows. The workflows are expressed as [[Graph_Concepts#Directed_Acyclic_Graph_.28DAG.29|DAGs]] of tasks. | Airflow is a platform to programmatically author, schedule and monitor workflows. The workflows are expressed as [[Graph_Concepts#Directed_Acyclic_Graph_.28DAG.29|DAGs]] of tasks. | ||
=Subjects= | |||
* [[Airflow Concepts|Concepts]] | |||
=Organizatorium= | =Organizatorium= |
Revision as of 22:43, 13 December 2021
External
Internal
Overview
Airflow is a platform to programmatically author, schedule and monitor workflows. The workflows are expressed as DAGs of tasks.
Subjects
Organizatorium
- Users schedule batch jobs in Airflow.
- Celery Executor: https://airflow.apache.org/docs/apache-airflow/stable/executor/celery.html
- Kubernetes Executor introduced in Airflow 1.10.0
- Dag Sync