Airflow: Difference between revisions
Jump to navigation
Jump to search
Line 3: | Line 3: | ||
=Internal= | =Internal= | ||
=Overview= | =Overview= | ||
Airflow is a platform to programmatically author, schedule and monitor workflows. | Airflow is a platform to programmatically author, schedule and monitor workflows. The workflows are expressed as [[Graph_Concepts#Directed_Acyclic_Graph_.28DAG.29|DAGs]] of tasks. | ||
=Organizatorium= | =Organizatorium= | ||
* Users schedule batch jobs in Airflow. | * Users schedule batch jobs in Airflow. |
Revision as of 20:23, 9 December 2021
External
Internal
Overview
Airflow is a platform to programmatically author, schedule and monitor workflows. The workflows are expressed as DAGs of tasks.
Organizatorium
- Users schedule batch jobs in Airflow.
- Celery Executor: https://airflow.apache.org/docs/apache-airflow/stable/executor/celery.html
- Kubernetes Executor introduced in Airflow 1.10.0
- Dag Sync