Airflow Sensor: Difference between revisions

From NovaOrdis Knowledge Base
Jump to navigation Jump to search
Line 12: Line 12:
=Sensor Types=
=Sensor Types=
==Poke==
==Poke==
This is default run mode. The Sensor takes up a [[Airflow_Concepts#Worker|worker]] slot for its entire runtime.
<code>poke</coce> is the default run mode for a sensor. The Sensor takes up a [[Airflow_Concepts#Worker|worker]] slot for its entire runtime.


==Reschedule==
==Reschedule==

Revision as of 22:24, 17 July 2022

External

Internal

Overview

A Sensor is a subclass of Operator. Sensors wait for an external event to happen. When the event they are waiting for occurs, the tasks succeeds, so their downstream tasks can run. The sensors are primarily idle, and because of that, they have primarily three modes of running, that allows executing them with various degrees of efficiency: poke, reschedule and smart sensors.

Also see Deferrable Operators and Triggers.

Sensor Types

Poke

poke</coce> is the default run mode for a sensor. The Sensor takes up a worker slot for its entire runtime.

Reschedule

The reschedule mode can be configured when the sensor is instantiated. The sensor takes up a worker slot only when it's checking, and sleeps for a set duration between checks.

Smart Sensor

There is a single centralized version of this sensor that batches all executions of it.