Flink

External

• https://flink.apache.org
• https://www.macrometa.com/event-stream-processing/spark-vs-flink

Internal

• Distributed Systems
• Stream Processing
• Spark
• Beam
• Hadoop
• Flink on K8s Operator

Overview

Apache Flink is a fourth generation data processing framework. It enables distributed data processing at scale. It supports both batch processing and stream processing and it is designed for stream processing natively. Flink streaming seems to be superior to Spark streaming. It promotes continuous streaming where event computations are triggered as soon as the event is received. That means Flink processes each event in real-time and provides very low latency.

Organizatorium

• The concept of a Flink application. Needs to be packaged and deployed.
• Flink operator.
• A Flink operator state machine: https://github.com/lyft/flinkk8soperator/blob/master/docs/state_machine.md