Spark

External

• https://spark.apache.org
• https://spark.apache.org/docs/latest/index.html

Internal

• Distributed Systems
• Flink

Overview

Spark is a third generation unified analytics engine for large-scale data processing. It natively supports batch processing and stream processing. Stream processing is implemented as micro-batching. It uses HDFS as state backend.

Subjects

• Concepts