Kafka

External

• https://kafka.apache.org/documentation
• Kafka Overview https://www.slideshare.net/junrao/kafka-replication-apachecon2013
• https://www.confluent.io

Internal

• Asynchronous Communication
• Distributed Systems
• Confluent Schema Registry
• Flume

Overview

Kafka is a distributed publish/subscribe messaging system. It is used for real-time event processing, log aggregation, monitoring, queueing, etc. Kafka has database-like durability guarantees. It can sustain high throughput (tens of MB/sec/server).

Subjects

• Operations
• Kafka Streams

Organizatorium

• DataObjects in Kafka topics.
• Offset per topic should be maintained.
• Kafka cluster.
• Kafka broker. Each cluster has a number of brokers.