Kafka

From NovaOrdis Knowledge Base
Jump to navigation Jump to search

External

Internal

Overview

Kafka is a distributed publish/subscribe messaging system. It is used for real-time event processing, log aggregation, monitoring, queueing, etc. Kafka has database-like durability guarantees. It can sustain high throughput (tens of MB/sec/server).

Subjects

Organizatorium

  • DataObjects in Kafka topics.
  • Offset per topic should be maintained.
  • Kafka cluster.
  • Kafka broker. Each cluster has a number of brokers.