Kafka: Difference between revisions

From NovaOrdis Knowledge Base
Jump to navigation Jump to search
 
(2 intermediate revisions by the same user not shown)
Line 1: Line 1:
=External=
=External=
* https://kafka.apache.org/documentation
* Kafka Overview https://www.slideshare.net/junrao/kafka-replication-apachecon2013
* Kafka Overview https://www.slideshare.net/junrao/kafka-replication-apachecon2013
* https://www.confluent.io
* https://www.confluent.io
Line 5: Line 6:
=Internal=
=Internal=


* [[Asynchronous Communication#Kafka|Asynchronous Communication]]
* [[Distributed_Systems#Distributed_Messaging|Distributed Systems]]
* [[Distributed_Systems#Distributed_Messaging|Distributed Systems]]
* [[Confluent Schema Registry]]
* [[Confluent Schema Registry]]
Line 13: Line 15:


=Subjects=
=Subjects=
* [[Kafka Operations|Operations]]
* [[Kafka Streams]]
* [[Kafka Streams]]
=Organizatorium=
=Organizatorium=
* DataObjects in Kafka topics.
* DataObjects in Kafka topics.

Latest revision as of 18:57, 5 October 2023

External

Internal

Overview

Kafka is a distributed publish/subscribe messaging system. It is used for real-time event processing, log aggregation, monitoring, queueing, etc. Kafka has database-like durability guarantees. It can sustain high throughput (tens of MB/sec/server).

Subjects

Organizatorium

  • DataObjects in Kafka topics.
  • Offset per topic should be maintained.
  • Kafka cluster.
  • Kafka broker. Each cluster has a number of brokers.