Kafka: Difference between revisions

From NovaOrdis Knowledge Base
Jump to navigation Jump to search
 
(4 intermediate revisions by the same user not shown)
Line 1: Line 1:
=External=
=External=
 
* https://kafka.apache.org/documentation
* Kafka Overview https://www.slideshare.net/junrao/kafka-replication-apachecon2013
* Kafka Overview https://www.slideshare.net/junrao/kafka-replication-apachecon2013
* https://www.confluent.io


=Internal=
=Internal=


* [[Asynchronous Communication#Kafka|Asynchronous Communication]]
* [[Distributed_Systems#Distributed_Messaging|Distributed Systems]]
* [[Distributed_Systems#Distributed_Messaging|Distributed Systems]]
* [[Confluent Schema Registry]]
* [[Confluent Schema Registry]]
Line 10: Line 12:


=Overview=
=Overview=
Kafka is a distributed publish/subscribe messaging system. It is used for real-time event processing, log aggregation, monitoring, queueing, etc. Kafka has [[Databases|database]]-like durability guarantees.
Kafka is a distributed publish/subscribe messaging system. It is used for real-time event processing, log aggregation, monitoring, queueing, etc. Kafka has [[Databases|database]]-like durability guarantees. It can sustain high throughput (tens of MB/sec/server).


=Subjects=
=Subjects=
* [[Kafka Operations|Operations]]
* [[Kafka Streams]]
* [[Kafka Streams]]
=Organizatorium=
=Organizatorium=
* DataObjects in Kafka topics.
* DataObjects in Kafka topics.

Latest revision as of 18:57, 5 October 2023

External

Internal

Overview

Kafka is a distributed publish/subscribe messaging system. It is used for real-time event processing, log aggregation, monitoring, queueing, etc. Kafka has database-like durability guarantees. It can sustain high throughput (tens of MB/sec/server).

Subjects

Organizatorium

  • DataObjects in Kafka topics.
  • Offset per topic should be maintained.
  • Kafka cluster.
  • Kafka broker. Each cluster has a number of brokers.