Using Kafka as an event store
Apache Kafka is not just limited to a messaging system, it can also be used as a durable storage for immutable records and to build a streaming data pipeline on top of it. It is well suited for use cases such as website activity tracking, real-time monitoring, log aggregation, and processing streams of data. Any messages that are published on a Kafka topic are persisted on disk and replicated across Kafka servers based on the configuration for fault tolerance. Since Kafka guarantees the sequence of messages within a topic partition, it allows consumers to control their read position irrespective of other consumers of the same topic. The following example shows how the events published by a producer are made available ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access