Building Data Streaming Applications with Apache Kafka

Kafka message delivery semantics

Semantic guarantees in Kafka need to be understood from the perspective of producers and consumers.

At a very high level, message flows in Kafka comprise the producer writing messages that are read by consumers to deliver it to the message processing component. In other words, producer message delivery semantics impact the way messages are received by the consumer.

For example, suppose the producer component does not receive successful acks from brokers because of network connectivity. In that case, the producer re-sends those messages even if the broker has received them. This results in duplicate messages sent to the consumer application. Therefore, it is important to understand that the way messages are ...