Data Lake for Enterprises

Kafka message broker

One of the important component, which brings the decoupling behaviour of Kafka in action is the all important message broker. The messages produced by the producer is pumped to the topic residing in the broker and the consumer consumes the messages from the topic (the consumer subscribes to topics in the broker and the broker publishes the messages to it). The messages are published to this broker and there could be more than one broker (node) which forms the Kafka cluster. The storage responsibility in Kafka is taken care of by the broker. Finding the message from within the partition and within a broker is the responsibility of the broker. This is required when the consumer requests a message from within a subscribe ...