Mastering Hadoop 3

Consumer

As mentioned previously, consuming messages from Kafka is different than other messaging systems. However, when we write consumer applications using consumer APIs, all the details are abstracted and most of the internal work is done by the Kafka consumer libraries that are used by your application. We need to consider not to code for most of the consumer internal work and understand the internal workings. These concepts will help in debugging consumer applications and make the right application decision choices.

As seen in the previous section on Kafka producers, we will understand the different responsibilities of Kafka consumers. We will see them in the following points below:

• Subscribing to a topic: The Consumer operations initializes ...