Data Lake for Enterprises

Kafka producer

As the name suggests, this is the client which produces message (stream data) to the Kafka cluster into the designated Kafka topics. There are different types of producers that exist and each have different ways by how they pump these messages. Some produce at a high-velocity with low volume (a message with less payload and high throughput). Some produce low velocity data at a very high-volume (low throughput with the message size being high).

The producer has a choice of sending messages in a synchronous or asynchronous manner. Asynchronous support in Kafka allows producers to send micro-batch messages and can reduce the chattiness between the producer and the cluster. In certain situations, this is quite useful and it is ...