Data Lake for Enterprises

Data stream life cycle

Apache Kafka is a piece of technology that enables us to handle data streams. Before getting into the working of Kafka, let's see what life cycle events that are when a data stream flow takes place. Rassul Fazelat, in one of his LinkedIn blogs, has explained this in detail as shown pictorially in the following figure.

Figure 04: Life cycle of Data Stream

As shown in the preceding figure, the life cycle events of a data stream have three components, each having a definite job to do:

• Create: The most important component. It produces the data streams from a variety of internal business applications and external partners ...