Data Lake for Enterprises

Messaging layer - technology mapping

If data is the lifeblood of high technology, Apache Kafka is the circulatory system

- Todd Palino, LinkedIn

To cover our use case and to build our Data Lake, we use Apache Kafka in this layer as the technology.

The following figure brings in the technology aspect to the conceptual architecture that we will be following throughout this book. We will keep explaining each technology and its relevance in terms of overall architecture before bringing all the technologies together in the final part of this book (Part 3).

Figure 02: Technology mapping for Messaging Layer

In line with our use case of SCV, the real-time ...