Data Lake for Enterprises

Messaging layer

In Chapter 2, Comprehensive Concepts of a Data Lake, you already a high-level view of the messaging layer and how it works, especially in the context of Data Lake.

Figure 01: Data Lake: Messaging layer

The messaging layer in Data Lake takes care of as mentioned in the bulleted list has a set of functions/capabilities:

• One of the core capabilities of this layer is it's ability to decouple both the source (producer) and destination (consumer).
• Ability to handle high-velocity messages of the order of hundreds of megabytes per second from each application server node.
• Ability to handle huge volumes of data of the order of terabytes ...