Data Lake for Enterprises

Data Storage and the Lambda Batch Layer

In Chapter 2, Comprehensive Concepts of a Data Lake, you got a glimpse into the data storage layer. This layer’s responsibility is to persist gathered data into a permanent place in our Data Lake. The Lambda Batch Layer’s responsibility is to create batch views for the data stored in the Data Storage layer. The following figure will refresh your memory and give you a good pictorial view of this layer:

Figure 01: Data Lake - Data Storage and Lambda Batch Layer

The Data Storage Layer is one of the very important layers, which should persist different types of raw data coming from different source systems, ...