Data Lake for Enterprises

Data Storage and Lambda Batch Layer - technology mapping

To cover our use case and to build the Data Lake, we use multiple stores. This chapter aims at covering storage mechanism for non-indexed raw data. This chapter delve deeply into Hadoop, which is our choice for this capability.

The following figure brings in the technology aspects of the conceptual architecture that we will be following throughout this book. We will keep explaining each technology and its relevance in the overall architecture before we bring all the technologies together in the final part of this book (part 3):

Figure 02: Technology mapping for Data Storage and Lambda ...