Data Lake for Enterprises

Complete working of a Lambda Architecture

The following figure pictorially shows the complete working of Lambda Architecture:

Figure 10: Complete working of Lambda Architecture

As briefly explained earlier, the master data set is maintained and managed in the batch layer. When new data arrives, it is despatched to both, batch and speed layer. Once it reaches the batch layer, at regular batch interval batch views are generated and recomputed from scratch each time. Similarly, the speed layer using the new data generates the speed view whenever the new data arrives in the layer. The serving layer when queried, merges both the speed and batch ...