Big Data

Chapter 18. Lambda Architecture in depth

This chapter covers

• Revisiting the Lambda Architecture
• Incremental batch processing
• Efficiently managing resources in batch workflows
• Merging logic between batch and realtime views

In chapter 1 you were introduced to the Lambda Architecture and its general-purpose approach for implementing any data system. Every chapter since then has dived into the details of the various components of the Lambda Architecture. As you’ve seen, there’s a lot involved in building Big Data systems that not only scale, but are robust and easy to understand as well.

Now that you’ve had a chance to dive into all the different layers of the Lambda Architecture, let’s use that newfound knowledge to review the Lambda Architecture ...