Chapter 18. Lambda Architecture in depth

This chapter covers

  • Revisiting the Lambda Architecture
  • Incremental batch processing
  • Efficiently managing resources in batch workflows
  • Merging logic between batch and realtime views

In chapter 1 you were introduced to the Lambda Architecture and its general-purpose approach for implementing any data system. Every chapter since then has dived into the details of the various components of the Lambda Architecture. As you’ve seen, there’s a lot involved in building Big Data systems that not only scale, but are robust and easy to understand as well.

Now that you’ve had a chance to dive into all the different layers of the Lambda Architecture, let’s use that newfound knowledge to review the Lambda Architecture ...

Get Big Data now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.