Scalable Data Architecture with Java

7

Core Architectural Design Patterns

In the previous chapters, we learned how to architect data engineering solutions for both batch-based and real-time processing using specific use cases. However, we haven’t discussed the various options available concerning architectural design patterns for batch and real-time stream processing engines.

In this chapter, we will learn about a few commonly used architectural patterns for data engineering problems. We will start by learning about a few common patterns in batch-based data processing and common scenarios where they are used. Then, we will learn about various streaming-based processing patterns in modern data architectures and how they can help solve business problems. We will also discuss the ...