Streaming Databases

Chapter 9. The Streaming Plane

In the previous chapter, we explored the existing real-time systems in today’s ecosystem and introduced three distinct data planes: operational, analytical, and streaming. Both the operational and analytical planes predominantly deal with data at rest, emphasizing static information. In contrast, the streaming plane stands out as the sole realm characterized by data in motion.

In this chapter, we will be delving into the streaming plane and how data architects and engineers can begin to think about its role in simplifying real-time analytics.

We have consistently interlinked terms such as asynchronous, data in motion, and streaming, treating them as interchangeable expressions. They are synonymous with long-running processes that do continuous transformations, simplifying and quickening the retrieval of real-time analytical data for applications.

Figure 9-1 shows only the streaming plane portion of the Venn diagram shown throughout Chapter 7. We will refer to this diagram throughout this chapter.

Figure 9-1. Streaming plane from the Venn diagram from Chapter 7

This chapter will examine several pivotal topics to understand the intricacies of real-time data processing on the streaming plane. Among the focal points is the concept of analytics on the operational plane (or operational analytics), which delves into the practice of performing analytical ...