Streaming Data

Chapter 6. Storing the analyzed or collected data

This chapter covers

• Understanding why we need to store the data
• Learning what to store
• Choosing your storage solution

Up to this point we have spent time discussing the architecture and the algorithms commonly used in stream-processing applications. This chapter focuses on what to do with the data after you have processed it. Our focus will be less on the performance of any persistent store we use and more on how to choose a persistent store if one is needed for your application.

First let’s recap where we are in the overall architecture. Figure 6.1 shows our over-arching architecture with the focus of this chapter highlighted.

Figure 6.1. Overall streaming architecture blueprint with ...