6 Real-time data processing and analytics

This chapter covers

  • Defining real-time processing and real-time analytics
  • Organizing data in fast storage
  • Understanding typical real-time data transformation scenarios
  • Organizing data for real-time use
  • Translating common data transformations into real-time processing
  • Comparing real-time processing services

In this chapter, we’ll help you get a clear understanding of real-time or streaming data—one of the most popular features of a modern data platform.

We’ll cover the difference between real-time ingestion and real-time processing and walk through some examples of when to use one or both, showing different data platform designs.

We’ll also go deeper into how streaming data is organized—with producers, ...

Get Designing Cloud Data Platforms now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.