Big Data

Chapter 14. Queuing and stream processing

This chapter covers

• Single-consumer versus multi-consumer queues
• One-at-a-time stream processing
• Limitations of queues-and-workers approaches to stream processing

You’ve learned of two types of architectures for the speed layer: synchronous and asynchronous. With synchronous architectures, applications send update requests directly to the database and block until receiving a response. Such applications require the coordination of different tasks, but there’s not much to add to the discussion from an architectural standpoint. Conversely, asynchronous architectures update the speed layer databases independently from the application that created the data. How you decide to persist and process the ...