6
Developing a Stream Processing Solution
Building on the foundation of Spark, Azure Data Factory (ADF), and Synapse pipelines, Chapter 5, Developing a Batch Processing Solution, equipped you to effectively process large amounts of data.
In this chapter, you will cover another data method, stream processing solutions, also known as real-time processing systems. Similar to batch processing, stream processing is another important segment of data pipelines. This chapter will focus on introducing the concepts and technologies involved in building a stream processing system. You will be learning about technologies such as Azure Stream Analytics (ASA), Azure Event Hubs, and Spark (from a streaming perspective).
You will learn how to build end-to-end ...
Get Azure Data Engineer Associate Certification Guide - Second Edition now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
