Chapter 3
Manage and develop data processing for Azure Data Solutions
The Azure ecosystem offers many options to process data at scale. Services like Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Stream Analytics are very versatile, and are typically found in a modern data warehouse architecture.
The most common types of workloads in modern data warehouse architectures are batch processing and streaming. While both gather data from one or more sources, process it, and load it into a destination sink, they have different traits and require specific approaches.
Batch processing usually occurs on a schedule, typically at night to avoid affecting operations on source systems. Data stores that are fully operational 24/7 ...
Get Microsoft Azure Data Solutions - An Introduction now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
