Manage and develop data processing for Azure Data Solutions
The Azure ecosystem offers many options to process data at scale. Services like Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Stream Analytics are very versatile, and are typically found in a modern data warehouse architecture.
The most common types of workloads in modern data warehouse architectures are batch processing and streaming. While both gather data from one or more sources, process it, and load it into a destination sink, they have different traits and require specific approaches.
Batch processing usually occurs on a schedule, typically at night to avoid affecting operations on source systems. Data stores that are fully operational 24/7 ...