Azure Data Factory by Example: Practical Implementation for Data Engineers

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2024

R. SwinbankAzure Data Factory by Examplehttps://doi.org/10.1007/979-8-8688-0218-8_1

1. Creating an Azure Data Factory Instance

Richard Swinbank¹  

(1)

Tewkesbury, UK

 

A major responsibility of the data engineer is the development and management of extract, transform, and load (ETL) and other data integration workloads. Real-time integration workloads process data as it is generated – for example, a transaction being recorded at a point-of-sale terminal or a sensor measuring the temperature in a data center. In contrast, batch integration workloads run at intervals, usually processing data produced since the previous batch run.

Azure Data Factory (ADF) is Microsoft’s ...