© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2021
R. SwinbankAzure Data Factory by Examplehttps://doi.org/10.1007/978-1-4842-7029-5_7

7. Data Flows

Richard Swinbank1  
(1)
Birmingham, UK
 

The Copy data activity is a powerful tool for moving data between data storage systems, but it has limited support for data transformation. Columns can be added to the activity’s source configuration, or removed by excluding them from the source to sink mapping, but the activity does not support manipulation of individual rows or allow data sources to be combined or separated.

The Azure platform supports a number of tools capable of large-scale data transformation, one of which is Azure Databricks. Databricks is a cloud-based ...

Get Azure Data Factory by Example: Practical Implementation for Data Engineers now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.