In the previous chapter, you learned about Mapping Data Flows in ADF and how to design an ETL pattern for data quality checking, cleaning, and prep. Now that we have a working data flow artifact, we need to execute it from a pipeline. Previously, we were able to peek at samples of the results while designing our logic. This was useful from the perspective of unit testing. The next step in building your ETL solution in ADF will be to test the data flow inside of a pipeline ...
© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2022
M. KromerMapping Data Flows in Azure Data Factoryhttps://doi.org/10.1007/978-1-4842-8612-8_55. Common ETL Pipeline Practices in ADF with Mapping Data Flows
Mark Kromer1
(1)
SNOHOMISH, WA, USA
Get Mapping Data Flows in Azure Data Factory: Building Scalable ETL Projects in the Microsoft Cloud now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
