Understanding Azure Data Factory: Operationalizing Big Data and Advanced Analytics Solutions

© Sudhir Rawat and Abhishek Narain 2019

Sudhir Rawat and Abhishek NarainUnderstanding Azure Data Factoryhttps://doi.org/10.1007/978-1-4842-4122-6_6

6. Managing Flow

Sudhir Rawat¹  and Abhishek Narain²

(1)

Bangalore, India

(2)

Shanghai, China

 

In previous chapters, you focused on the Azure Data Factory features and learned how to build an end-to-end pipeline. The focus of this chapter will be how to set up a pipeline flow and why it’s important for any organization.

Why Managing Flow Is Important

So far, you can build an Azure Data Factory pipeline and run it. This chapter will discuss expressions, functions, and activities to control the data flow in an ADF pipeline. Why do you need to manage the flow? An SSIS developer knows the importance of control ...