Beginning Azure Synapse Analytics: Transition from Data Warehouse to Data Lakehouse

© The Author(s), under exclusive license to APress Media, LLC, part of Springer Nature 2021

B. ShiyalBeginning Azure Synapse Analyticshttps://doi.org/10.1007/978-1-4842-7061-5_7

7. Synapse Pipelines

Bhadresh Shiyal¹  

(1)

Mumbai, India

 

For any data analytics project, you will likely need to ingest data from various disparate data sources and store it in a database, a data lake, a data warehouse, or a data lakehouse. To meet these requirements, you will have to build data ingestion pipelines, which will bring data to your desired target location. In addition, once you have ingested the data, you will have to cleanse it, apply business transformations and validations, and aggregate and consolidate it so that you can generate some insights and intelligence ...