Video description
Azure Data Factory (ADF) is a component of Microsoft's Cortana Intelligence Suite. It is a cloud-based data movement service that allows you to prepare, analyze, publish, and monitor your data, and run pipelines on a specified schedule. In this video, you’ll learn how to utilize all elements of the ADF to help you manage data at scale in the cloud and on premises. We’ll cover how to set up your environment to transfer data between your on-premise server, the Azure data store, and your Azure Machine Learning models, and how to use visualizations that indicate the lineage and dependencies between your data pipelines. You’ll also learn how to set up monitoring alerts so you can identify issues easily and quickly.
- Understand how the ADF fits within the overall Cortana Intelligence Suite
- Discover how the ADF is used to load and manage data
- Learn to utilize visualizations that indicate lineage and dependencies between data pipelines
- Discover how to set up monitoring alerts to identify pinpoint issues in the pipeline
- Learn to create an ADF instance and load data into a SQL data warehouse using ADF
- Explore methods for loading data into a machine learning model
- Learn to create datasets, data pipelines, and linked services using ADF
Chris Testa-O'Neill works with the Cortana Intelligence Suite (CIS) and Microsoft R Server product lines as part of Microsoft's Analytics and Data Science team. A long term contributor to SQL Bits, Chris was a Microsoft Most Valuable Professional for six years and has authored a wide range of Microsoft Learning Experience courses since 2007.
Table of contents
- Introduction to Using Azure Data Factory for Information Management
- Understanding the Azure Data Factory (ADF) as part of the Cortana Intelligence Suite
- Introducing the Azure Data Factory and Its logical flow
- Create an Azure Data Factory Instance
- Understanding the Azure Data Factory Process
- Understanding Linked Services Using Azure Data Factory
- How to Define Datasets and Timeslices Using Azure Data Factory
- Activities to Transform or Analyze Data using Azure Data Factory
- Creating Linked Services and Datasets Using Azure Data Factory
- Final Thoughts on Using Azure Data Factory for Information Management
Product information
- Title: Information Management Using Azure Data Factory
- Author(s):
- Release date: July 2017
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 9781491989630
You might also like
book
Quick Start Guide to Azure Data Factory, Azure Data Lake Server, and Azure Data Warehouse
With constantly expanding options such as Azure Data Lake Server (ADLS) and Azure SQL Data Warehouse …
book
Hands-On Data Warehousing with Azure Data Factory
Leverage the power of Microsoft Azure Data Factory v2 to build hybrid data solutions About This …
video
Professional Azure SQL Database Administration
Azure SQL Database is the cloud version of SQL Server. It differs in terms of management, …
book
Azure Data Factory Cookbook
Solve real-world data problems and create data-driven workflows for easy data movement and processing at scale …