Video description
Azure Data Factory (ADF) is a component of Microsoft's Cortana Intelligence Suite. It is a cloud-based data movement service that allows you to prepare, analyze, publish, and monitor your data, and run pipelines on a specified schedule. In this video, you’ll learn how to utilize all elements of the ADF to help you manage data at scale in the cloud and on premises. We’ll cover how to set up your environment to transfer data between your on-premise server, the Azure data store, and your Azure Machine Learning models, and how to use visualizations that indicate the lineage and dependencies between your data pipelines. You’ll also learn how to set up monitoring alerts so you can identify issues easily and quickly.
- Understand how the ADF fits within the overall Cortana Intelligence Suite
- Discover how the ADF is used to load and manage data
- Learn to utilize visualizations that indicate lineage and dependencies between data pipelines
- Discover how to set up monitoring alerts to identify pinpoint issues in the pipeline
- Learn to create an ADF instance and load data into a SQL data warehouse using ADF
- Explore methods for loading data into a machine learning model
- Learn to create datasets, data pipelines, and linked services using ADF
Chris Testa-O'Neill works with the Cortana Intelligence Suite (CIS) and Microsoft R Server product lines as part of Microsoft's Analytics and Data Science team. A long term contributor to SQL Bits, Chris was a Microsoft Most Valuable Professional for six years and has authored a wide range of Microsoft Learning Experience courses since 2007.
Table of contents
- Introduction to Using Azure Data Factory for Information Management
- Understanding the Azure Data Factory (ADF) as part of the Cortana Intelligence Suite
- Introducing the Azure Data Factory and Its logical flow
- Create an Azure Data Factory Instance
- Understanding the Azure Data Factory Process
- Understanding Linked Services Using Azure Data Factory
- How to Define Datasets and Timeslices Using Azure Data Factory
- Activities to Transform or Analyze Data using Azure Data Factory
- Creating Linked Services and Datasets Using Azure Data Factory
- Final Thoughts on Using Azure Data Factory for Information Management
Product information
- Title: Information Management Using Azure Data Factory
- Author(s):
- Release date: July 2017
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 9781491989630
You might also like
book
Head First Design Patterns, 2nd Edition
You know you don’t want to reinvent the wheel, so you look to design patterns—the lessons …
book
Designing Data-Intensive Applications
Data is at the center of many challenges in system design today. Difficult issues need to …
book
Building Microservices, 2nd Edition
Distributed systems have become more fine-grained as organizations shift from code-heavy monolithic applications to smaller, self-contained …
book
Fundamentals of Software Architecture
Salary surveys worldwide regularly place software architect in the top 10 best jobs, yet no real …