September 2020
Intermediate
1h 29m
English
on-demand course
Microsoft PolyBase Hadoop and Blob Storage: Processing Big Data and Cloud Objects
with Kevin Feasel
Closed Captioning available in English
Overview
This video dives into Microsoft SQL Server's PolyBase feature for virtualizing data from Apache Hadoop and Azure Blob Storage into SQL Server. From this video you will learn how to configure SQL Server and PolyBase to connect to Azure Blob Storage, including how to make connections to public and secured blob containers. You’ll also learn how to make connections to Hadoop clusters and query data that is stored in Hadoop.
The video begins by showing how to read from and insert data into Azure Blob Storage. From there, you will learn how to connect PolyBase to a Hadoop cluster, whether in Cloudera’s distribution of Hadoop or the Hortonworks Data Platform. Once connected, you will learn how to query data in Hadoop using two methods: streaming and predicate pushdown. Finally, the video provides key tips on troubleshooting Hadoop integrations, including tips on where to look for log data as well as common configuration and data issues.
What You Will Learn
- Connect to Azure Blob Storage and Hadoop clusters from SQL Server
- Uncover configuration options needed to connect to a Hadoop cluster
- Use predicate pushdown to create MapReduce jobs which offload work to a Hadoop cluster
- Write data to Hadoop and Azure Blob Storage using T-SQL from SQL Server
- Troubleshoot common errors when connecting to Hadoop or Azure Blob Storage
Who This Video Is For
Data platform specialists who need to work on multiple data platforms but want to use one unifying language to tie them together. Viewers should be familiar with SQL Server and the T-SQL language, and should be familiar with the content from the prior video in the series, PolyBase Concepts and Configuration.
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Watch now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.