March 2017
Beginner to intermediate
1h 2m
English
Overview
Hadoop is today's most pervasive technology used in Big Data for distributing the processing of massive data sets across clusters of commodity computers. With Amazon's Elastic MapReduce service (EMR), you can rent capacity through Amazon Web Services (AWS) to store and analyze data at minimal cost on top of a real Hadoop cluster.
This course shows you how to use an EMR Hadoop cluster via a real life example where you'll analyze movie ratings data using Hive, Pig, and Oozie. It focuses on practical tips for using an EMR cluster efficiently, integrating the cluster with Amazon's S3 service, and determining the right money-saving size for a cluster. You'll learn how to interact with your cluster through the Hue Web interface, from a terminal prompt, as well as through EMR steps that can execute your scripts automatically.
- Gain experience with three high value skill sets: Hadoop, AWS, and EMR
- Save time and money by learning about the undocumented "gotchas" of AWS and EMR
- See how the experts provision EMR clusters and connect to them via SSH and web UIs
- Learn to import data into a cluster and to access external data stored on Amazon's S3
- Explore three different ways to query data using Hive and Pig
- Discover the Tez engine and see how it accelerates Hive and Pig queries
- Learn how to schedule workflows using Oozie
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Watch now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.