June 2016
Beginner to intermediate
11h 8m
English
Overview
You're new to Big Data, you've heard about Apache Spark and Apache Hadoop and you want to play. Big Data coach Rich Morrow gets you into the game via sixteen sprints (sixteen hands-on labs) across the Spark-Hadoop ball field. First, you'll create playing areas using Amazon Web Services EMR and Cloudera Quickstart VM. Then you'll install Hadoop, run basic HDFS commands, learn MapReduce, use Flume and Sqoop, run Spark and then run Spark again.
You'll play with Spark SQL, learn common MLLib usage, do analysis with Hive, ETL with Pig, and then jog through Hadoop/Cloud use cases, Hbase basics, and enterprise integration. When practice is over, you'll know Spark, it's associated modules, the Hadoop ecosystem, and the when, where, how, and why each technology is used. Working files are included, allowing you to follow along with the author throughout the lessons. Play on.
- Understand Apache Spark and why it's Big Data's fastest growing open source project
- Learn what Apache Hadoop is and how it's used in the world of Big Data
- Master the basics of Hadoop - HDFS, YARN and MapReduce
- Master the basics of Spark- Spark SQL, MLlib, Spark Streaming, Graphx and more
- Discover Sqoop, Flume, Hive, Pig, HBase, and Oozie - key components of Hadoop
- Gain direct experience with Spark and Hadoop with sixteen hands-on labs
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Watch now
Unlock full access
More than 5,000 organizations count on O’Reilly
O’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.Julian F.
I wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.Addison B.
I’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.Amir M.
I'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.