O'Reilly logo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Apache Hadoop YARN LiveLessons (Video Training)

Apache Hadoop YARN LiveLessons (Video Training)

by Vinod Vavilapalli, Doug Eadline, Arun Murthy
Publisher: Addison-Wesley Professional
Release Date: December 2013
ISBN: 9780133811063
View table of contents
Start watching

Video Description

Apache Hadoop YARN Fundamentals LiveLessonsis the first complete video training course on the basics of Apache Hadoop version 2 with YARN. The tutorial begins with MapReduce and Big Data fundamentals and moves to YARN design, installation (laptop, cluster, and cloud), administration, running applications (MapReduce2, Pig and Hive), writing new applications, and useful frameworks. Additional coverage of Ambari, Ganglia, Nagios and the Hortonworks HDP is provided.

The source code repository for this LiveLesson can be found at www.clustermonkey.net/download/LiveLessons/Hadoop_YARN_Fundamentals/.

About the Instructor

Douglas Eadlineis the instructor for this essential Big Data LiveLessons. Eadline is a practitioner and writer in the Linux Cluster community and previously authored Hadoop Fundamentals LiveLessons which focused on many of the basic aspects of Hadoop processing. Eadline is a co-authorof the companion book Apache Hadoop YARN, Moving beyond MapReduce and Batch Processing with Apache Hadoop 2. Doug provides a clear and complete introduction to many of the important Apache Hadoop YARN tasks and topics. In addition to a sound background on Hadoop design, he provides several installation scenarios including a laptop, cluster, and cloud. The Ambari graphic installation tool is explained and used for both installation and administration. You will also learn how to write your own YARN applications and what is needed to run Hadoop version 1 applications. Some familiarity with Java, Hadoop MapReduce and the Hadoop Distributed File System is helpful but not necessary. All example code and Lesson notes are available for download.

Table of Contents

  1. Introduction
    1. Introduction to Apache Hadoop YARN LiveLessons 00:03:47
  2. Lesson 1: Apache Hadoop Yarn Background Concepts
    1. Learning objectives 00:00:43
    2. 1.1 Review Apache Hadoop version 1 00:12:35
    3. 1.2 Understand what Apache Hadoop YARN offers 00:20:10
  3. Lesson 2: Running Apache Hadoop YARN on Personal Systems
    1. Learning objectives 00:01:08
    2. 2.1 Install on a laptop or desktop from Apache Sources 00:25:21
    3. 2.2 Install on a laptop or desktop using the HDP Sandbox 00:10:09
    4. 2.3 Install on a small cluster 00:27:49
    5. 2.4 Install in the Cloud using Apache Whirr 00:16:05
  4. Lesson 3: Functional Description of YARN Components
    1. Learning objectives 00:00:35
    2. 3.1 Understand new components 00:13:25
    3. 3.2 Understand scheduler options 00:06:07
    4. 3.3 Understand the application life cycle 00:07:59
  5. Lesson 4: Apache Hadoop YARN Cluster Installation Methods
    1. Learning objectives 00:00:38
    2. 4.1 Complete a large scale scripted installation 00:25:02
    3. 4.2 Complete a large Apache Ambari installation—Part 1 00:16:10
    4. 4.2 Complete a large Apache Ambari installation—Part 2 00:26:34
    5. 4.3 Complete the installation of Ganglia and Nagios—Part 1 00:11:34
    6. 4.3 Complete the installation of Ganglia and Nagios—Part 2 00:26:14
  6. Lesson 5: Apache Hadoop YARN Cluster Administration Methods
    1. Learning objectives 00:00:35
    2. 5.1 Understand scripted administration 00:11:13
    3. 5.2 Understand Apache Ambari administration 00:32:57
    4. 5.3 Understand key administration tips 00:16:25
  7. Lesson 6: Running Existing Applications with Apache Hadoop YARN
    1. Learning objectives 00:00:40
    2. 6.1 Understand the MapReduce framework 00:17:32
    3. 6.2 Understand how to the run YARN examples 00:16:09
  8. Lesson 7: Using YARN Distributed Shell and Introduction to Applications
    1. Learning objectives 00:00:37
    2. 7.1 Understand how to use Distributed Shell 00:13:26
    3. 7.2 Understand how to write a simple YARN application using Distributed Shell 00:41:16
  9. Lesson 8: Exploring Apache Hadoop YARN Application Frameworks
    1. Learning objectives 00:00:39
    2. 8.1 Understand the other YARN frameworks 00:15:31
  10. Summary
    1. Summary of Apache Hadoop YARN LiveLessons 00:03:39