Apache Hadoop YARN LiveLessons (Video Training)

Apache Hadoop YARN LiveLessons (Video Training)

by
Released December 2013
Publisher(s): Addison-Wesley Professional
ISBN: 0133811069

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to live online training experiences, plus books, videos, and digital content from O’Reilly and nearly 200 trusted publishing partners.

Start your free trial

Video description

Apache Hadoop YARN Fundamentals LiveLessonsis the first complete video training course on the basics of Apache Hadoop version 2 with YARN. The tutorial begins with MapReduce and Big Data fundamentals and moves to YARN design, installation (laptop, cluster, and cloud), administration, running applications (MapReduce2, Pig and Hive), writing new applications, and useful frameworks. Additional coverage of Ambari, Ganglia, Nagios and the Hortonworks HDP is provided.

The source code repository for this LiveLesson can be found at www.clustermonkey.net/download/LiveLessons/Hadoop_YARN_Fundamentals/.

About the Instructor

Douglas Eadlineis the instructor for this essential Big Data LiveLessons. Eadline is a practitioner and writer in the Linux Cluster community and previously authored Hadoop Fundamentals LiveLessons which focused on many of the basic aspects of Hadoop processing. Eadline is a co-authorof the companion book Apache Hadoop YARN, Moving beyond MapReduce and Batch Processing with Apache Hadoop 2. Doug provides a clear and complete introduction to many of the important Apache Hadoop YARN tasks and topics. In addition to a sound background on Hadoop design, he provides several installation scenarios including a laptop, cluster, and cloud. The Ambari graphic installation tool is explained and used for both installation and administration. You will also learn how to write your own YARN applications and what is needed to run Hadoop version 1 applications. Some familiarity with Java, Hadoop MapReduce and the Hadoop Distributed File System is helpful but not necessary. All example code and Lesson notes are available for download.

Table of contents

  1. Introduction
    1. Introduction to Apache Hadoop YARN LiveLessons 00:03:47
  2. Lesson 1: Apache Hadoop Yarn Background Concepts
    1. Learning objectives 00:00:43
    2. 1.1 Review Apache Hadoop version 1 00:12:35
    3. 1.2 Understand what Apache Hadoop YARN offers
  3. Lesson 2: Running Apache Hadoop YARN on Personal Systems
    1. Learning objectives
    2. 2.1 Install on a laptop or desktop from Apache Sources
    3. 2.2 Install on a laptop or desktop using the HDP Sandbox
    4. 2.3 Install on a small cluster
    5. 2.4 Install in the Cloud using Apache Whirr
  4. Lesson 3: Functional Description of YARN Components
    1. Learning objectives
    2. 3.1 Understand new components
    3. 3.2 Understand scheduler options
    4. 3.3 Understand the application life cycle
  5. Lesson 4: Apache Hadoop YARN Cluster Installation Methods
    1. Learning objectives
    2. 4.1 Complete a large scale scripted installation
    3. 4.2 Complete a large Apache Ambari installation—Part 1
    4. 4.2 Complete a large Apache Ambari installation—Part 2
    5. 4.3 Complete the installation of Ganglia and Nagios—Part 1
    6. 4.3 Complete the installation of Ganglia and Nagios—Part 2
  6. Lesson 5: Apache Hadoop YARN Cluster Administration Methods
    1. Learning objectives
    2. 5.1 Understand scripted administration
    3. 5.2 Understand Apache Ambari administration
    4. 5.3 Understand key administration tips
  7. Lesson 6: Running Existing Applications with Apache Hadoop YARN
    1. Learning objectives
    2. 6.1 Understand the MapReduce framework
    3. 6.2 Understand how to the run YARN examples
  8. Lesson 7: Using YARN Distributed Shell and Introduction to Applications
    1. Learning objectives
    2. 7.1 Understand how to use Distributed Shell
    3. 7.2 Understand how to write a simple YARN application using Distributed Shell
  9. Lesson 8: Exploring Apache Hadoop YARN Application Frameworks
    1. Learning objectives
    2. 8.1 Understand the other YARN frameworks
  10. Summary
    1. Summary of Apache Hadoop YARN LiveLessons

Product information

  • Title: Apache Hadoop YARN LiveLessons (Video Training)
  • Author(s):
  • Release date: December 2013
  • Publisher(s): Addison-Wesley Professional
  • ISBN: 0133811069