O'Reilly logo

Hadoop Operations and Cluster Management Cookbook by Shumin Guo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Configuring Hadoop daemon logging

System logging plays an important role in dealing with performance and security problems. In addition, the logging information can be used analytically to tune the performance of a Hadoop cluster. In this recipe, we will show you how to configure Hadoop logging.

Getting ready

We assume that our Hadoop cluster has been properly configured.

How to do it...

Perform the following steps to configure Hadoop logging:

  1. Log in to the master node with the following command from the Hadoop administrator machine:
    ssh hduser@master
    
  2. Check the current logging level of JobTracker with the following command:
    hadoop daemonlog -getlevel master:50030 org.apache.hadoop.mapred.JobTracker
    

    We will get an output similar to the following:

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required