O'Reilly logo

Hadoop Operations and Cluster Management Cookbook by Shumin Guo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Configuring SecondaryNameNode

Hadoop NameNode is a single point of failure. By configuring SecondaryNameNode, the filesystem image and edit log files can be backed up periodically. And in case of NameNode failure, the backup files can be used to recover the NameNode. In this recipe, we will outline steps to configure SecondaryNameNode.

Getting ready

We assume that Hadoop has been configured correctly.

Log in to the master node from the cluster administration machine using the following command:

ssh hduser@master

How to do it...

Perform the following steps to configure SecondaryNameNode:

  1. Stop the cluster using the following command:
    stop-all.sh
    
  2. Add or change the following into the file $HADOOP_HOME/conf/hdfs-site.xml:
    <property> <name>fs.checkpoint.dir</name> ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required