O'Reilly logo

Hadoop Operations and Cluster Management Cookbook by Shumin Guo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Decommissioning DataNode

Similar to TaskTracker, there are situations when we need to temporarily disable a DataNode from the cluster, for example, because the storage space of the DataNode has been used up. In this recipe, we will outline steps to decommission a DataNode from a live Hadoop cluster.

Getting ready

We assume that our Hadoop has been configured properly.

Log in to the master node from the cluster administrator machine with the following command:

ssh hduser@master

Tip

For illustration purpose, we assume to decommission DataNode on host slave1 from our running Hadoop cluster.

How to do it...

Perform the following steps to decommission a live DataNode:

  1. Create the file $HADOOP_HOME/conf/dfs-exclude.txt with the following content:
    slave1

    Note ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required