O'Reilly logo

Hadoop 2.x Administration Cookbook by Gurmukh Singh

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Tuning the network

In this recipe, we will look at tuning the network for better performance. This recipe is very much limited to the operating system parameters and not the optimization of routers or switches.

Getting ready

To step through the recipe in this section, we need at least one node to test and to make the configuration changes, and the same can be applied to all the nodes in the cluster.

How to do it...

  1. Connect to a node which at a later stage will be used to install Hadoop. We are using the node master1.cyrus.com.
  2. Switch as user root or have sudo privileges.
  3. Edit the /etc/sysctl.conf file to tune parameters which affect the network performance. The parameters shown in the next steps need to be changed in this file.
  4. Change the port range ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required