O'Reilly logo

Hadoop Operations and Cluster Management Cookbook by Shumin Guo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 5. Hardening a Hadoop Cluster

In this chapter, we will cover:

  • Configuring service-level authentication
  • Configuring job authorization with ACL
  • Securing a Hadoop cluster with Kerberos
  • Configuring web UI authentication
  • Recovering from NameNode failure
  • Configuring NameNode high availability
  • Configuring HDFS federation

Introduction

The security of a Hadoop cluster is critical for its availability. Hardening a Hadoop cluster includes configuring access control over resources, such as jobs, queues, and various administrative services. We will introduce NameNode High Availability (HA) for the problem of single node failure. In the end, we will introduce Hadoop federation, which federates multiple machines to expand the capacity of a cluster.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required