O'Reilly logo

Hadoop Operations and Cluster Management Cookbook by Shumin Guo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Configuring Hadoop audit logging

Audit logging might be required for data processing systems such as Hadoop. In Hadoop, audit logging has been implemented using the Log4j Java logging library at the INFO logging level. By default, Hadoop audit logging is disabled. This recipe will guide you through the steps to configure Hadoop audit logging.

Getting ready

We assume that our Hadoop cluster has been configured properly.

Log in to the master node from the administrator machine using the following command:

ssh hduser@master

How to do it...

Perform the following steps to configure Hadoop audit logging:

  1. Enable audit logging by changing the following line in the $HADOOP_HOME/conf/log4j.properties file from:
    log4j.logger.org.apache.hadoop.hdfs.server.namenode.FSNamesystem.audit=WARN ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required