In this section we will talk about configuring node labels in a Hadoop cluster. Every request to YARN goes through the Resource Manager therefore the first step is to enable node label configuration to resource manager:
- Enabling node label and setting node label path: The YARN-site.xml file contains the configuration related to YARN, as follows:
<property> <name>YARN.node-labels.enabled</name> <value>true</value> <description>Enabling node label feature</description> </property> <property> <name>YARN.node-labels.fs-store.root-dir</name> <value>http://namemoderpc:port/YARN/packt/node.labels</value> <description>The path to the node labels file.</description> </property>
- Creating directory structure on HDFS: The ...
