Node types
A Hadoop cluster has one MasterNode and one to many slave nodes. The MasterNode operates what is called the NameNode. The role of the NameNode is to track which other nodes are healthy and some other key information about the cluster, such as file locations. There is also the role of the ResourceManager, one per cluster, which may or may not be on the same server. You will learn more about the NameNode in the HDFS section and more about the ResourceManager in the YARN section.
The rest of the machines in the cluster act as both DataNode and NodeManager. These are the workers. This is where, you guessed it, the data is distributed and where the distributed computing happens. There are several types of slave node that serve different ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access