O'Reilly logo

Learning YARN by Shrey Mehrotra, Akhil Arora

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Understanding NodeManager

The NodeManager node is the worker node for YARN and is responsible for updating the resource availability on a node to ResourceManager. It is also responsible for monitoring the health of a node and for executing containers for an application.

The following diagram shows various subcomponents of the NodeManager daemon followed by a detailed description of these subcomponents:

Understanding NodeManager

Status updates

The resource capability of a cluster is calculated as the sum of the capabilities of all NodeManager nodes. To utilize cluster resources efficiently, it is important to keep track of all resources across the cluster. NodeManager nodes ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required