Data Lake for Enterprises

YARN

A handy addition to Hadoop (as against Hadoop 1.x) is the resource negotiator YARN, enabling Hadoop to utilize resources in a dynamic fashion, allowing applications to do the job rather than figuring out their impact on the resources. It allows Hadoop to effectively and efficiently use each of the nodes in a cluster. YARN in Hadoop 2.x is also called MR V2 (MapReduce V2).

The following figure shows YARN’s architecture and its components in detail along with how it works:

Figure 10: YARN (MR V2) architecture showing off its components

These are the important components constituting the YARN architecture:

• ResourceManager (RM): This is ...