ApplicationMaster (AM)
Once a job is scheduled by the ResourceManager, it no longer keeps track of its status and progress. This results in the ResourceManager being able to support completely different kinds of application in the cluster without worrying about the internal communication and logic of the application.
Whenever an application is submitted, the ResourceManager creates a new ApplicationMaster for that application, which is then responsible for negotiating resources from ResourceManager and communicating with the NodeMangers for the resources. NodeManager provides resources in the form of resource containers, which are abstractions for resource allocation, where you can tell how much CPU, memory, and so on is required.
Once the ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access