12. Apache Hadoop YARN Frameworks

One of the most exciting aspects of YARN is its ability to support multiple programming models and application frameworks. In Hadoop version 1, the only processing model available to users is MapReduce. In Hadoop version 2, MapReduce is separated from the resource management layer of Hadoop and placed into its own application framework. YARN forms a resource management platform, which provides services such as scheduling, fault monitoring, data locality, and more to Map-Reduce and other frameworks.

The following is a brief survey of emerging open-source frameworks that are being developed to run under YARN. As of this writing, there are many YARN frameworks under active development and the framework landscape ...

Get Apache Hadoop™ YARN: Moving beyond MapReduce and Batch Processing with Apache Hadoop™ 2 now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.