10. Apache Hadoop YARN Application Example

In describing how to write a YARN application, it can be helpful to review a bit of YARN’s architecture. YARN is a platform for allowing distributed applications to take full advantage of the resources that YARN has deployed. Currently, resources can be things like CPU, memory, and data. Many developers coming from a server-side application development background or from a classic MapReduce developer background may be accustomed to a certain flow in the development and deployment cycle. In this chapter, the application development life cycle in YARN will be described and the unique requirements of a YARN application will be demonstrated. YARN applications can launch containers encapsulating virtually ...

Get Apache Hadoop™ YARN: Moving beyond MapReduce and Batch Processing with Apache Hadoop™ 2 now with the O’Reilly learning platform.

O’Reilly members experience live online training, plus books, videos, and digital content from nearly 200 publishers.