O'Reilly logo

Learning YARN by Shrey Mehrotra, Akhil Arora

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

The integration of Storm with YARN

Storm is a distributed computational and processing framework, which was developed to process streaming data in real time. It has been released as open source. It is useful for continuous monitoring of processes and running machine learning algorithms. Storm can process millions of records per second on a single node and is widely used for low-latency processing.

Storm has two main services: Nimbus (master) and Supervisor (slave). Storm requires Zookeeper component for co-ordination between the Nimbus and Supervisor services. The Storm bundle contains a storm.yaml configuration file. The file contains information related to the Nimbus server and the Zookeeper quorum. Similar to Spark, this book does not focus ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required