In this chapter, we explored Apache Hadoop in depth and covered its components, such as HDFS, YARN, and so on, that are part of a Hadoop cluster. We also learned about the subcomponents of an HDFS cluster and a YARN cluster and the ways in which they interact with each other. Then, we walked through setting up a single-node Hadoop cluster.
We also introduced Storm-YARN, which was the object of this chapter. Storm-YARN enables you to run Storm topologies on a Hadoop cluster. This helps from the manageability and operations points of view. Finally, we learned how to deploy a topology on Storm running over YARN.
In the next chapter, we will see how Storm can integrate with other Big Data technologies, such as HBase and Redis.