O'Reilly logo

Mastering Mesos by Akhil Das, Dipa Dubhashi

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Chapter 8. Mesos Big Data Frameworks

This chapter is a guide to deploy important big data processing frameworks, such as Hadoop, Spark, Storm, and Samza, on top of Mesos.

Hadoop on Mesos

This section will introduce Hadoop, explain how to set up the Hadoop stack on Mesos, and discuss the problems commonly encountered while setting up the stack.

Introduction to Hadoop

Hadoop was developed by Mike Cafarella and Doug Cutting in 2006 to manage the distribution for the Nutch project. The project was named after Doug's son's toy elephant.

The following modules make up the Apache Hadoop framework:

  • Hadoop Common: This has the common libraries and utilities required by other modules
  • Hadoop Distributed File System (HDFS): This is a distributed, scalable filesystem ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required