Building a Hadoop cluster in the Cloud

We saw earlier that the Cloud offers a flexible and easy way to rent resources such as servers, storage, networking, and so on. The Cloud has made it very easy for consumers with the pay-as-you-go model, but much of the complexity of the Cloud is hidden from us by the providers.

In order to better understand whether Hadoop is well suited to being on the Cloud, let's try to dig further and see how the Cloud is organized internally.

At the core of the Cloud are the following mechanisms:

  • A very large number of servers with a variety of hardware configurations
  • Servers connected and made available over IP networks
  • Large data centers to host these devices
  • Data centers spanning geographies with evolved network ...

Get Modern Big Data Processing with Hadoop now with the O’Reilly learning platform.

O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.