O'Reilly logo

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

OpenStack Sahara Essentials

Book Description

Integrate, deploy, rapidly configure, and successfully manage your own big data-intensive clusters in the cloud using OpenStack Sahara

About This Book

  • A fast paced guide to help you utilize the benefits of Sahara in OpenStack to meet the Big Data world of Hadoop.
  • A step by step approach to simplify the complexity of Hadoop configuration, deployment and maintenance.

Who This Book Is For

This book targets data scientists, cloud developers and Devops Engineers who would like to become proficient with OpenStack Sahara. Ideally, this book is well suitable for readers who are familiars with databases, Hadoop and Spark solutions. Additionally, a basic prior knowledge of OpenStack is expected. The readers should also be familiar with different Linux boxes, distributions and virtualization technology.

What You Will Learn

  • Integrate and Install Sahara with OpenStack environment
  • Learn Sahara architecture under the hood
  • Rapidly configure and scale Hadoop clusters on top of OpenStack
  • Explore the Sahara REST API to create, deploy and manage a Hadoop cluster
  • Learn the Elastic Processing Data (EDP) facility to execute jobs in clusters from Sahara
  • Cover other Hadoop stable plugins existing supported by Sahara
  • Discover different features provided by Sahara for Hadoop provisioning and deployment
  • Learn how to troubleshoot OpenStack Sahara issues

In Detail

The Sahara project is a module that aims to simplify the building of data processing capabilities on OpenStack.

The goal of this book is to provide a focused, fast paced guide to installing, configuring, and getting started with integrating Hadoop with OpenStack, using Sahara.

The book should explain to users how to deploy their data-intensive Hadoop and Spark clusters on top of OpenStack. It will also cover how to use the Sahara REST API, how to develop applications for Elastic Data Processing on Openstack, and setting up hadoop or spark clusters on Openstack.

Style and approach

This book takes a step by step approach teaching how to integrate, deploy and manage data using OpenStack Sahara. It will teach how the OpenStack Sahara is beneficial by simplifying the complexity of Hadoop configuration, deployment and maintenance.

Downloading the example code for this book. You can download the example code files for all Packt books you have purchased from your account at http://www.PacktPub.com. If you purchased this book elsewhere, you can visit http://www.PacktPub.com/support and register to have the code file.

Table of Contents

  1. OpenStack Sahara Essentials
    1. Table of Contents
    2. OpenStack Sahara Essentials
    3. Credits
    4. About the Author
    5. About the Reviewer
    6. www.PacktPub.com
      1. eBooks, discount offers, and more
        1. Why subscribe?
    7. Preface
      1. What this book covers
      2. What you need for this book
      3. Who this book is for
      4. Conventions
      5. Reader feedback
      6. Customer support
        1. Errata
        2. Piracy
        3. Questions
    8. 1. The Essence of Big Data in the Cloud
      1. It is all about data
        1. The dimensions of big data
        2. The big challenge of big data
        3. The revolution of big data
        4. A key of big data success
          1. Use case: Elastic MapReduce
      2. OpenStack crossing big data
        1. Sahara: bringing big data to the cloud
          1. Sahara in OpenStack
          2. The Sahara OpenStack mission
            1. The Sahara's architecture
      3. Summary
    9. 2. Integrating OpenStack Sahara
      1. Preparing the test infrastructure environment
        1. OpenStack test topology environment
        2. OpenStack test networking layout
        3. OpenStack test environment design
      2. Installing OpenStack
        1. Network requirements
        2. System requirements
        3. Running the RDO installation
      3. Integrating Sahara
        1. Installing and configuring OpenStack Sahara
        2. Installing the Sahara user interface
      4. Summary
    10. 3. Using OpenStack Sahara
      1. Planning a Hadoop deployment
        1. Assigning Hadoop nodes
        2. Sahara provisioning plugins
      2. Creating a Hadoop cluster
        1. Preparing the image from Horizon
        2. Preparing the image using CLI
        3. Creating the Node Group Template
          1. Creating the Node Group Template in Horizon
          2. Creating a Node Group Template using CLI
        4. Creating the Node Cluster Template
          1. Creating the Node Cluster Template with Horizon
          2. Creating the Node Cluster Template using CLI
        5. Launching the Hadoop cluster
          1. Launching the Hadoop cluster with Horizon
          2. Launching the Hadoop cluster using the CLI
      3. Summary
    11. 4. Executing Jobs with Sahara
      1. Job glossary in Sahara
        1. Job binaries in Sahara
          1. Jobs in Sahara
      2. Running jobs in Sahara
        1. Executing jobs via Horizon
        2. Executing jobs using the Sahara RESTful API
        3. API authentication
        4. Launching an EDP job
          1. Registering a Spark image using REST API
          2. Creating Spark node group templates
          3. Creating a Spark cluster template
          4. Launching the Spark cluster
          5. Creating a job binary
          6. Creating a Spark job template
          7. Executing the Spark job
          8. Extending the Spark job
      3. Summary
    12. 5. Discovering Advanced Features with Sahara
      1. Sahara plugins
        1. Vanilla Apache Hadoop
          1. Building an image for the Apache Vanilla plugin
          2. Vanilla Apache requirements and limitations
        2. Hortonworks Data Platform plugin
          1. Building an image for the HDP plugin
          2. HDP requirements and limitations
        3. Cloudera Distribution Hadoop plugin
          1. Building an image for the CDH plugin
          2. CDH requirements and limitations
        4. Apache Spark plugin
          1. Building an image for the Spark plugin
          2. Spark requirements and limitations
        5. Affinity and anti-affinity
          1. Anti-affinity in action
      2. Boosting Elastic Data Processing performance
      3. Defining the network
      4. Increasing data reliability
      5. Summary
    13. 6. Hadoop High Availability Using Sahara
      1. HDP high-availability support
        1. Minimum requirements for the HA Hadoop cluster in Sahara
        2. HA Hadoop cluster templates
      2. CDH high-availability support
      3. Summary
    14. 7. Troubleshooting
      1. Troubleshooting OpenStack
        1. OpenStack debug tool
        2. Troubleshooting SELinux
        3. Troubleshooting identity
        4. Troubleshooting networking
      2. Troubleshooting data processing
        1. Debugging Sahara
        2. Logging Sahara
        3. Troubleshooting missing services
        4. Troubleshooting cluster creation
        5. Troubleshooting user quota
        6. Troubleshooting cluster scaling
        7. Troubleshooting cluster access
      3. Summary
    15. Index