Book description
Although you don’t need a large computing infrastructure to process massive amounts of data with Apache Hadoop, it can still be difficult to get started. This practical guide shows you how to quickly launch data analysis projects in the cloud by using Amazon Elastic MapReduce (EMR), the hosted Hadoop framework in Amazon Web Services (AWS).
Authors Kevin Schmidt and Christopher Phillips demonstrate best practices for using EMR and various AWS and Apache technologies by walking you through the construction of a sample MapReduce log analysis application. Using code samples and example configurations, you’ll learn how to assemble the building blocks necessary to solve your biggest data analysis problems.
- Get an overview of the AWS and Apache software tools used in large-scale data analysis
- Go through the process of executing a Job Flow with a simple log analyzer
- Discover useful MapReduce patterns for filtering and analyzing data sets
- Use Apache Hive and Pig instead of Java to build a MapReduce Job Flow
- Learn the basics for using Amazon EMR to run machine learning algorithms
- Develop a project cost model for using Amazon EMR and other AWS tools
Publisher resources
Table of contents
- Preface
- 1. Introduction to Amazon Elastic MapReduce
- 2. Data Collection and Data Analysis with AWS
- 3. Data Filtering Design Patterns and Scheduling Work
- 4. Data Analysis with Hive and Pig in Amazon EMR
- 5. Machine Learning Using EMR
- 6. Planning AWS Projects and Managing Costs
- A. Amazon Web Services Resources and Tools
- B. Cloud Computing, Amazon Web Services, and Their Impacts
- C. Installation and Setup
- Index
- Colophon
- Copyright
Product information
- Title: Programming Elastic MapReduce
- Author(s):
- Release date: December 2013
- Publisher(s): O'Reilly Media, Inc.
- ISBN: 9781449363628
You might also like
book
MapReduce Design Patterns
Until now, design patterns for the MapReduce framework have been scattered among various research papers, blogs, …
book
Mastering Hadoop 3
A comprehensive guide to mastering the most advanced Hadoop 3 concepts Key Features Get to grips …
video
Analyzing Big Data with Hadoop, AWS, and EMR
Hadoop is today's most pervasive technology used in Big Data for distributing the processing of massive …
video
The Ultimate Hands-On Hadoop
Understanding Hadoop is a highly valuable skill for anyone working at companies that work with large …