Book description
The Complete Guide to Data Science with Hadoop—For Technical Professionals, Businesspeople, and Students
Demand is soaring for professionals who can solve real data science problems with Hadoop and Spark. Practical Data Science with Hadoop® and Spark is your complete guide to doing just that. Drawing on immense experience with Hadoop and big data, three leading experts bring together everything you need: high-level concepts, deep-dive techniques, real-world use cases, practical applications, and hands-on tutorials.
The authors introduce the essentials of data science and the modern Hadoop ecosystem, explaining how Hadoop and Spark have evolved into an effective platform for solving data science problems at scale. In addition to comprehensive application coverage, the authors also provide useful guidance on the important steps of data ingestion, data munging, and visualization.
Once the groundwork is in place, the authors focus on specific applications, including machine learning, predictive modeling for sentiment analysis, clustering for document analysis, anomaly detection, and natural language processing (NLP).
This guide provides a strong technical foundation for those who want to do practical data science, and also presents business-driven guidance on how to apply Hadoop and Spark to optimize ROI of data science initiatives.
Learn
What data science is, how it has evolved, and how to plan a data science career
How data volume, variety, and velocity shape data science use cases
Hadoop and its ecosystem, including HDFS, MapReduce, YARN, and Spark
Data importation with Hive and Spark
Data quality, preprocessing, preparation, and modeling
Visualization: surfacing insights from huge data sets
Machine learning: classification, regression, clustering, and anomaly detection
Algorithms and Hadoop tools for predictive modeling
Cluster analysis and similarity functions
Large-scale anomaly detection
NLP: applying data science to human language
Table of contents
- About This E-Book
- Title Page
- Copyright Page
- Contents
- Foreword
- Preface
- Acknowledgments
- About the Authors
-
I: Data Science with Hadoop—An Overview
- 1. Introduction to Data Science
-
2. Use Cases for Data Science
- Big Data—A Driver of Change
-
Business Use Cases
- Product Recommendation
- Customer Churn Analysis
- Customer Segmentation
- Sales Leads Prioritization
- Sentiment Analysis
- Fraud Detection
- Predictive Maintenance
- Market Basket Analysis
- Predictive Medical Diagnosis
- Predicting Patient Re-admission
- Detecting Anomalous Record Access
- Insurance Risk Analysis
- Predicting Oil and Gas Well Production Levels
- Summary
- 3. Hadoop and Data Science
-
II: Preparing and Visualizing Data with Hadoop
-
4. Getting Data into Hadoop
- Hadoop as a Data Lake
- The Hadoop Distributed File System (HDFS)
- Direct File Transfer to Hadoop HDFS
- Importing Data from Files into Hive Tables
- Importing Data into Hive Tables Using Spark
- Using Apache Sqoop to Acquire Relational Data
- Using Apache Flume to Acquire Data Streams
- Manage Hadoop Work and Data Flows with Apache Oozie
- Apache Falcon
- What’s Next in Data Ingestion?
- Summary
- 5. Data Munging with Hadoop
- 6. Exploring and Visualizing Data
-
4. Getting Data into Hadoop
-
III: Applying Data Modeling with Hadoop
- 7. Machine Learning with Hadoop
- 8. Predictive Modeling
- 9. Clustering
- 10. Anomaly Detection with Hadoop
- 11. Natural Language Processing
- 12. Data Science with Hadoop—The Next Frontier
- A. Book Web Page and Code Download
- B. HDFS Quick Start
- C. Additional Background on Data Science and Apache Hadoop and Spark
- Index
- Code Snippets
Product information
- Title: Practical Data Science with Hadoop® and Spark: Designing and Building Effective Analytics at Scale
- Author(s):
- Release date: December 2016
- Publisher(s): Addison-Wesley Professional
- ISBN: 9780134029733
You might also like
book
Modeling Techniques in Predictive Analytics with Python and R: A Guide to Data Science
Master predictive analytics, from start to finish Start with strategy and management Master methods and build …
book
Scala and Spark for Big Data Analytics
Harness the power of Scala to program Spark and analyze tonnes of data in the blink …
book
Data Science Bookcamp
Learn data science with Python by building five real-world projects! Experiment with card game predictions, tracking …
book
Adaptive Machine Learning Algorithms with Python: Solve Data Analytics and Machine Learning Problems on Edge Devices
Learn to use adaptive algorithms to solve real-world streaming data problems. This book covers a multitude …