Principles of Big Data

Chapter 11

Stepwise Approach to Big Data Analysis

Outline

Background

Step 1. A Question Is Formulated

Step 2. Resource Evaluation

Step 3. A Question Is Reformulated

Step 4. Query Output Adequacy

Step 5. Data Description

Step 6. Data Reduction

Step 7. Algorithms Are Selected, If Absolutely Necessary

Step 8. Results Are Reviewed and Conclusions Are Asserted

Step 9. Conclusions Are Examined and Subjected to Validation

The purpose of computing is insight, not numbers.

Richard Hamming

Background

At this point, you may feel completely overwhelmed by the complexities of Big Data resources. It may seem that analysis is humanly impossible. The best way to tackle a large and complex project is to divide it into smaller, less intimidating tasks. Of course, ...