Data Analysis: What Can Be Learned From the Past 50 Years

Data Analysis: What Can Be Learned From the Past 50 Years

by Peter J. Huber
Released April 2011
Publisher(s): Wiley
ISBN: 9781118010648

Read it now on the O’Reilly learning platform with a 10-day free trial.

O’Reilly members get unlimited access to books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.

Start your free trial

Book description

This book explores the many provocative questions concerning the fundamentals of data analysis. It is based on the time-tested experience of one of the gurus of the subject matter. Why should one study data analysis? How should it be taught? What techniques work best, and for whom? How valid are the results? How much data should be tested? Which machine languages should be used, if used at all? Emphasis on apprenticeship (through hands-on case studies) and anecdotes (through real-life applications) are the tools that Peter J. Huber uses in this volume. Concern with specific statistical techniques is not of immediate value; rather, questions of strategy – when to use which technique – are employed. Central to the discussion is an understanding of the significance of massive (or robust) data sets, the implementation of languages, and the use of models. Each is sprinkled with an ample number of examples and case studies. Personal practices, various pitfalls, and existing controversies are presented when applicable. The book serves as an excellent philosophical and historical companion to any present-day text in data analysis, robust statistics, data mining, statistical learning, or computational statistics.

Table of contents

  1. Cover
  2. Half Title page
  3. Title page
  4. Copyright page
  5. Preface
  6. Chapter 1: What is Data Analysis?
    1. 1.1 Tukey’s 1962 Paper
    2. 1.2 The Path of Statistics
  7. Chapter 2: Strategy Issues in Data Analysis
    1. 2.1 Strategy in Data Analysis
    2. 2.2 Philosophical Issues
    3. 2.3 Issues of Size
    4. 2.4 Strategic Planning
    5. 2.5 The Stages of Data Analysis
    6. 2.6 Tools Required for Strategy Reasons
  8. Chapter 3: Massive Data Sets
    1. 3.1 Introduction
    2. 3.2 Disclosure: Personal Experiences
    3. 3.3 What Is Massive? A Classification of Size
    4. 3.4 Obstacles to Scaling
    5. 3.5 On The Structure of Large Data Sets
    6. 3.6 Data Base Management And Related Issues
    7. 3.7 The Stages of A Data Analysis
    8. 3.8 Examples and Some Thoughts on Strategy
    9. 3.9 Volume Reduction
    10. 3.10 Supercomputers and Software Challenges
    11. 3.11 Summary of Conclusions
  9. Chapter 4: Languages for Data Analysis
    1. 4.1 Goals and Purposes
    2. 4.2 Natural Languages and Computing Languages
    3. 4.3 Interface Issues
    4. 4.4 Miscellaneous Issues
    5. 4.5 Requirements for A General Purpose Immediate Language
  10. Chapter 5: Approximate Models
    1. 5.1 Models
    2. 5.2 Bayesian Modeling
    3. 5.3 Mathematical Statistics and Approximate Models
    4. 5.4 Statistical Significance and Physical Relevance
    5. 5.5 Judicious Use of A Wrong Model
    6. 5.6 Composite Models
    7. 5.7 Modeling The Length of Day
    8. 5.8 The Role of Simulation
    9. 5.9 Summary of Conclusions
  11. Chapter 6: Pitfalls
    1. 6.1 Simpson’s Paradox
    2. 6.2 Missing Data
    3. 6.3 Regression of Y on X or of X on Y?
  12. Chapter 7: Create Order in Data
    1. 7.1 General Considerations
    2. 7.2 Principal Component Methods
    3. 7.3 Multidimensional Scaling
    4. 7.4 Correspondence Analysis
    5. 7.5 Multidimensional Scaling vs. Correspondence Analysis
  13. Chapter 8: More Case Studies
    1. 8.1 A Nutshell Example
    2. 8.2 Shape Invariant Modeling
    3. 8.3 Comparison of Point Configurations
    4. 8.4 Notes on Numerical Optimization
  14. References
  15. Index

Product information

  • Title: Data Analysis: What Can Be Learned From the Past 50 Years
  • Author(s): Peter J. Huber
  • Release date: April 2011
  • Publisher(s): Wiley
  • ISBN: 9781118010648