Practical Text Mining and Statistical Analysis for Non-structured Text Data Applications

Chapter 10

Feature Selection and Dimensionality Reduction

Contents

Preamble

Introduction

Feature Selection

Feature Selection Approaches

Dimensionality Reduction

Linear Dimensionality Reduction Approaches

Postscript

References

Preamble

Feature selection techniques remove features that have low information content, clarifying the data by identifying the more important features. Similarly, dimensionality reduction techniques extract new features from the data by combining two or more existing features. A simple example of dimensionality reduction strategy is to replace factors of “length” and “width” by multiplying them together to create the new factor, “area.” Area has information elements related to length and width, in addition to elements ...