Practical Text Mining and Statistical Analysis for Non-structured Text Data Applications

Chapter 11

Singular Value Decomposition in Text Mining

Contents

Preamble

Introduction

Redundancy in Text

Dimensions of Meaning: Latent Semantic Indexing

The Math of Singular Value Decomposition

Graphical Representations and Simple Examples

Singular Value Decomposition in Equation Form

Singular Value Decomposition and Principal Components Analysis Eigenvalues

Some Practical Considerations

Extracting Dimensions

Subjective Methods: Reviewing Graphs

Analytical Methods: Building Models for Dimensions

Useful Analyses Based on Singular Value Decomposition Scores

Cluster Analysis

Predictive Modeling

When SVD Is Not Useful

Summary

Postscript

References

Preamble

Singular value decomposition is a form of dimensionality reduction, but it adds to the total ...