TensorFlow 1.x Deep Learning Cookbook

Getting ready

PCA reduces the n-dimensional input data to r-dimensional input data, where r<n. In simpler terms, PCA involves translating the origin and performing rotation of the axis such that one of the axes (the principal axis) has the least variance with data points. A reduced dimension dataset is obtained from the original dataset by performing this transformation and then dropping (removing) the orthogonal axes with high variance. Here, we employ the SVD method for PCA dimensionality reduction. Consider X, the n-dimensional data, with p points X_p,n. Any real (p×n) matrix can be decomposed as follows:

X = U ∑ V^T

Here, U and V are orthonormal matrices (that is, U.U^T = V^T.V= 1) of size p × n and n × n respectively. ∑ is a diagonal matrix ...