Building Machine Learning Systems with Python - Third Edition

Feature projection

At some point, after we have removed redundant features and dropped irrelevant ones, we will often still find that we have too many features. No matter what learning method we use, they all perform badly and, given the huge feature space, we understand that they actually cannot do better. We have to get rid of features, even though common sense tells us that they are valuable. Another situation where we need to reduce the feature dimension, and where feature selection does not help much, is when we want to visualize data. Then, we need to have, at most, three dimensions at the end to provide any meaningful graphs.

Enter feature projection methods. They restructure the feature space to make it more accessible to the model, ...