Feature Engineering Made Easy

Using RBMs in a machine learning pipeline

Of course, we want to see how the RBM performs in our machine learning pipelines to not just visualize the workings of the model, but to see concrete results of the feature learning. To do this, we will create and run three pipelines:

• A logistic regression model by itself running on the raw pixel strengths
• A logistic regression running on extracted PCA components
• A logistic regression running on extracted RBM components

Each of these pipelines will be grid-searched across a number of components (for PCA and RBM) and the C parameter for logistic regression. Let's start with our simplest pipeline. We will run the raw pixel values through a logistic regression to see if the linear model is enough to ...