A quick review of all the models
Let's recap each of the models we built, to model these fonts and some of their strengths and weaknesses:
At a glance, recall that we slowly built up more complicated models and took into account the structure of the data to improve our accuracy.
The logistic regression model
First, we started with a simple logistic regression model:
This has 36x36 pixels plus 1 bias times 5 classes total weights, or 6,485 parameters that we need to train. After 1,000 training epochs, this model achieved about 40 percent validation accuracy. ...