R Deep Learning Essentials - Second Edition

Base model (no convolutional layers)

Now that we have explored the data and we are satisfied that it looks OK, the next step is to create our first deep learning model. This is similar to the example we saw in the previous chapter. The code for this is in Chapter5/mnist.Rmd:

data <- mx.symbol.Variable("data")fullconnect1 <- mx.symbol.FullyConnected(data, name="fullconnect1", num_hidden=256)activation1 <- mx.symbol.Activation(fullconnect1, name="activation1", act_type="relu")fullconnect2 <- mx.symbol.FullyConnected(activation1, name="fullconnect2", num_hidden=128)activation2 <- mx.symbol.Activation(fullconnect2, name="activation2", act_type="relu")fullconnect3 <- mx.symbol.FullyConnected(activation2, name="fullconnect3", num_hidden=10)softmax ...