Deep Learning with R Cookbook

Implementing vanilla autoencoders

An autoencoder comprises of the following two networks:

• Encoder: An encoder encodes its input, , into a hidden representation, . The output of an encoder unit is as follows:

h = g(Wx_i+b)

where, x_i ∈ Rⁿ, W ∈ R^{d x n}, b ∈ R^d.

• Decoder: A decoder reconstructs the input from the hidden representation, h. The output of a decoder unit is as follows:

where, W* ∈ R^{n x d}, h ∈ R^d, c ∈ Rⁿ.

An autoencoder neural network ...