January 2018
Beginner to intermediate
284 pages
8h 35m
English
RBM is an energy-based model. The energy function produces a scalar value indicating the probability of the model is in that configuration.
From Geoffrey Hinton's tutorial (Geoffrey Hinton, A Practical Guide to Training Restricted Boltzmann Machines, 2010), the energy function is written as follows:
The calculation is simple. Basically, you do the dot product between biases and the corresponding units (visible or hidden) to calculate their contribution to the energy function. The third item is the energy representation for connections between the visible nodes and the hidden nodes.
During the model learning stage this energy ...
Read now
Unlock full access