Artificial Intelligence By Example

Energy-based models

An RBM is an energy-based model (EBM). An EBM uses probabilistic distributions defined by an energy function.

For a given x, E(x) or E(v,h) is one way of expressing the energy function of an RBM in a simplified, conceptual line. It is:

This energy function drives the model and will be used to direct weight and bias optimization:

• The v (visible) and h (hidden) units are connected by W (the weights)
• b is an offset of the units that acts as a bias

Then the energy will be measured with a probabilistic function p:

Z is a