O'Reilly logo

Deep Belief Nets in C++ and CUDA C: Volume 1: Restricted Boltzmann Machines and Supervised Feedforward Networks by Timothy Masters

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

© Timothy Masters 2018

Timothy Masters, Deep Belief Nets in C++ and CUDA C: Volume 1, https://doi.org/10.1007/978-1-4842-3591-1_4

4. Greedy Training

Timothy Masters

(1)Ithaca, New York, USA

We saw in Chapter 2 how to construct and train (supervised) a traditional multiple-layer feedforward network. In Chapter 3 we learned how to construct and train without supervision a single-layer Restricted Boltzmann Machine (RBM). Now we will explore how to stack multiple RBMs into a deep belief network, train this multiple-layer network without supervision, and append an output layer that is trained with supervision. The resulting network can be enormously powerful.

The algorithm for stacking RBMs is surprisingly simple. Roughly stated, we train the bottom-most ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required