O'Reilly logo

R Deep Learning Projects by Pablo Maldonado, Yuxi Liu

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

RNN without derivatives — the cross-entropy method

We will replace the backward propagation part on the preceding neural network with a Monte Carlo algorithm, called the cross-entropy method. This is a general-purpose algorithm introduced by Reuven Rubinstein which is quite helpful in many cases, especially for rare event simulation. It has been proven efficient for many reinforcement learning tasks, so why not give it a try?

The method consists of two parts:

  1. Generate a random data sample (trajectories, vectors) according to a specified mechanism.
  2. Update the parameters of the random mechanism based on the data to produce a better sample in the next iteration. This step involves minimizing the cross-entropy or Kullback–Leibler divergence. ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required