Skip to Content
Reinforcement Learning with TensorFlow
book

Reinforcement Learning with TensorFlow

by Sayon Dutta
April 2018
Intermediate to advanced content levelIntermediate to advanced
334 pages
10h 18m
English
Packt Publishing
Content preview from Reinforcement Learning with TensorFlow

Use of experience replay

Another important feature added to deep Q-networks is experience replay. The idea behind this feature is that the agent can store its past experiences and use them in batches to train the deep neural network. Storing the experiences allows the agent to randomly draw the batches and help the network to learn from a variety of data instead of just formalizing decisions on immediate experiences. Each of these experiences are stored in a form of four dimensional vector comprising of state, action, reward, and next state.

In order to avoid storage issues, the buffer of experience replay is fixed, and as the new experiences get stored the old experiences get removed. For training neural networks, uniform batches of random ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Deep Learning with TensorFlow - Second Edition

Deep Learning with TensorFlow - Second Edition

Giancarlo Zaccone, Vihan Jain, Md. Rezaul Karim, Motaz Saad
Deep Learning with TensorFlow 2 and Keras - Second Edition

Deep Learning with TensorFlow 2 and Keras - Second Edition

Antonio Gulli, Dr. Amita Kapoor, Sujit Pal

Publisher Resources

ISBN: 9781788835725Supplemental Content