Deep Reinforcement Learning Hands-On

Imagination-augmented agent

The overall idea of the new architecture called imagination-augmented agent (I2A) is to allow the agent to imagine future trajectories by the current observations and incorporate these imagined paths into its decision process. The high-level architecture is shown in the following diagram:

Figure 1: 12A architecture

The agent consists of two different paths used to transform the input observation: model-free and imagination. Model-free is a standard set of convolution layers transforming the input image in high-level features. Another path is called imagination and consists of a set of trajectories "imagined" from the current ...