June 2018
Intermediate to advanced
546 pages
13h 30m
English
The overall idea of the new architecture called imagination-augmented agent (I2A) is to allow the agent to imagine future trajectories by the current observations and incorporate these imagined paths into its decision process. The high-level architecture is shown in the following diagram:

Figure 1: 12A architecture
The agent consists of two different paths used to transform the input observation: model-free and imagination. Model-free is a standard set of convolution layers transforming the input image in high-level features. Another path is called imagination and consists of a set of trajectories "imagined" from the current ...