Hands-On Neuroevolution with Python

Atari Learning Environment

During agent training, we need to simulate actual gameplay in the Atari system. This can be done using the ALE, which simulates an Atari system that can run ROM images of the games. The ALE provides an interface that allows us to capture game screen frames and control the game by emulating the game controller. Here, we'll use the ALE modification that's available at https://github.com/yaricom/atari-py.

Our implementation uses the TensorFlow framework to implement ANN models and execute them on the GPU. Thus, the corresponding bridge needs to be implemented between ALE and TensorFlow. This is done by implementing a custom TensorFlow operation using the C++ programming language for efficiency. The corresponding Python ...