Hands-On Intelligent Agents with OpenAI Gym

Max and skip-frame

The Gym library provides environments that have NoFrameskip in their ID, which we discussed in Chapter 4, Exploring the Gym and its Features, where we discussed the nomenclature of the Gym environments. As you may recall from our discussion in Chapter 4, Exploring the Gym and its Features, by default, if there is no presence of Deterministic or NoFrameskip in the environment name, the action sent to the environment is repeatedly performed for a duration of n frames, where n is uniformly sampled from (2, 3, 4). If we want to step through the environment at a specific rate, we can use the Gym Atari environments with NoFrameskip in their ID, which will step through the underlying environment without any alteration to the step ...