Nomenclature
The presence of the word ram in the environment name means that the observation returned by the environment is the contents of the Random Access Memory (RAM) of the Atari console on which the game was designed to run.
The presence of the word deterministic in the environment names means that the actions sent to the environment by the agent are performed repeatedly for a deterministic/fixed duration of four frames, and then the resulting state is returned.
The presence of the word NoFrameskip means that the actions sent to the environment by the agent are performed once and the resulting state is returned immediately, without skipping any frames in-between.
By default, if deterministic and NoFrameskip are not included in the environment ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access