Getting started

If you don't have a full installation of OpenAI Gym, you can install the classic_control and mujoco environment dependencies as follows:

pip install gym[classic_control]pip install gym[mujoco]

MuJoCo is not open source, so you'll have to follow the instructions in mujoco-py (available at to set it up. After the classic control environment is installed, try the following commands:

import gymatari = gym.make('Acrobot-v1')atari.reset()atari.render()

If it runs successfully, a small window will pop up, showing the screen of the Acrobot task:

Besides Acrobot, ...

Get Python Reinforcement Learning Projects now with O’Reilly online learning.

O’Reilly members experience live online training, plus books, videos, and digital content from 200+ publishers.