Make: Volume 93

OKAY ROBOT Pupper AI Quadruped

environment with GPU access. It’s very affordable

at around $1 an hour when using the powerful

A100 GPU.

If you have Python programming experience,

you can modify our Google Colab training code to

teach Pupper new tricks by changing the reward

function and/or the training environment. Model

your house in the simulator and teach Pupper to

navigate from room to room! Put dominos in your

simulation and train Pupper to knock them down!

RL IN THE REAL WORLD

Now that we’ve trained new behaviors for Pupper

in simulation, how do we ensure these behaviors

transfer accurately to the real world? When we

first started using RL ...