In this hands-on exercise, we will build an MDP using a task from your own daily life or experience. This should allow you to better apply this abstract concept to something more tangible. Let's begin as follows:
- Think of a daily task you do that may encompass six or so states. Examples of this may be going to school, getting dressed, eating, showering, browsing Facebook, and traveling.
- Write each state within a circle on a full sheet of paper or perhaps some digital drawing app.
- Connect the states with the actions you feel most appropriate. For example, don't get dressed before you shower.
- Assign the probability you would use to take each action. For example, if you have two actions leaving a state, you could make them ...