Deep Reinforcement Learning with Python: With PyTorch, TensorFlow and OpenAI Gym

© Nimish Sanghi 2021

N. SanghiDeep Reinforcement Learning with Pythonhttps://doi.org/10.1007/978-1-4842-6809-4_2

2. Markov Decision Processes

Nimish Sanghi¹  

(1)

Bangalore, India

 

As discussed in Chapter 1, reinforcement learning involves sequential decision-making. In this chapter, we will formalize the notion of using stochastic processes under the branch of probability that models sequential decision-making behavior. While most of the problems we study in reinforcement learning are modeled as Markov decision processes (MDP), we start by first introducing Markov chains (MC) followed by Markov reward processes (MRP). We finish up by discussing MDP in-depth while covering model setup and the assumptions behind MDP.

We then discuss related concepts ...