June 2018
Intermediate to advanced
318 pages
9h 24m
English
The Bellman equation, named after Richard Bellman, American mathematician, helps us to solve MDP. It is omnipresent in RL. When we say solve the MDP, it actually means finding the optimal policies and value functions. There can be many different value functions according to different policies. The optimal value function
is the one which yields maximum value compared to all the other value functions:

Similarly, the optimal policy is the one which results in an optimal value function.
Since the optimal value ...
Read now
Unlock full access