April 2018
Intermediate to advanced
334 pages
10h 18m
English
Say we have some n states in the given environment and if we see the Bellman equation,

we find out that n states are given; therefore, we will have n equations and n unknown but the
function makes it non-linear. Thus, we cannot solve them as linear equations.
Therefore, in order to solve:
Start with an arbitrary utility
Update the utilities based on the neighborhood until convergence, that is, update the utility of the state using the Bellman equation based on the utilities of the landing states ...