October 2019
Intermediate to advanced
366 pages
12h 4m
English
The core of policy gradient algorithms has already been covered, but we have another important concept to explain. We are yet to look at how action values are computed.
We already saw with the formula (6.4):

that we are able to estimate the gradient of the objective function by sampling directly from the experience that is collected following the
policy.
The only two terms that are involved are the values of and the derivative of the logarithm of the policy, which can be obtained through modern deep learning ...
Read now
Unlock full access