We just learned that we use 
to approximate 
. Thus, the estimated value of should be close to . Since these both are distributions, we use KL divergence to measure how diverges from and we need to minimize the divergence.
A KL ...
The loss function
Get Hands-On Deep Learning Algorithms with Python now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
