June 2020
Intermediate to advanced
364 pages
13h 56m
English
Content preview from Hands-On Mathematics for Deep Learning
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Jensen-Shannon divergence
Like the KL divergence, the Jensen-Shannon (JS) divergence measures how similar two probability distributions are; however, it is smoother. The following equation represents the JS divergence:
This behaves a lot better than KL divergence when p(x) and q(x) are both small.