Hands-On Deep Learning Algorithms with Python

Defining the sparse regularizer

The following is the code to define the sparse regularizer:

def sparse_regularizer(activation_matrix):

Set our value to 0.05:

rho = 0.05

Calculate the , which is the mean activation value:

rho_hat = K.mean(activation_matrix) 

Compute the KL divergence between the mean and the mean according to equation (1):

KL_divergence ...