Activation Functions
As mentioned, activation functions, some of which are listed in Table 8-2, serve as a
way to normalize data between either the standard or symmetric ranges. They also
are differentiable, and need to be, because of how we find weights in a training
algorithm.
Table 8-2. Activation functions
Name Standard Symmetric
Sigmoid
1