Deep Learning with Keras

An overview of predefined activation functions

Activation includes commonly used functions such as sigmoid, linear, hyperbolic tangent, and ReLU. We have seen a few examples of activation functions in Chapter 1, Neural Networks Foundations, and more examples will be presented in the next chapters. The following diagrams are examples of sigmoid, linear, hyperbolic tangent, and ReLU activation functions:

Sigmoid	Linear
Hyperbolic tangent	ReLU