June 2020
Intermediate to advanced
364 pages
13h 56m
English
Content preview from Hands-On Mathematics for Deep Learning
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
Start your free trial
Exponential linear unit
Exponential linear unit (ELU) is another variation of the leaky ReLU activation function, where instead of having a straight line for all cases of 
, it is a log curve.
The ELU activation function is as follows:
The function looks as follows:
The derivative of this activation function is as follows: