February 2019
Intermediate to advanced
336 pages
9h 29m
English
In this chapter
What is an activation function?
Standard hidden activation functions
Standard output activation functions
Activation function installation instructions
“I know that 2 and 2 make 4—& should be glad to prove it too if I could—though I must say if by any sort of process I could convert 2 & 2 into five it would give me much greater pleasure.”
George Gordon Byron, letter to Annabella Milbanke, November 10, 1813
An activation function is a function applied to the neurons in a layer during prediction. This should seem very familiar, ...