One of the most simple ANN models is the perceptron, consisting of a single logistic unit. We can represent the perceptron in the following diagram:
Each of the inputs are associated with a weight and these are fed into the logistic unit. Note that we add a bias feature, x0 = 1. This logistic unit consists of two elements: a function to sum inputs and an activation function. If we use the sigmoid as the activation function, then we can write the following equation:
Note that this is exactly the hypothesis we used for logistic ...
