In this section, we'll discuss the vector and matrix operations that are relevant to NNs. Let's start:
- Vector addition is the operation of adding two or more vectors together into an output vector sum. The output is another vector and is computed with the following formula:
- The dot (or scalar) product takes two vectors and outputs a scalar value. We can compute the dot product with the following formula:
Here, |a| and |b| are the vector magnitudes and θ is the angle between the two vectors. Let's assume that ...