- Let's assume we have a quadratic cost function and we find its minima:
- The cost function in statistical machine learning algorithms acts as a proxy for the level of difficulty, energy spent, or total error as we move around in our search space.
- The first thing we do is to graph the function and inspect it visually.
- Upon visual inspection, we see that is a concave function with its minima at (2,1).
- Our next step would ...