O'Reilly logo

Machine Learning with Swift by Alexander Sosnovshchenko

Stay ahead with the world's most comprehensive technology and business learning platform.

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

Start Free Trial

No credit card required

Using gradient descent for function minimization

If the machine learning algorithm is a car, then the optimization algorithm is its engine. For more information, refer to http://www.pyimagesearch.com/2016/10/10/gradient-descent-with-python/.

From your math classes, you should remember that geometrical interpretation is a derivative  of a function f(x) is a slope at any given point (x) of the function. Now, if we have a function of two parameters f(x, y), we can't calculate just derivative as we did previously. Nevertheless, we can calculate partial derivatives: . The vector composed of these partial derivatives is known as a gradient, and the ...

With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

Start Free Trial

No credit card required