Skip to Main Content
Machine Learning
book

Machine Learning

by Sergios Theodoridis
April 2015
Intermediate to advanced content levelIntermediate to advanced
1062 pages
40h 35m
English
Academic Press
Content preview from Machine Learning
Chapter 5

Stochastic Gradient Descent

The LMS Algorithm and its Family

Abstract

The focus of this chapter is to introduce the stochastic gradient descent family of online/adaptive algorithms in the framework of the squared error loss function. The gradient descent approach to optimization is presented and the stochastic approximation method is discussed. Then, the LMS algorithm and its offsprings, such as the APA and the NLMS are introduced. Finally, distributed learning is discussed with an emphasis to distributed versions of the LMS.

Keywords

Affine projection algorithm

Distributed learning

Diffusion LMS

Gradient descent method

Least-mean-squares LMS adaptive algorithm

Method of stochastic approximation

Robbins-Monro algorithm

Steepest ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Machine Learning

Machine Learning

Mohssen Mohammed, Muhammad Badruddin Khan, Eihab Mohammed Bashier
Machine Learning

Machine Learning

Subramanian Chandramouli, Saikat Dutt, Amit Kumar Das
Machine Learning Algorithms

Machine Learning Algorithms

Giuseppe Bonaccorso
Introducing Machine Learning

Introducing Machine Learning

Dino Esposito, Francesco Esposito

Publisher Resources

ISBN: 9780128015223