## With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, tutorials, and more.

No credit card required

## 6.11 The Coordinate and Cyclic Coordinate Descent Methods

So far, we have discussed the steepest descent and Newton’s method for optimization. We will conclude the discussion with a third method, which can also be seen as a member of the steepest descent family of methods. Instead of the Euclidean and quadratic norms, let us consider the following minimization task for obtaining the normalized descent direction,

$\begin{array}{ll}\hfill \mathbit{v}& =arg\underset{\mathbit{z}}{min}{\mathbit{z}}^{\text{T}}\nabla J,\hfill \end{array}$

(6.57)

$\begin{array}{ll}\hfill \text{s.t.}& ||\mathbit{z}|{|}_{1}=1,\hfill \end{array}$

(6.58)

where ||⋅||1 denotes the 1 norm, defined as

$||z|{|}_{1}:=\sum _{i=1}^{l}|{z}_{i}|.$

Most of Chapter 9 ...

## With Safari, you learn the way you learn best. Get unlimited access to videos, live online training, learning paths, books, interactive tutorials, and more.

No credit card required