**Index**

Absolute value

Absolute value penalty function

Activation function

Active constraint

Adaline

Adaptive linear element

Additivity

Affine function

Affine matrix inequality

Affine scaling

Affine scaling method

artificial problem

stopping criterion

strictly interior feasible point

Algebraic Riccati inequality

Algorithm

affine scaling

backpropagation

BFGS

Broyden-Fletcher-Goldfarb-Shanno, *see* BFGS algorithm

complexity of

conjugate gradient, *see* Conjugate gradient algorithm

convergence of, *see* Convergence

Davidon-Fletcher-Powell, *see* DFP algorithm

DFP

ellipsoid, *see* Khachiyan’s method

exponential complexity

fixed step size

for constrained optimization

genetic

globally monotone

gradient

Gram-Schmidt

interior-point

iterative, *See also* Search methods

Kaczmarz’s

Karmarkar’s, *see* Karmarkar’s method

Khachiyan’s

Lagrangian

naive random search

Nelder-Mead

particle swarm optimization

polynomial complexity

probabilistic search

projected

projected gradient

projected steepest descent

quasi-Newton, *see* Quasi-Newton methods

randomized search

rank one

rank two

RLS

secant method

simplex, *see* Simplex method

simulated annealing

single-rank symmetric

SRS

steepest descent

symmetric Huang family

variable metric

Widrow-Hoff

zero finding

Allocation

Alphabet in genetic algorithm

Argmin

Armijo backtracking algorithm

Armijo condition

Armijo-Goldstein condition

Artificial neural networks, *see* Feedforward neural networks

Artificial problem

in affine scaling method

in Karmarkar’s method

in simplex method

Start Free Trial

No credit card required