Hands-On Mathematics for Deep Learning

Optimization problems

We can recall from earlier in this chapter that the optimization problem can be defined as follows:

The optimal value of our problem is defined as follows:

We call x^* an optimal point (or solution to our problem) if . Therefore, the optimal set containing all the optimal points is as follows:

In convex optimization, there ...