Optimizers in TensorFlow
We’re still on the subject of gradient descent. But let’s now talk about gradient optimization, because of its importance to gradient descent. It is an optimization method for finding the minimum of a function, and it’s important in deep learning. It works to update the weights of the neural network through backpropagation.
So what are the optimizations of the types of gradient descent we talked about previously (batch, mini-batch, and stochastic)? Let’s start by talking about the benefits of these optimization methods ...
