-
SPS
IEEE Members: Free
Non-members: FreeLength: 0:40:52
A number of popular variants of the gradient descent scheme, in the context of the back-propagation algorithm, are discussed such as Nesterov's momentum, the AdaGrad and the Adam algorithms.