Descending through a Crowded Valley -- Benchmarking Deep Learning Optimizers

Robin M. Schmidt
Robin M. Schmidt
Frank Schneider
Frank Schneider
Cited by: 0|Views16

Abstract:

Choosing the optimizer is among the most crucial decisions of deep learning engineers, and it is not an easy one. The growing literature now lists literally hundreds of optimization methods. In the absence of clear theoretical guidance and conclusive empirical evidence, the decision is often done according to personal anecdotes. In this...More

Code:

Data:

ZH
Full Text
Bibtex
Your rating :
0

 

Tags
Comments