Finally, we discuss AdaMax, a variant of Adam based on the infinity norm. Diederik P. Kingma, et al., "Adam: A Method for Stochastic Optimization" https://arxiv.org/abs/1412.6980 学習を最適化させるアルゴリズムとして近年よく使われているAdam…

Empirical results demonstrate that Adam works well in practice and compares favorably to other stochastic optimization methods. Diederik P. Kingma, et al., "Adam: A Method for Stochastic Optimization" https://arxiv.org/abs/1412.6980 学習を…