Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Optimizer

43 views

Published on

Slides for optimizer

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Optimizer

  1. 1. Optimizer
  2. 2. Overall
  3. 3. SGD
  4. 4. SGD with Momentum
  5. 5. SGD with Nesterov Acceleration
  6. 6. AdaGrad • 二阶动量 • 下降梯度
  7. 7. AdaDelta / RMSProp • 时间窗口
  8. 8. Adam
  9. 9. On the Convergence of Adam and Beyond
  10. 10. Improving Generalization Performance by Switching from Adam to SGD
  11. 11. Improving Generalization Performance by Switching from Adam to SGD

×