Successfully reported this slideshow.
Your SlideShare is downloading. ×

Optimizer

Ad

Optimizer

Ad

Overall

Ad

SGD

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Loading in …3
×

Check these out next

1 of 13 Ad
1 of 13 Ad

More Related Content

Optimizer

  1. 1. Optimizer
  2. 2. Overall
  3. 3. SGD
  4. 4. SGD with Momentum
  5. 5. SGD with Nesterov Acceleration
  6. 6. AdaGrad • 二阶动量 • 下降梯度
  7. 7. AdaDelta / RMSProp • 时间窗口
  8. 8. Adam
  9. 9. On the Convergence of Adam and Beyond
  10. 10. Improving Generalization Performance by Switching from Adam to SGD
  11. 11. Improving Generalization Performance by Switching from Adam to SGD

×