Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

0

Share

Download to read offline

Optimizer

Download to read offline

Slides for optimizer

Related Books

Free with a 30 day trial from Scribd

See all

Related Audiobooks

Free with a 30 day trial from Scribd

See all
  • Be the first to like this

Optimizer

  1. 1. Optimizer
  2. 2. Overall
  3. 3. SGD
  4. 4. SGD with Momentum
  5. 5. SGD with Nesterov Acceleration
  6. 6. AdaGrad • 二阶动量 • 下降梯度
  7. 7. AdaDelta / RMSProp • 时间窗口
  8. 8. Adam
  9. 9. On the Convergence of Adam and Beyond
  10. 10. Improving Generalization Performance by Switching from Adam to SGD
  11. 11. Improving Generalization Performance by Switching from Adam to SGD

Slides for optimizer

Views

Total views

107

On Slideshare

0

From embeds

0

Number of embeds

1

Actions

Downloads

4

Shares

0

Comments

0

Likes

0

×