Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Gradient Descent. How NN learns

668 views

Published on

Learn how Neural Networks learns, what is Gradient Descent algorithm part in it, Cost Function, Backpropagation, etc. from short presentation by Anatolii Shkurpylo, Software Developer at ElifTech

Published in: Software
  • Be the first to comment

Gradient Descent. How NN learns

  1. 1. Gradient Descent. How NN learns by Anatolii Shkurpylo, Software Developer
  2. 2. www.eliftech.com ▪ Interesting intro ▪ Recap basics of Neural Network ▪ Cost Function ▪ Gradient Descent ▪ Backpropagation ▪ Links
  3. 3. www.eliftech.com Interesting Intro
  4. 4. www.eliftech.com Types of Machine Learning
  5. 5. www.eliftech.com Blizzard and Google betray humanity with StarCraft 2 tools
  6. 6. www.eliftech.com Recap Neural Networks
  7. 7. www.eliftech.com Input layer 2 hidden layers Output layer ... 28 * 28 px vector 784d
  8. 8. www.eliftech.com
  9. 9. www.eliftech.com Cost Function
  10. 10. www.eliftech.com Cost Function (Loss or objective function) C =cost
  11. 11. www.eliftech.com Cost function by Linear regression example
  12. 12. www.eliftech.com Quadratic or MSE function
  13. 13. www.eliftech.com Gradient Descent
  14. 14. www.eliftech.com Cost Function (Loss or objective function)
  15. 15. www.eliftech.com Gradient Descent of cost function C(v1, v2)
  16. 16. www.eliftech.com Gradient Descent of cost function
  17. 17. www.eliftech.com Stochastic Gradient Descent
  18. 18. www.eliftech.com Backpropagation
  19. 19. www.eliftech.com Chain Rule
  20. 20. www.eliftech.com Chain Rule
  21. 21. www.eliftech.com
  22. 22. www.eliftech.com Links ▪ http://neuralnetworksanddeeplearning.com/index.html ▪ https://www.analyticsvidhya.com/blog/2017/01/introduction-to-reinforcement- learning-implementation/ ▪ https://deepmind.com/blog/deepmind-and-blizzard-open-starcraft-ii-ai-research- environment/ ▪ http://www.3blue1brown.com/ ▪ https://www.khanacademy.org/math/ap-calculus-ab/ab-derivative-rules/ab-chain- rule/v/chain-rule-introduction ▪ https://www.coursera.org/learn/machine-learning ▪ https://github.com/mnielsen/neural-networks-and-deep- learning/blob/master/src/network.py
  23. 23. www.eliftech.com Thank you for attention! Find us at eliftech.com Have a question? Contact us: info@eliftech.com

×