Learn how Neural Networks learns, what is Gradient Descent algorithm part in it, Cost Function, Backpropagation, etc. from short presentation by Anatolii Shkurpylo, Software Developer at ElifTech

1. Gradient Descent. How NN learns
by Anatolii Shkurpylo,
Software Developer

2. www.eliftech.com
▪ Interesting intro
▪ Recap basics of Neural Network
▪ Cost Function
▪ Gradient Descent
▪ Backpropagation
▪ Links

3. www.eliftech.com
Interesting Intro

4. www.eliftech.com
Types of Machine Learning

5. www.eliftech.com
Blizzard and Google betray humanity with StarCraft 2 tools

6. www.eliftech.com
Recap Neural Networks

7. www.eliftech.com
Input layer
2 hidden layers
Output layer
...
28 * 28 px
vector 784d

8. www.eliftech.com

9. www.eliftech.com
Cost Function

10. www.eliftech.com
Cost Function
(Loss or objective function)
C =cost

11. www.eliftech.com
Cost function by Linear regression example

12. www.eliftech.com
Quadratic or MSE function

13. www.eliftech.com
Gradient Descent

14. www.eliftech.com
Cost Function
(Loss or objective function)

15. www.eliftech.com
Gradient Descent of cost function
C(v1, v2)

16. www.eliftech.com
Gradient Descent of cost function

17. www.eliftech.com
Stochastic Gradient Descent

18. www.eliftech.com
Backpropagation

19. www.eliftech.com
Chain Rule

20. www.eliftech.com
Chain Rule

21. www.eliftech.com

22. www.eliftech.com
Links
▪ http://neuralnetworksanddeeplearning.com/index.html
▪ https://www.analyticsvidhya.com/blog/2017/01/introduction-to-reinforcement-
learning-implementation/
▪ https://deepmind.com/blog/deepmind-and-blizzard-open-starcraft-ii-ai-research-
environment/
▪ http://www.3blue1brown.com/
▪ https://www.khanacademy.org/math/ap-calculus-ab/ab-derivative-rules/ab-chain-
rule/v/chain-rule-introduction
▪ https://www.coursera.org/learn/machine-learning
▪ https://github.com/mnielsen/neural-networks-and-deep-
learning/blob/master/src/network.py

23. www.eliftech.com
Thank you for attention!
Find us at eliftech.com
Have a question? Contact us:
info@eliftech.com