Gradient Descent. How NN learns
by Anatolii Shkurpylo,
Software Developer
www.eliftech.com
▪ Interesting intro
▪ Recap basics of Neural Network
▪ Cost Function
▪ Gradient Descent
▪ Backpropagation
▪ Links
www.eliftech.com
Interesting Intro
www.eliftech.com
Types of Machine Learning
www.eliftech.com
Blizzard and Google betray humanity with StarCraft 2 tools
www.eliftech.com
Recap Neural Networks
www.eliftech.com
Input layer
2 hidden layers
Output layer
...
28 * 28 px
vector 784d
www.eliftech.com
www.eliftech.com
Cost Function
www.eliftech.com
Cost Function
(Loss or objective function)
C =cost
www.eliftech.com
Cost function by Linear regression example
www.eliftech.com
Quadratic or MSE function
www.eliftech.com
Gradient Descent
www.eliftech.com
Cost Function
(Loss or objective function)
www.eliftech.com
Gradient Descent of cost function
C(v1, v2)
www.eliftech.com
Gradient Descent of cost function
www.eliftech.com
Stochastic Gradient Descent
www.eliftech.com
Backpropagation
www.eliftech.com
Chain Rule
www.eliftech.com
Chain Rule
www.eliftech.com
www.eliftech.com
Links
▪ http://neuralnetworksanddeeplearning.com/index.html
▪ https://www.analyticsvidhya.com/blog/2017/01/introduction-to-reinforcement-
learning-implementation/
▪ https://deepmind.com/blog/deepmind-and-blizzard-open-starcraft-ii-ai-research-
environment/
▪ http://www.3blue1brown.com/
▪ https://www.khanacademy.org/math/ap-calculus-ab/ab-derivative-rules/ab-chain-
rule/v/chain-rule-introduction
▪ https://www.coursera.org/learn/machine-learning
▪ https://github.com/mnielsen/neural-networks-and-deep-
learning/blob/master/src/network.py
www.eliftech.com
Thank you for attention!
Find us at eliftech.com
Have a question? Contact us:
info@eliftech.com

Gradient Descent. How NN learns