Short overview of Neural Networks Basics from our Software Developer Anatolii Shkurpylo + What is Neural Networks? + How NN works? + Simple NN in Python

1. Neural Networks Basics
by Anatolii Shkurpylo,
Software Developer

2. www.eliftech.com
▪ Interesting intro
▪ What is NN ?
▪ Now NN works?
▪ Simple NN in Python
▪ Links

3. www.eliftech.com
Interesting Intro

4. www.eliftech.com

5. www.eliftech.com
NN is used
▪ Classification
▪ Regression
▪ Clustering

6. www.eliftech.com
What is Neural Networks

7. www.eliftech.com
“Neural network - a beautiful biologically-inspired programming
paradigm which enables a computer to learn from observational data”
Michael Nielsen
Deep learning - a powerful set of techniques for learning in neural networks

8. www.eliftech.com
Neuron

9. www.eliftech.com
History
First Neuron Model was invented in 1943 by two data scientists W. McCulloch and W. Pitts

10. www.eliftech.com
History
In 1957 psychologist Frank Rosenblatt conceived the perceptron.
Perceptron - Single Layer Feedforward Neural Network

11. www.eliftech.com
Terminology

12. www.eliftech.com
How NN works?

13. www.eliftech.com
Consider this by resolving
Handwritten Digit Recognition problem
NN
6

14. www.eliftech.com
A mostly complete chart of
Neural Networks

15. www.eliftech.com
...
Input layer
2 hidden layers
Output layer
28 * 28 px
vector 784d

16. www.eliftech.com
How does human recognize the digits?

17. www.eliftech.com
How NN recognize the digits (not actually)?
pixels layer
edges
layer
shapes layer
digits layer

18. www.eliftech.com
weights of
previous layer
biases of
previous layer
activations of
previous layer

19. www.eliftech.com

20. www.eliftech.com
Now we know how NN
calculate!
Let’s take a look at few other
things.

21. www.eliftech.com
Activation function
To make our model nonlinear

22. www.eliftech.com
Bias
linear function sigmoid
function
bias
x
y

23. www.eliftech.com
Input layer Output layerHidden layer

24. www.eliftech.com
Links
▪ http://neuralnetworksanddeeplearning.com/index.html
▪ https://becominghuman.ai/cheat-sheets-for-ai-neural-networks-machine-learning-
deep-learning-big-data-678c51b4b463
▪ https://www.analyticsvidhya.com/blog/2016/03/introduction-deep-learning-
fundamentals-neural-networks/
▪ http://www.3blue1brown.com/
▪ http://neuralnetworksanddeeplearning.com/index.html
▪ https://iamtrask.github.io/2015/07/12/basic-python-network/

25. www.eliftech.com
Thank you for attention!
Find us at eliftech.com
Have a question? Contact us:
info@eliftech.com