More Related Content
More from Kirill Eremenko (15)
Deep Learning A-Z™: AutoEncoders - AutoEncoders
- 2. © SuperDataScienceDeep Learning A-Z
Used for Regression & ClassificationArtificial Neural Networks
Used for Computer VisionConvolutional Neural Networks
Used for Time Series AnalysisRecurrent Neural Networks
Used for Feature DetectionSelf-Organizing Maps
Used for Recommendation SystemsDeep Boltzmann Machines
Used for Recommendation SystemsAutoEncoders
SupervisedUnsupervised
- 4. © SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
Movie 1
Movie 2
Movie 3
Movie 4
- 5. © SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
Movie 1
Movie 2
Movie 3
Movie 4
= * (+1)
= * (-1)
- 6. © SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
0
0
0
Movie 1
Movie 2
Movie 3
Movie 4
1 2
0
0
1
1
-2
= * (+1)
= * (-1)
- 7. © SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
0
0
0
Movie 1
Movie 2
Movie 3
Movie 4
1 2
0
0
1
1
-2
1
0
0
0
Softmax
= * (+1)
= * (-1)
- 8. © SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
1
0
0
Movie 1
Movie 2
Movie 3
Movie 4
0 0
2
-2
0
1
-1
0
1
0
0
= * (+1)
= * (-1)
- 9. © SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
0
1
0
Movie 1
Movie 2
Movie 3
Movie 4
0 0
-2
2
0
-1
1
0
0
1
0
= * (+1)
= * (-1)
- 10. © SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
0
0
1
Movie 1
Movie 2
Movie 3
Movie 4
0 -2
0
0
2
-1
-1
0
0
0
1
= * (+1)
= * (-1)
- 11. © SuperDataScienceDeep Learning A-Z
Neural Networks Are Impressively Good At
Compression
By Malte Skarupke (2016)
Link:
https://probablydance.com/2016/04/30/neural-networks-are-impressively-
good-at-compression/
Additional Reading: