© SuperDataScienceDeep Learning A-Z
© SuperDataScienceDeep Learning A-Z
Used for Regression & ClassificationArtificial Neural Networks
Used for Computer VisionConvolutional Neural Networks
Used for Time Series AnalysisRecurrent Neural Networks
Used for Feature DetectionSelf-Organizing Maps
Used for Recommendation SystemsDeep Boltzmann Machines
Used for Recommendation SystemsAutoEncoders
SupervisedUnsupervised
© SuperDataScienceDeep Learning A-Z
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
Encoding Decoding
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
Movie 1
Movie 2
Movie 3
Movie 4
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
Movie 1
Movie 2
Movie 3
Movie 4
= * (+1)
= * (-1)
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
0
0
0
Movie 1
Movie 2
Movie 3
Movie 4
1 2
0
0
1
1
-2
= * (+1)
= * (-1)
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
0
0
0
Movie 1
Movie 2
Movie 3
Movie 4
1 2
0
0
1
1
-2
1
0
0
0
Softmax
= * (+1)
= * (-1)
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
1
0
0
Movie 1
Movie 2
Movie 3
Movie 4
0 0
2
-2
0
1
-1
0
1
0
0
= * (+1)
= * (-1)
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
0
1
0
Movie 1
Movie 2
Movie 3
Movie 4
0 0
-2
2
0
-1
1
0
0
1
0
= * (+1)
= * (-1)
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
0
0
1
Movie 1
Movie 2
Movie 3
Movie 4
0 -2
0
0
2
-1
-1
0
0
0
1
= * (+1)
= * (-1)
© SuperDataScienceDeep Learning A-Z
Neural Networks Are Impressively Good At
Compression
By Malte Skarupke (2016)
Link:
https://probablydance.com/2016/04/30/neural-networks-are-impressively-
good-at-compression/
Additional Reading:

Deep Learning A-Z™: AutoEncoders - AutoEncoders

  • 1.
  • 2.
    © SuperDataScienceDeep LearningA-Z Used for Regression & ClassificationArtificial Neural Networks Used for Computer VisionConvolutional Neural Networks Used for Time Series AnalysisRecurrent Neural Networks Used for Feature DetectionSelf-Organizing Maps Used for Recommendation SystemsDeep Boltzmann Machines Used for Recommendation SystemsAutoEncoders SupervisedUnsupervised
  • 3.
    © SuperDataScienceDeep LearningA-Z Visible Input Nodes Hidden Nodes Visible Output Nodes Encoding Decoding
  • 4.
    © SuperDataScienceDeep LearningA-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes Movie 1 Movie 2 Movie 3 Movie 4
  • 5.
    © SuperDataScienceDeep LearningA-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes Movie 1 Movie 2 Movie 3 Movie 4 = * (+1) = * (-1)
  • 6.
    © SuperDataScienceDeep LearningA-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes 0 0 0 Movie 1 Movie 2 Movie 3 Movie 4 1 2 0 0 1 1 -2 = * (+1) = * (-1)
  • 7.
    © SuperDataScienceDeep LearningA-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes 0 0 0 Movie 1 Movie 2 Movie 3 Movie 4 1 2 0 0 1 1 -2 1 0 0 0 Softmax = * (+1) = * (-1)
  • 8.
    © SuperDataScienceDeep LearningA-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes 1 0 0 Movie 1 Movie 2 Movie 3 Movie 4 0 0 2 -2 0 1 -1 0 1 0 0 = * (+1) = * (-1)
  • 9.
    © SuperDataScienceDeep LearningA-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes 0 1 0 Movie 1 Movie 2 Movie 3 Movie 4 0 0 -2 2 0 -1 1 0 0 1 0 = * (+1) = * (-1)
  • 10.
    © SuperDataScienceDeep LearningA-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes 0 0 1 Movie 1 Movie 2 Movie 3 Movie 4 0 -2 0 0 2 -1 -1 0 0 0 1 = * (+1) = * (-1)
  • 11.
    © SuperDataScienceDeep LearningA-Z Neural Networks Are Impressively Good At Compression By Malte Skarupke (2016) Link: https://probablydance.com/2016/04/30/neural-networks-are-impressively- good-at-compression/ Additional Reading: