SlideShare a Scribd company logo
1 of 11
© SuperDataScienceDeep Learning A-Z
© SuperDataScienceDeep Learning A-Z
Used for Regression & ClassificationArtificial Neural Networks
Used for Computer VisionConvolutional Neural Networks
Used for Time Series AnalysisRecurrent Neural Networks
Used for Feature DetectionSelf-Organizing Maps
Used for Recommendation SystemsDeep Boltzmann Machines
Used for Recommendation SystemsAutoEncoders
SupervisedUnsupervised
© SuperDataScienceDeep Learning A-Z
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
Encoding Decoding
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
Movie 1
Movie 2
Movie 3
Movie 4
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
Movie 1
Movie 2
Movie 3
Movie 4
= * (+1)
= * (-1)
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
0
0
0
Movie 1
Movie 2
Movie 3
Movie 4
1 2
0
0
1
1
-2
= * (+1)
= * (-1)
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
0
0
0
Movie 1
Movie 2
Movie 3
Movie 4
1 2
0
0
1
1
-2
1
0
0
0
Softmax
= * (+1)
= * (-1)
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
1
0
0
Movie 1
Movie 2
Movie 3
Movie 4
0 0
2
-2
0
1
-1
0
1
0
0
= * (+1)
= * (-1)
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
0
1
0
Movie 1
Movie 2
Movie 3
Movie 4
0 0
-2
2
0
-1
1
0
0
1
0
= * (+1)
= * (-1)
© SuperDataScienceDeep Learning A-Z
Movie 1
Movie 2
Movie 3
Movie 4
Visible
Input
Nodes
Hidden
Nodes
Visible
Output
Nodes
0
0
1
Movie 1
Movie 2
Movie 3
Movie 4
0 -2
0
0
2
-1
-1
0
0
0
1
= * (+1)
= * (-1)
© SuperDataScienceDeep Learning A-Z
Neural Networks Are Impressively Good At
Compression
By Malte Skarupke (2016)
Link:
https://probablydance.com/2016/04/30/neural-networks-are-impressively-
good-at-compression/
Additional Reading:

More Related Content

What's hot

What's hot (20)

Deep Learning A-Z™: Boltzmann Machines - Restricted Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machines  - Restricted Boltzmann MachineDeep Learning A-Z™: Boltzmann Machines  - Restricted Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machines - Restricted Boltzmann Machine
 
Deep Learning A-Z™: Autoencoders - Contractive Autoencoders
Deep Learning A-Z™: Autoencoders  - Contractive AutoencodersDeep Learning A-Z™: Autoencoders  - Contractive Autoencoders
Deep Learning A-Z™: Autoencoders - Contractive Autoencoders
 
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Gradient Descent
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Gradient DescentDeep Learning A-Z™: Artificial Neural Networks (ANN) - Gradient Descent
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Gradient Descent
 
Deep Learning A-Z™: Recurrent Neural Networks (RNN) - Practical Intuition
Deep Learning A-Z™: Recurrent Neural Networks (RNN) - Practical IntuitionDeep Learning A-Z™: Recurrent Neural Networks (RNN) - Practical Intuition
Deep Learning A-Z™: Recurrent Neural Networks (RNN) - Practical Intuition
 
Deep Learning A-Z™: Boltzmann Machine - Module 5 - Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machine - Module 5 - Boltzmann MachineDeep Learning A-Z™: Boltzmann Machine - Module 5 - Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machine - Module 5 - Boltzmann Machine
 
Deep Learning A-Z™: AutoEncoders - Training an AutoEncoder
Deep Learning A-Z™: AutoEncoders  - Training an AutoEncoderDeep Learning A-Z™: AutoEncoders  - Training an AutoEncoder
Deep Learning A-Z™: AutoEncoders - Training an AutoEncoder
 
Deep Learning A-Z™: Autoencoders - Sparse Autoencoders
Deep Learning A-Z™: Autoencoders  - Sparse AutoencodersDeep Learning A-Z™: Autoencoders  - Sparse Autoencoders
Deep Learning A-Z™: Autoencoders - Sparse Autoencoders
 
Deep Learning A-Z™: Recurrent Neural Networks (RNN) - Module 3
Deep Learning A-Z™: Recurrent Neural Networks (RNN) - Module 3Deep Learning A-Z™: Recurrent Neural Networks (RNN) - Module 3
Deep Learning A-Z™: Recurrent Neural Networks (RNN) - Module 3
 
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Plan of Attack
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Plan of AttackDeep Learning A-Z™: Artificial Neural Networks (ANN) - Plan of Attack
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Plan of Attack
 
Deep Learning A-Z™: Self Organizing Maps (SOM) - Reading an Advanced SOM
Deep Learning A-Z™: Self Organizing Maps (SOM) - Reading an Advanced SOMDeep Learning A-Z™: Self Organizing Maps (SOM) - Reading an Advanced SOM
Deep Learning A-Z™: Self Organizing Maps (SOM) - Reading an Advanced SOM
 
Deep Learning A-Z™: Artificial Neural Networks (ANN) - The Activation Function
Deep Learning A-Z™: Artificial Neural Networks (ANN) - The Activation FunctionDeep Learning A-Z™: Artificial Neural Networks (ANN) - The Activation Function
Deep Learning A-Z™: Artificial Neural Networks (ANN) - The Activation Function
 
Deep Learning A-Z™: Boltzmann Machines - Energy Based Models (ebm)
Deep Learning A-Z™: Boltzmann Machines  - Energy Based Models (ebm)Deep Learning A-Z™: Boltzmann Machines  - Energy Based Models (ebm)
Deep Learning A-Z™: Boltzmann Machines - Energy Based Models (ebm)
 
Deep Learning A-Z™: Self Organizing Maps (SOM) - How Do SOMs Work?
Deep Learning A-Z™: Self Organizing Maps (SOM) - How Do SOMs Work?Deep Learning A-Z™: Self Organizing Maps (SOM) - How Do SOMs Work?
Deep Learning A-Z™: Self Organizing Maps (SOM) - How Do SOMs Work?
 
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Module 1
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Module 1Deep Learning A-Z™: Artificial Neural Networks (ANN) - Module 1
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Module 1
 
Deep Learning A-Z™: Recurrent Neural Networks (RNN) - LSTMs
Deep Learning A-Z™: Recurrent Neural Networks (RNN) - LSTMsDeep Learning A-Z™: Recurrent Neural Networks (RNN) - LSTMs
Deep Learning A-Z™: Recurrent Neural Networks (RNN) - LSTMs
 
Deep Learning A-Z™: Artificial Neural Networks (ANN) - The Neuron
Deep Learning A-Z™: Artificial Neural Networks (ANN) - The NeuronDeep Learning A-Z™: Artificial Neural Networks (ANN) - The Neuron
Deep Learning A-Z™: Artificial Neural Networks (ANN) - The Neuron
 
Deep Learning A-Z™: Self Organizing Maps (SOM) - Plan of attack
Deep Learning A-Z™: Self Organizing Maps (SOM) - Plan of attackDeep Learning A-Z™: Self Organizing Maps (SOM) - Plan of attack
Deep Learning A-Z™: Self Organizing Maps (SOM) - Plan of attack
 
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Backpropagation
Deep Learning A-Z™: Artificial Neural Networks (ANN) - BackpropagationDeep Learning A-Z™: Artificial Neural Networks (ANN) - Backpropagation
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Backpropagation
 
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Stochastic Gradient De...
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Stochastic Gradient De...Deep Learning A-Z™: Artificial Neural Networks (ANN) - Stochastic Gradient De...
Deep Learning A-Z™: Artificial Neural Networks (ANN) - Stochastic Gradient De...
 
Deep Learning A-Z™: Recurrent Neural Networks (RNN) - LSTM Variations
Deep Learning A-Z™: Recurrent Neural Networks (RNN) - LSTM VariationsDeep Learning A-Z™: Recurrent Neural Networks (RNN) - LSTM Variations
Deep Learning A-Z™: Recurrent Neural Networks (RNN) - LSTM Variations
 

More from Kirill Eremenko

More from Kirill Eremenko (15)

Deep Learning A-Z™: Regression & Classification - Module 7
Deep Learning A-Z™: Regression & Classification - Module 7Deep Learning A-Z™: Regression & Classification - Module 7
Deep Learning A-Z™: Regression & Classification - Module 7
 
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
 
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
 
Deep Learning A-Z™: Regression & Classification - Logistic Regression
Deep Learning A-Z™: Regression & Classification - Logistic RegressionDeep Learning A-Z™: Regression & Classification - Logistic Regression
Deep Learning A-Z™: Regression & Classification - Logistic Regression
 
Deep Learning A-Z™: Autoencoders - Stacked Autoencoders
Deep Learning A-Z™: Autoencoders  - Stacked AutoencodersDeep Learning A-Z™: Autoencoders  - Stacked Autoencoders
Deep Learning A-Z™: Autoencoders - Stacked Autoencoders
 
Deep Learning A-Z™: Autoencoders - Denoising Autoencoders
Deep Learning A-Z™: Autoencoders  - Denoising AutoencodersDeep Learning A-Z™: Autoencoders  - Denoising Autoencoders
Deep Learning A-Z™: Autoencoders - Denoising Autoencoders
 
Deep Learning A-Z™: Regression - Multiple Linear Regression Intuition
Deep Learning A-Z™: Regression - Multiple Linear Regression IntuitionDeep Learning A-Z™: Regression - Multiple Linear Regression Intuition
Deep Learning A-Z™: Regression - Multiple Linear Regression Intuition
 
Deep Learning A-Z™: Boltzmann Machines - Deep Belief Networks
Deep Learning A-Z™: Boltzmann Machines  - Deep Belief NetworksDeep Learning A-Z™: Boltzmann Machines  - Deep Belief Networks
Deep Learning A-Z™: Boltzmann Machines - Deep Belief Networks
 
Deep Learning A-Z™: Boltzmann Machines - Deep Boltzmann Machines
Deep Learning A-Z™: Boltzmann Machines  - Deep Boltzmann MachinesDeep Learning A-Z™: Boltzmann Machines  - Deep Boltzmann Machines
Deep Learning A-Z™: Boltzmann Machines - Deep Boltzmann Machines
 
Deep Learning A-Z™: Boltzmann Machines - Plan of Attack
Deep Learning A-Z™: Boltzmann Machines  - Plan of AttackDeep Learning A-Z™: Boltzmann Machines  - Plan of Attack
Deep Learning A-Z™: Boltzmann Machines - Plan of Attack
 
Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering (part 2)
Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering (part 2)Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering (part 2)
Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering (part 2)
 
Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering
Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means ClusteringDeep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering
Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering
 
Deep Learning A-Z™: Convolutional Neural Networks (CNN) - Step 1: Convolution...
Deep Learning A-Z™: Convolutional Neural Networks (CNN) - Step 1: Convolution...Deep Learning A-Z™: Convolutional Neural Networks (CNN) - Step 1: Convolution...
Deep Learning A-Z™: Convolutional Neural Networks (CNN) - Step 1: Convolution...
 
Deep Learning A-Z™: Self Organizing Maps (SOM) - Module 4
Deep Learning A-Z™: Self Organizing Maps (SOM) - Module 4Deep Learning A-Z™: Self Organizing Maps (SOM) - Module 4
Deep Learning A-Z™: Self Organizing Maps (SOM) - Module 4
 
Deep Learning A-Z™: Convolutional Neural Networks (CNN) - Step 3: Flattening
Deep Learning A-Z™: Convolutional Neural Networks (CNN) - Step 3: FlatteningDeep Learning A-Z™: Convolutional Neural Networks (CNN) - Step 3: Flattening
Deep Learning A-Z™: Convolutional Neural Networks (CNN) - Step 3: Flattening
 

Recently uploaded

Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 

Recently uploaded (20)

On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptxCOMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
COMMUNICATING NEGATIVE NEWS - APPROACHES .pptx
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdfUnit 3 Emotional Intelligence and Spiritual Intelligence.pdf
Unit 3 Emotional Intelligence and Spiritual Intelligence.pdf
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 

Deep Learning A-Z™: AutoEncoders - AutoEncoders

  • 2. © SuperDataScienceDeep Learning A-Z Used for Regression & ClassificationArtificial Neural Networks Used for Computer VisionConvolutional Neural Networks Used for Time Series AnalysisRecurrent Neural Networks Used for Feature DetectionSelf-Organizing Maps Used for Recommendation SystemsDeep Boltzmann Machines Used for Recommendation SystemsAutoEncoders SupervisedUnsupervised
  • 3. © SuperDataScienceDeep Learning A-Z Visible Input Nodes Hidden Nodes Visible Output Nodes Encoding Decoding
  • 4. © SuperDataScienceDeep Learning A-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes Movie 1 Movie 2 Movie 3 Movie 4
  • 5. © SuperDataScienceDeep Learning A-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes Movie 1 Movie 2 Movie 3 Movie 4 = * (+1) = * (-1)
  • 6. © SuperDataScienceDeep Learning A-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes 0 0 0 Movie 1 Movie 2 Movie 3 Movie 4 1 2 0 0 1 1 -2 = * (+1) = * (-1)
  • 7. © SuperDataScienceDeep Learning A-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes 0 0 0 Movie 1 Movie 2 Movie 3 Movie 4 1 2 0 0 1 1 -2 1 0 0 0 Softmax = * (+1) = * (-1)
  • 8. © SuperDataScienceDeep Learning A-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes 1 0 0 Movie 1 Movie 2 Movie 3 Movie 4 0 0 2 -2 0 1 -1 0 1 0 0 = * (+1) = * (-1)
  • 9. © SuperDataScienceDeep Learning A-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes 0 1 0 Movie 1 Movie 2 Movie 3 Movie 4 0 0 -2 2 0 -1 1 0 0 1 0 = * (+1) = * (-1)
  • 10. © SuperDataScienceDeep Learning A-Z Movie 1 Movie 2 Movie 3 Movie 4 Visible Input Nodes Hidden Nodes Visible Output Nodes 0 0 1 Movie 1 Movie 2 Movie 3 Movie 4 0 -2 0 0 2 -1 -1 0 0 0 1 = * (+1) = * (-1)
  • 11. © SuperDataScienceDeep Learning A-Z Neural Networks Are Impressively Good At Compression By Malte Skarupke (2016) Link: https://probablydance.com/2016/04/30/neural-networks-are-impressively- good-at-compression/ Additional Reading: