SlideShare a Scribd company logo
1 of 4
© SuperDataScienceDeep Learning A-Z
© SuperDataScienceDeep Learning A-Z
Hidden
Nodes
VisibleN
odes
© SuperDataScienceDeep Learning A-Z
Greedy Layer-Wise Training of
Deep Networks
By Yoshua Bengio et al. (2006)
Link:
http://www.iro.umontreal.ca/~lisa/pointeurs/BengioNips2006All.pdf
Additional Reading:
© SuperDataScienceDeep Learning A-Z
The wake-sleep algorithm for
unsupervised neural networks
By Geoffrey Hinton et al. (1995)
Link:
http://www.gatsby.ucl.ac.uk/~dayan/papers/hdfn95.pdf
Additional Reading:

More Related Content

More from Kirill Eremenko

Deep Learning A-Z™: Boltzmann Machine - Module 5 - Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machine - Module 5 - Boltzmann MachineDeep Learning A-Z™: Boltzmann Machine - Module 5 - Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machine - Module 5 - Boltzmann MachineKirill Eremenko
 
Deep Learning A-Z™: Regression & Classification - Module 7
Deep Learning A-Z™: Regression & Classification - Module 7Deep Learning A-Z™: Regression & Classification - Module 7
Deep Learning A-Z™: Regression & Classification - Module 7Kirill Eremenko
 
Deep Learning A-Z™: Autoencoders - Sparse Autoencoders
Deep Learning A-Z™: Autoencoders  - Sparse AutoencodersDeep Learning A-Z™: Autoencoders  - Sparse Autoencoders
Deep Learning A-Z™: Autoencoders - Sparse AutoencodersKirill Eremenko
 
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...Kirill Eremenko
 
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...Kirill Eremenko
 
Deep Learning A-Z™: Autoencoders - Contractive Autoencoders
Deep Learning A-Z™: Autoencoders  - Contractive AutoencodersDeep Learning A-Z™: Autoencoders  - Contractive Autoencoders
Deep Learning A-Z™: Autoencoders - Contractive AutoencodersKirill Eremenko
 
Deep Learning A-Z™: Regression & Classification - Logistic Regression
Deep Learning A-Z™: Regression & Classification - Logistic RegressionDeep Learning A-Z™: Regression & Classification - Logistic Regression
Deep Learning A-Z™: Regression & Classification - Logistic RegressionKirill Eremenko
 
Deep Learning A-Z™: Autoencoders - Stacked Autoencoders
Deep Learning A-Z™: Autoencoders  - Stacked AutoencodersDeep Learning A-Z™: Autoencoders  - Stacked Autoencoders
Deep Learning A-Z™: Autoencoders - Stacked AutoencodersKirill Eremenko
 
Deep Learning A-Z™: Autoencoders - Denoising Autoencoders
Deep Learning A-Z™: Autoencoders  - Denoising AutoencodersDeep Learning A-Z™: Autoencoders  - Denoising Autoencoders
Deep Learning A-Z™: Autoencoders - Denoising AutoencodersKirill Eremenko
 
Deep Learning A-Z™: Boltzmann Machines - Restricted Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machines  - Restricted Boltzmann MachineDeep Learning A-Z™: Boltzmann Machines  - Restricted Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machines - Restricted Boltzmann MachineKirill Eremenko
 
Deep Learning A-Z™: Regression - Multiple Linear Regression Intuition
Deep Learning A-Z™: Regression - Multiple Linear Regression IntuitionDeep Learning A-Z™: Regression - Multiple Linear Regression Intuition
Deep Learning A-Z™: Regression - Multiple Linear Regression IntuitionKirill Eremenko
 
Deep Learning A-Z™: AutoEncoders - Training an AutoEncoder
Deep Learning A-Z™: AutoEncoders  - Training an AutoEncoderDeep Learning A-Z™: AutoEncoders  - Training an AutoEncoder
Deep Learning A-Z™: AutoEncoders - Training an AutoEncoderKirill Eremenko
 
Deep Learning A-Z™: AutoEncoders - Module 6
Deep Learning A-Z™: AutoEncoders  - Module 6Deep Learning A-Z™: AutoEncoders  - Module 6
Deep Learning A-Z™: AutoEncoders - Module 6Kirill Eremenko
 
Deep Learning A-Z™: Boltzmann Machines - Deep Boltzmann Machines
Deep Learning A-Z™: Boltzmann Machines  - Deep Boltzmann MachinesDeep Learning A-Z™: Boltzmann Machines  - Deep Boltzmann Machines
Deep Learning A-Z™: Boltzmann Machines - Deep Boltzmann MachinesKirill Eremenko
 
Deep Learning A-Z™: Boltzmann Machines - Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machines  - Boltzmann MachineDeep Learning A-Z™: Boltzmann Machines  - Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machines - Boltzmann MachineKirill Eremenko
 
Deep Learning A-Z™: AutoEncoders - AutoEncoders
Deep Learning A-Z™: AutoEncoders  - AutoEncodersDeep Learning A-Z™: AutoEncoders  - AutoEncoders
Deep Learning A-Z™: AutoEncoders - AutoEncodersKirill Eremenko
 
Deep Learning A-Z™: Boltzmann Machines - Plan of Attack
Deep Learning A-Z™: Boltzmann Machines  - Plan of AttackDeep Learning A-Z™: Boltzmann Machines  - Plan of Attack
Deep Learning A-Z™: Boltzmann Machines - Plan of AttackKirill Eremenko
 
Deep Learning A-Z™: Boltzmann Machines - Module 5
Deep Learning A-Z™: Boltzmann Machines  - Module 5Deep Learning A-Z™: Boltzmann Machines  - Module 5
Deep Learning A-Z™: Boltzmann Machines - Module 5Kirill Eremenko
 
Deep Learning A-Z™: Self Organizing Maps (SOM) - How do SOMs learn (part 2)
Deep Learning A-Z™: Self Organizing Maps (SOM) - How do SOMs learn (part 2)Deep Learning A-Z™: Self Organizing Maps (SOM) - How do SOMs learn (part 2)
Deep Learning A-Z™: Self Organizing Maps (SOM) - How do SOMs learn (part 2)Kirill Eremenko
 
Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering (part 2)
Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering (part 2)Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering (part 2)
Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering (part 2)Kirill Eremenko
 

More from Kirill Eremenko (20)

Deep Learning A-Z™: Boltzmann Machine - Module 5 - Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machine - Module 5 - Boltzmann MachineDeep Learning A-Z™: Boltzmann Machine - Module 5 - Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machine - Module 5 - Boltzmann Machine
 
Deep Learning A-Z™: Regression & Classification - Module 7
Deep Learning A-Z™: Regression & Classification - Module 7Deep Learning A-Z™: Regression & Classification - Module 7
Deep Learning A-Z™: Regression & Classification - Module 7
 
Deep Learning A-Z™: Autoencoders - Sparse Autoencoders
Deep Learning A-Z™: Autoencoders  - Sparse AutoencodersDeep Learning A-Z™: Autoencoders  - Sparse Autoencoders
Deep Learning A-Z™: Autoencoders - Sparse Autoencoders
 
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
 
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
Deep Learning A-Z™: Regression & Classification - Simple Linear Regression - ...
 
Deep Learning A-Z™: Autoencoders - Contractive Autoencoders
Deep Learning A-Z™: Autoencoders  - Contractive AutoencodersDeep Learning A-Z™: Autoencoders  - Contractive Autoencoders
Deep Learning A-Z™: Autoencoders - Contractive Autoencoders
 
Deep Learning A-Z™: Regression & Classification - Logistic Regression
Deep Learning A-Z™: Regression & Classification - Logistic RegressionDeep Learning A-Z™: Regression & Classification - Logistic Regression
Deep Learning A-Z™: Regression & Classification - Logistic Regression
 
Deep Learning A-Z™: Autoencoders - Stacked Autoencoders
Deep Learning A-Z™: Autoencoders  - Stacked AutoencodersDeep Learning A-Z™: Autoencoders  - Stacked Autoencoders
Deep Learning A-Z™: Autoencoders - Stacked Autoencoders
 
Deep Learning A-Z™: Autoencoders - Denoising Autoencoders
Deep Learning A-Z™: Autoencoders  - Denoising AutoencodersDeep Learning A-Z™: Autoencoders  - Denoising Autoencoders
Deep Learning A-Z™: Autoencoders - Denoising Autoencoders
 
Deep Learning A-Z™: Boltzmann Machines - Restricted Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machines  - Restricted Boltzmann MachineDeep Learning A-Z™: Boltzmann Machines  - Restricted Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machines - Restricted Boltzmann Machine
 
Deep Learning A-Z™: Regression - Multiple Linear Regression Intuition
Deep Learning A-Z™: Regression - Multiple Linear Regression IntuitionDeep Learning A-Z™: Regression - Multiple Linear Regression Intuition
Deep Learning A-Z™: Regression - Multiple Linear Regression Intuition
 
Deep Learning A-Z™: AutoEncoders - Training an AutoEncoder
Deep Learning A-Z™: AutoEncoders  - Training an AutoEncoderDeep Learning A-Z™: AutoEncoders  - Training an AutoEncoder
Deep Learning A-Z™: AutoEncoders - Training an AutoEncoder
 
Deep Learning A-Z™: AutoEncoders - Module 6
Deep Learning A-Z™: AutoEncoders  - Module 6Deep Learning A-Z™: AutoEncoders  - Module 6
Deep Learning A-Z™: AutoEncoders - Module 6
 
Deep Learning A-Z™: Boltzmann Machines - Deep Boltzmann Machines
Deep Learning A-Z™: Boltzmann Machines  - Deep Boltzmann MachinesDeep Learning A-Z™: Boltzmann Machines  - Deep Boltzmann Machines
Deep Learning A-Z™: Boltzmann Machines - Deep Boltzmann Machines
 
Deep Learning A-Z™: Boltzmann Machines - Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machines  - Boltzmann MachineDeep Learning A-Z™: Boltzmann Machines  - Boltzmann Machine
Deep Learning A-Z™: Boltzmann Machines - Boltzmann Machine
 
Deep Learning A-Z™: AutoEncoders - AutoEncoders
Deep Learning A-Z™: AutoEncoders  - AutoEncodersDeep Learning A-Z™: AutoEncoders  - AutoEncoders
Deep Learning A-Z™: AutoEncoders - AutoEncoders
 
Deep Learning A-Z™: Boltzmann Machines - Plan of Attack
Deep Learning A-Z™: Boltzmann Machines  - Plan of AttackDeep Learning A-Z™: Boltzmann Machines  - Plan of Attack
Deep Learning A-Z™: Boltzmann Machines - Plan of Attack
 
Deep Learning A-Z™: Boltzmann Machines - Module 5
Deep Learning A-Z™: Boltzmann Machines  - Module 5Deep Learning A-Z™: Boltzmann Machines  - Module 5
Deep Learning A-Z™: Boltzmann Machines - Module 5
 
Deep Learning A-Z™: Self Organizing Maps (SOM) - How do SOMs learn (part 2)
Deep Learning A-Z™: Self Organizing Maps (SOM) - How do SOMs learn (part 2)Deep Learning A-Z™: Self Organizing Maps (SOM) - How do SOMs learn (part 2)
Deep Learning A-Z™: Self Organizing Maps (SOM) - How do SOMs learn (part 2)
 
Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering (part 2)
Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering (part 2)Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering (part 2)
Deep Learning A-Z™: Self Organizing Maps (SOM) - K-Means Clustering (part 2)
 

Recently uploaded

On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxPooja Bhuva
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - Englishneillewis46
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfSherif Taha
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfNirmal Dwivedi
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Jisc
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxmarlenawright1
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxJisc
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.christianmathematics
 
Basic Intentional Injuries Health Education
Basic Intentional Injuries Health EducationBasic Intentional Injuries Health Education
Basic Intentional Injuries Health EducationNeilDeclaro1
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxCeline George
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17Celine George
 
Philosophy of china and it's charactistics
Philosophy of china and it's charactisticsPhilosophy of china and it's charactistics
Philosophy of china and it's charactisticshameyhk98
 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxUmeshTimilsina1
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxAreebaZafar22
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxRamakrishna Reddy Bijjam
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Pooja Bhuva
 
latest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answerslatest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answersdalebeck957
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the ClassroomPooky Knightsmith
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...Amil baba
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Pooja Bhuva
 

Recently uploaded (20)

On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Basic Intentional Injuries Health Education
Basic Intentional Injuries Health EducationBasic Intentional Injuries Health Education
Basic Intentional Injuries Health Education
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Philosophy of china and it's charactistics
Philosophy of china and it's charactisticsPhilosophy of china and it's charactistics
Philosophy of china and it's charactistics
 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptx
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
latest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answerslatest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answers
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
NO1 Top Black Magic Specialist In Lahore Black magic In Pakistan Kala Ilam Ex...
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 

Deep Learning A-Z™: Boltzmann Machines - Deep Belief Networks