SlideShare a Scribd company logo
1 of 29
+
漫談人工智慧
+
神經元 (neuron) 示意圖
+
神經元間的溝通之處
突觸 (synapse)
+
跳耀式傳導 (saltatory conduction)
+
動作電位 (action potential)
+
皮質柱 (Cortical Column)
相同的接受域 (receptive field)
+
聯結體 (connectome)
神經系統連接線路圖
+
長期增益作用
(long-term potentiation, LTP)
刺激輸入神經元而發生在突觸前神經元和突觸後
神經元信號傳輸產生一種持久的增強現象。
+
海柏學習法則
(Hebb’s learning rule)
突觸前神經元向突觸後神經元持續重複的刺激,
使得神經元之間的突觸強度增加。
+
人工神經元模型
+
常用激活函數 (activation function)
Sigmoid function
+
常用激活函數
Softmax function
+
常用激活函數
Hyperbolic tangent
+
常用激活函數
Rectified linear unit (ReLU)
+
感知機 (perceptron) 模型
+
多層感知機
(multi-layer perceptron)
+
卷積神經網路
(convolutional neural networks)
+
卷積神經網路
(convolutional neural networks)
+
卷積神經網路
Convolutional layer
 Depth (D): filter ( 或稱 kernel) 組數
 Stride (S): 每一次 kernel 移動的間
隔
 Zero padding (P): 每一輸入邊緣填
0 的寬度
若以 W 表示輸入寬度大小, F 表示
filter 寬度大小, 卷積運算後
feature map 的寬度大小公式為:
D 個 [(W - F + 2P) / S] + 1
+
卷積神經網路
Convolutional layer
+
卷積神經網路
Pooling layer
+
卷積神經網路
Local receptive field
+
卷積神經網路
Weight sharing
 此處 w1 = w4 = w7, w2 = w5 = w8, w3 = w6 = w9
 具有 translational invariance 的特性
+
目標函數 (objective function) / 損
失函數 (loss function)
 最小化目標函數 J
x*
= arg min J(x)
 Mean square error
 Cross entropy
+
隨機梯度下降
(stochastic gradient descent, SGD)
+
隨機梯度下降 (SGD)
minibatchminibatch
+
倒傳遞演算法 (Back-propagation)
+
神經網路模型何其多
 Hopfield model
 Self-organizing feature map
 Grossberg Network
 Adaptive Resonance Theory
 Neocognitron
 Hierarchical temporal memory
 Recurrent neural networks
 Spiking neural networks
 ……
+
人工智慧
機器學習 傻傻分不清楚
深度學習
人工智慧的未來

More Related Content

More from Jason Tsai

基於深度學習的人臉辨識技術簡介
基於深度學習的人臉辨識技術簡介基於深度學習的人臉辨識技術簡介
基於深度學習的人臉辨識技術簡介Jason Tsai
 
Neural Network Design: Chapter 17 Radial Basis Networks
Neural Network Design: Chapter 17 Radial Basis NetworksNeural Network Design: Chapter 17 Radial Basis Networks
Neural Network Design: Chapter 17 Radial Basis NetworksJason Tsai
 
Neural Network Design: Chapter 18 Grossberg Network
Neural Network Design: Chapter 18 Grossberg NetworkNeural Network Design: Chapter 18 Grossberg Network
Neural Network Design: Chapter 18 Grossberg NetworkJason Tsai
 
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...Jason Tsai
 
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...Jason Tsai
 
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...Jason Tsai
 
Reinforcement Learning: Chapter 15 Neuroscience
Reinforcement Learning: Chapter 15 NeuroscienceReinforcement Learning: Chapter 15 Neuroscience
Reinforcement Learning: Chapter 15 NeuroscienceJason Tsai
 
Deep Learning: Chapter 11 Practical Methodology
Deep Learning: Chapter 11 Practical MethodologyDeep Learning: Chapter 11 Practical Methodology
Deep Learning: Chapter 11 Practical MethodologyJason Tsai
 
Deep Learning: Introduction & Chapter 5 Machine Learning Basics
Deep Learning: Introduction & Chapter 5 Machine Learning BasicsDeep Learning: Introduction & Chapter 5 Machine Learning Basics
Deep Learning: Introduction & Chapter 5 Machine Learning BasicsJason Tsai
 

More from Jason Tsai (9)

基於深度學習的人臉辨識技術簡介
基於深度學習的人臉辨識技術簡介基於深度學習的人臉辨識技術簡介
基於深度學習的人臉辨識技術簡介
 
Neural Network Design: Chapter 17 Radial Basis Networks
Neural Network Design: Chapter 17 Radial Basis NetworksNeural Network Design: Chapter 17 Radial Basis Networks
Neural Network Design: Chapter 17 Radial Basis Networks
 
Neural Network Design: Chapter 18 Grossberg Network
Neural Network Design: Chapter 18 Grossberg NetworkNeural Network Design: Chapter 18 Grossberg Network
Neural Network Design: Chapter 18 Grossberg Network
 
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
 
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
 
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
Introduction to Spiking Neural Networks: From a Computational Neuroscience pe...
 
Reinforcement Learning: Chapter 15 Neuroscience
Reinforcement Learning: Chapter 15 NeuroscienceReinforcement Learning: Chapter 15 Neuroscience
Reinforcement Learning: Chapter 15 Neuroscience
 
Deep Learning: Chapter 11 Practical Methodology
Deep Learning: Chapter 11 Practical MethodologyDeep Learning: Chapter 11 Practical Methodology
Deep Learning: Chapter 11 Practical Methodology
 
Deep Learning: Introduction & Chapter 5 Machine Learning Basics
Deep Learning: Introduction & Chapter 5 Machine Learning BasicsDeep Learning: Introduction & Chapter 5 Machine Learning Basics
Deep Learning: Introduction & Chapter 5 Machine Learning Basics
 

漫談人工智慧:啟發自大腦科學的深度學習網路