4. 人工智能
1958:
Birth of
Perceptron and
neural networks
1974:
Backpropagation
Late 1980s:
convolution neural
networks and recurrent
neural networks
trained using
backpropagation
2006:
Unsupervised
pretraining for
deep neutral
networks
2012: Distributed
deep learning (e.g.,
Google Brain)
2013: DQN for
deep reinforcement
learning
1997: LSTM-RNN
2015: Open source
tools: MxNEt,
TensorFlow, CNTK
t
人工智能(Artificial Intelligence)
是研究、开发用于模拟、延伸和
扩展人的智能的理论、方法、技
术及应用系统的一门新的技术科
学。AI企图了解智能的实质,并
生产出一种新的能以人类智能相
似的方式做出反应的智能机器。
19. 递归神经网络RNN
• Model a dynamic system driven by an external signal x
– 𝐴" = 𝑓(𝑈𝑥" + 𝑊𝐴"*+)
– Hidden node 𝐴"*+ contains information about the whole past sequence
– function 𝑓(·) maps the whole past sequence (𝑥𝑡,… , 𝑥1) to current state 𝐴"