SlideShare a Scribd company logo
自然語言處理簡介	
  
By	
  Mark	
  Chang	
  
自然語言處理	
  
•  自然語言處理是人工智慧和語言學領域的分支	
  
–  探討如何處理及運用自然語言	
  
•  自然語言理解系統	
  
–  把自然語言轉化為電腦易於處理的形式。	
  
•  自然語言生成系統	
  
–  把電腦程式數據轉化為自然語言。	
  
•  h,ps://zh.wikipedia.org/wiki/%E8%87%AA
%E7%84%B6%E8%AF%AD
%E8%A8%80%E5%A4%84%E7%90%86
	
  
機器翻譯	
  
https://translate.google.com/	
  
	
  
問答系統
www.wolframalpha.com	
  
資訊檢索
https://www.google.com	
  
	
  
輸入法選字
https://www.ptt.cc/bbs/StupidClown/M.1423419065.A.AF8.html	
  
自然語言處理流程
純文字
斷詞 	
  
句法剖析
語意剖析
 小明 騎 機車	
  
詞性標記	
  
 小明騎機車	
  
 小明(Nb) 騎(VC) 機車(Na)	
  
 小明(Nb) 騎(VC) 機車(Na)	
  
 騎(	
  小明,	
  機車 )	
  
中文斷詞 &詞性標記	
  
	
  
	
  	
  
http://ckipsvr.iis.sinica.edu.tw/	
  
	
  
小明(Nb) 騎(VC) 機車(Na)	
  
Nb:專有名詞	
  
VC:及物動詞	
  
Na:普通名詞	
  
句法結構剖析	
  
h,p://rocling.iis.sinica.edu.tw/CKIP/parser.htm	
  
	
  
語意剖析
	
  

 騎( 小明,	
  機車	
  )	
  
h,p://www.let.rug.nl/bos/comsem/	
  
	
  
	
  

一階邏輯(First	
  Order	
  Logic)	
  
騎:Predicate	
  
小明、機車:Argument	
  
自然語言處理的困難
•  歧義(Ambiguity)	
  
發生於自然語言處理過程中的每個步驟	
  
– 斷詞歧義	
  
– 句法歧義	
  
– …
斷詞歧義
http://3rd.mafengwo.cn/travels/info_weibo.php?
id=2861280	
  
	
  
http://www.appledaily.com.tw/realtimenews/
article/new/20151006/705309/	
  
	
  
句法結構歧義
http://www.phil.uu.nl/~yoad/synsem/lecture1/lecture1.html	
  

Tina	
  is	
  not	
  tall	
  and	
  thin.	
  
一字多義
h,ps://www.moedict.tw	
  
	
  
代名詞指涉(Anaphora	
  Resolu.on)
http://web.iiit.ac.in/~sharada.mohanty/content/anaphora-resolution	
  
自然語言處理相關領域
•  語言學	
  
•  統計學	
  
•  機器學習(Machine	
  Learning)	
  
•  資訊檢索(InformaXon	
  Retrieval)	
  
•  資料探勘(Data	
  Mining)	
  
•  …	
  
相關課程
•  台大:	
  
– 資工系 陳信希 自然語言處理	
  
•  Coursera:	
  
– h,ps://www.coursera.org/course/nlp	
  
– h,ps://www.coursera.org/course/nlangp	
  
– h,ps://www.coursera.org/course/nlpintro	
  
講者資訊
•  Mark	
  Chang	
  
–  Blog	
  : h,p://cpmarkchang.logdown.com	
  
–  Slideshare : h,p://www.slideshare.net/ckmarkohchang	
  
–  Github	
  : h,p://github.com/ckmarkoh	
  
–  email	
  : ckmarkoh	
  at	
  gmail.com

More Related Content

What's hot

區塊鏈 (比特幣背後的關鍵技術) -- 十分鐘系列
區塊鏈  (比特幣背後的關鍵技術)   -- 十分鐘系列區塊鏈  (比特幣背後的關鍵技術)   -- 十分鐘系列
區塊鏈 (比特幣背後的關鍵技術) -- 十分鐘系列
鍾誠 陳鍾誠
 
Word2Vec
Word2VecWord2Vec
Word2Vec
hyunyoung Lee
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language ProcessingYasir Khan
 
Dependency Parsing
Dependency ParsingDependency Parsing
Dependency Parsing
Jinho Choi
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
Toine Bogers
 
用十分鐘搞懂 λ-Calculus
用十分鐘搞懂 λ-Calculus用十分鐘搞懂 λ-Calculus
用十分鐘搞懂 λ-Calculus
鍾誠 陳鍾誠
 
Practical Natural Language Processing From Theory to Industrial Applications
Practical Natural Language Processing From Theory to Industrial Applications Practical Natural Language Processing From Theory to Industrial Applications
Practical Natural Language Processing From Theory to Industrial Applications
Jaganadh Gopinadhan
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
CloudxLab
 
如何用十分鐘快速瞭解一個程式語言 《以JavaScript和C語言為例》
如何用十分鐘快速瞭解一個程式語言  《以JavaScript和C語言為例》如何用十分鐘快速瞭解一個程式語言  《以JavaScript和C語言為例》
如何用十分鐘快速瞭解一個程式語言 《以JavaScript和C語言為例》
鍾誠 陳鍾誠
 
Natural Language Processing seminar review
Natural Language Processing seminar review Natural Language Processing seminar review
Natural Language Processing seminar review
Jayneel Vora
 
[系列活動] 一天搞懂對話機器人
[系列活動] 一天搞懂對話機器人[系列活動] 一天搞懂對話機器人
[系列活動] 一天搞懂對話機器人
台灣資料科學年會
 
Word2Vec
Word2VecWord2Vec
Natural lanaguage processing
Natural lanaguage processingNatural lanaguage processing
Natural lanaguage processing
gulshan kumar
 
Bleu vs rouge
Bleu vs rougeBleu vs rouge
Natural Language Processing with Python
Natural Language Processing with PythonNatural Language Processing with Python
Natural Language Processing with Python
Benjamin Bengfort
 
Natural language processing
Natural language processing Natural language processing
Natural language processing
Md.Sumon Sarder
 
Natural language processing
Natural language processingNatural language processing
Natural language processing
KarenVacca
 
Abstractive Text Summarization
Abstractive Text SummarizationAbstractive Text Summarization
Abstractive Text Summarization
Tho Phan
 
What is word2vec?
What is word2vec?What is word2vec?
What is word2vec?
Traian Rebedea
 
Introduction to Named Entity Recognition
Introduction to Named Entity RecognitionIntroduction to Named Entity Recognition
Introduction to Named Entity Recognition
Tomer Lieber
 

What's hot (20)

區塊鏈 (比特幣背後的關鍵技術) -- 十分鐘系列
區塊鏈  (比特幣背後的關鍵技術)   -- 十分鐘系列區塊鏈  (比特幣背後的關鍵技術)   -- 十分鐘系列
區塊鏈 (比特幣背後的關鍵技術) -- 十分鐘系列
 
Word2Vec
Word2VecWord2Vec
Word2Vec
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
Dependency Parsing
Dependency ParsingDependency Parsing
Dependency Parsing
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
用十分鐘搞懂 λ-Calculus
用十分鐘搞懂 λ-Calculus用十分鐘搞懂 λ-Calculus
用十分鐘搞懂 λ-Calculus
 
Practical Natural Language Processing From Theory to Industrial Applications
Practical Natural Language Processing From Theory to Industrial Applications Practical Natural Language Processing From Theory to Industrial Applications
Practical Natural Language Processing From Theory to Industrial Applications
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
如何用十分鐘快速瞭解一個程式語言 《以JavaScript和C語言為例》
如何用十分鐘快速瞭解一個程式語言  《以JavaScript和C語言為例》如何用十分鐘快速瞭解一個程式語言  《以JavaScript和C語言為例》
如何用十分鐘快速瞭解一個程式語言 《以JavaScript和C語言為例》
 
Natural Language Processing seminar review
Natural Language Processing seminar review Natural Language Processing seminar review
Natural Language Processing seminar review
 
[系列活動] 一天搞懂對話機器人
[系列活動] 一天搞懂對話機器人[系列活動] 一天搞懂對話機器人
[系列活動] 一天搞懂對話機器人
 
Word2Vec
Word2VecWord2Vec
Word2Vec
 
Natural lanaguage processing
Natural lanaguage processingNatural lanaguage processing
Natural lanaguage processing
 
Bleu vs rouge
Bleu vs rougeBleu vs rouge
Bleu vs rouge
 
Natural Language Processing with Python
Natural Language Processing with PythonNatural Language Processing with Python
Natural Language Processing with Python
 
Natural language processing
Natural language processing Natural language processing
Natural language processing
 
Natural language processing
Natural language processingNatural language processing
Natural language processing
 
Abstractive Text Summarization
Abstractive Text SummarizationAbstractive Text Summarization
Abstractive Text Summarization
 
What is word2vec?
What is word2vec?What is word2vec?
What is word2vec?
 
Introduction to Named Entity Recognition
Introduction to Named Entity RecognitionIntroduction to Named Entity Recognition
Introduction to Named Entity Recognition
 

Similar to 自然語言處理簡介

Python in word cloud
Python in word cloudPython in word cloud
Python in word cloud
FEG
 
Statistical computing 00
Statistical computing 00Statistical computing 00
Statistical computing 00
Kevin Chun-Hsien Hsu
 
2021《芝麻開門——語音的聲音開啟人類文明的無限空間》台大科學教育中心「探索科學講座」
2021《芝麻開門——語音的聲音開啟人類文明的無限空間》台大科學教育中心「探索科學講座」2021《芝麻開門——語音的聲音開啟人類文明的無限空間》台大科學教育中心「探索科學講座」
2021《芝麻開門——語音的聲音開啟人類文明的無限空間》台大科學教育中心「探索科學講座」
linshanleearchive
 
第九章千年之際展望語料庫語言學 佩娟15
第九章千年之際展望語料庫語言學 佩娟15第九章千年之際展望語料庫語言學 佩娟15
第九章千年之際展望語料庫語言學 佩娟15
ungian iunn
 
芝麻開門:語音技術的前世今生
芝麻開門:語音技術的前世今生芝麻開門:語音技術的前世今生
芝麻開門:語音技術的前世今生
linshanleearchive
 
語音人機互動在各個運算時代下的發展 | Feb. 2018 威盛 OLAMI | 智慧家庭生活服務業交流會
語音人機互動在各個運算時代下的發展 | Feb. 2018 威盛 OLAMI | 智慧家庭生活服務業交流會語音人機互動在各個運算時代下的發展 | Feb. 2018 威盛 OLAMI | 智慧家庭生活服務業交流會
語音人機互動在各個運算時代下的發展 | Feb. 2018 威盛 OLAMI | 智慧家庭生活服務業交流會
olami.ai
 
腾讯大讲堂49期 产品翻译面面谈
腾讯大讲堂49期 产品翻译面面谈腾讯大讲堂49期 产品翻译面面谈
腾讯大讲堂49期 产品翻译面面谈George Ang
 

Similar to 自然語言處理簡介 (7)

Python in word cloud
Python in word cloudPython in word cloud
Python in word cloud
 
Statistical computing 00
Statistical computing 00Statistical computing 00
Statistical computing 00
 
2021《芝麻開門——語音的聲音開啟人類文明的無限空間》台大科學教育中心「探索科學講座」
2021《芝麻開門——語音的聲音開啟人類文明的無限空間》台大科學教育中心「探索科學講座」2021《芝麻開門——語音的聲音開啟人類文明的無限空間》台大科學教育中心「探索科學講座」
2021《芝麻開門——語音的聲音開啟人類文明的無限空間》台大科學教育中心「探索科學講座」
 
第九章千年之際展望語料庫語言學 佩娟15
第九章千年之際展望語料庫語言學 佩娟15第九章千年之際展望語料庫語言學 佩娟15
第九章千年之際展望語料庫語言學 佩娟15
 
芝麻開門:語音技術的前世今生
芝麻開門:語音技術的前世今生芝麻開門:語音技術的前世今生
芝麻開門:語音技術的前世今生
 
語音人機互動在各個運算時代下的發展 | Feb. 2018 威盛 OLAMI | 智慧家庭生活服務業交流會
語音人機互動在各個運算時代下的發展 | Feb. 2018 威盛 OLAMI | 智慧家庭生活服務業交流會語音人機互動在各個運算時代下的發展 | Feb. 2018 威盛 OLAMI | 智慧家庭生活服務業交流會
語音人機互動在各個運算時代下的發展 | Feb. 2018 威盛 OLAMI | 智慧家庭生活服務業交流會
 
腾讯大讲堂49期 产品翻译面面谈
腾讯大讲堂49期 产品翻译面面谈腾讯大讲堂49期 产品翻译面面谈
腾讯大讲堂49期 产品翻译面面谈
 

More from Mark Chang

Modeling the Dynamics of SGD by Stochastic Differential Equation
Modeling the Dynamics of SGD by Stochastic Differential EquationModeling the Dynamics of SGD by Stochastic Differential Equation
Modeling the Dynamics of SGD by Stochastic Differential Equation
Mark Chang
 
Modeling the Dynamics of SGD by Stochastic Differential Equation
Modeling the Dynamics of SGD by Stochastic Differential EquationModeling the Dynamics of SGD by Stochastic Differential Equation
Modeling the Dynamics of SGD by Stochastic Differential Equation
Mark Chang
 
Information in the Weights
Information in the WeightsInformation in the Weights
Information in the Weights
Mark Chang
 
Information in the Weights
Information in the WeightsInformation in the Weights
Information in the Weights
Mark Chang
 
PAC Bayesian for Deep Learning
PAC Bayesian for Deep LearningPAC Bayesian for Deep Learning
PAC Bayesian for Deep Learning
Mark Chang
 
PAC-Bayesian Bound for Deep Learning
PAC-Bayesian Bound for Deep LearningPAC-Bayesian Bound for Deep Learning
PAC-Bayesian Bound for Deep Learning
Mark Chang
 
Domain Adaptation
Domain AdaptationDomain Adaptation
Domain Adaptation
Mark Chang
 
NTU ML TENSORFLOW
NTU ML TENSORFLOWNTU ML TENSORFLOW
NTU ML TENSORFLOW
Mark Chang
 
NTHU AI Reading Group: Improved Training of Wasserstein GANs
NTHU AI Reading Group: Improved Training of Wasserstein GANsNTHU AI Reading Group: Improved Training of Wasserstein GANs
NTHU AI Reading Group: Improved Training of Wasserstein GANs
Mark Chang
 
Generative Adversarial Networks
Generative Adversarial NetworksGenerative Adversarial Networks
Generative Adversarial Networks
Mark Chang
 
Applied Deep Learning 11/03 Convolutional Neural Networks
Applied Deep Learning 11/03 Convolutional Neural NetworksApplied Deep Learning 11/03 Convolutional Neural Networks
Applied Deep Learning 11/03 Convolutional Neural Networks
Mark Chang
 
The Genome Assembly Problem
The Genome Assembly ProblemThe Genome Assembly Problem
The Genome Assembly Problem
Mark Chang
 
DRAW: Deep Recurrent Attentive Writer
DRAW: Deep Recurrent Attentive WriterDRAW: Deep Recurrent Attentive Writer
DRAW: Deep Recurrent Attentive Writer
Mark Chang
 
淺談深度學習
淺談深度學習淺談深度學習
淺談深度學習
Mark Chang
 
Variational Autoencoder
Variational AutoencoderVariational Autoencoder
Variational Autoencoder
Mark Chang
 
TensorFlow 深度學習快速上手班--深度學習
 TensorFlow 深度學習快速上手班--深度學習 TensorFlow 深度學習快速上手班--深度學習
TensorFlow 深度學習快速上手班--深度學習
Mark Chang
 
TensorFlow 深度學習快速上手班--電腦視覺應用
TensorFlow 深度學習快速上手班--電腦視覺應用TensorFlow 深度學習快速上手班--電腦視覺應用
TensorFlow 深度學習快速上手班--電腦視覺應用
Mark Chang
 
TensorFlow 深度學習快速上手班--自然語言處理應用
TensorFlow 深度學習快速上手班--自然語言處理應用TensorFlow 深度學習快速上手班--自然語言處理應用
TensorFlow 深度學習快速上手班--自然語言處理應用
Mark Chang
 
TensorFlow 深度學習快速上手班--機器學習
TensorFlow 深度學習快速上手班--機器學習TensorFlow 深度學習快速上手班--機器學習
TensorFlow 深度學習快速上手班--機器學習
Mark Chang
 
Computational Linguistics week 10
 Computational Linguistics week 10 Computational Linguistics week 10
Computational Linguistics week 10
Mark Chang
 

More from Mark Chang (20)

Modeling the Dynamics of SGD by Stochastic Differential Equation
Modeling the Dynamics of SGD by Stochastic Differential EquationModeling the Dynamics of SGD by Stochastic Differential Equation
Modeling the Dynamics of SGD by Stochastic Differential Equation
 
Modeling the Dynamics of SGD by Stochastic Differential Equation
Modeling the Dynamics of SGD by Stochastic Differential EquationModeling the Dynamics of SGD by Stochastic Differential Equation
Modeling the Dynamics of SGD by Stochastic Differential Equation
 
Information in the Weights
Information in the WeightsInformation in the Weights
Information in the Weights
 
Information in the Weights
Information in the WeightsInformation in the Weights
Information in the Weights
 
PAC Bayesian for Deep Learning
PAC Bayesian for Deep LearningPAC Bayesian for Deep Learning
PAC Bayesian for Deep Learning
 
PAC-Bayesian Bound for Deep Learning
PAC-Bayesian Bound for Deep LearningPAC-Bayesian Bound for Deep Learning
PAC-Bayesian Bound for Deep Learning
 
Domain Adaptation
Domain AdaptationDomain Adaptation
Domain Adaptation
 
NTU ML TENSORFLOW
NTU ML TENSORFLOWNTU ML TENSORFLOW
NTU ML TENSORFLOW
 
NTHU AI Reading Group: Improved Training of Wasserstein GANs
NTHU AI Reading Group: Improved Training of Wasserstein GANsNTHU AI Reading Group: Improved Training of Wasserstein GANs
NTHU AI Reading Group: Improved Training of Wasserstein GANs
 
Generative Adversarial Networks
Generative Adversarial NetworksGenerative Adversarial Networks
Generative Adversarial Networks
 
Applied Deep Learning 11/03 Convolutional Neural Networks
Applied Deep Learning 11/03 Convolutional Neural NetworksApplied Deep Learning 11/03 Convolutional Neural Networks
Applied Deep Learning 11/03 Convolutional Neural Networks
 
The Genome Assembly Problem
The Genome Assembly ProblemThe Genome Assembly Problem
The Genome Assembly Problem
 
DRAW: Deep Recurrent Attentive Writer
DRAW: Deep Recurrent Attentive WriterDRAW: Deep Recurrent Attentive Writer
DRAW: Deep Recurrent Attentive Writer
 
淺談深度學習
淺談深度學習淺談深度學習
淺談深度學習
 
Variational Autoencoder
Variational AutoencoderVariational Autoencoder
Variational Autoencoder
 
TensorFlow 深度學習快速上手班--深度學習
 TensorFlow 深度學習快速上手班--深度學習 TensorFlow 深度學習快速上手班--深度學習
TensorFlow 深度學習快速上手班--深度學習
 
TensorFlow 深度學習快速上手班--電腦視覺應用
TensorFlow 深度學習快速上手班--電腦視覺應用TensorFlow 深度學習快速上手班--電腦視覺應用
TensorFlow 深度學習快速上手班--電腦視覺應用
 
TensorFlow 深度學習快速上手班--自然語言處理應用
TensorFlow 深度學習快速上手班--自然語言處理應用TensorFlow 深度學習快速上手班--自然語言處理應用
TensorFlow 深度學習快速上手班--自然語言處理應用
 
TensorFlow 深度學習快速上手班--機器學習
TensorFlow 深度學習快速上手班--機器學習TensorFlow 深度學習快速上手班--機器學習
TensorFlow 深度學習快速上手班--機器學習
 
Computational Linguistics week 10
 Computational Linguistics week 10 Computational Linguistics week 10
Computational Linguistics week 10
 

自然語言處理簡介