SlideShare a Scribd company logo
How AI understands language
Wei Xu
Department of Computer Science and Engineering
March-15-2018 @ Women in Analytics Conference
The Turing Test
Alan Turing (1912-1954) mathematician, world-class Marathon runner, forced to chemical castration for homosexuality conviction.
. , ,
. .
Natural language processing (NLP)
2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017
865
770 749
660
860 863 930 894 880 823 871 845
732
887 931 887
1,190
1,104
1,620 1,597
1,315
1,583 1,641 1,562
2,123 2,104
1,602
2,151 2,136
2,028 2,064 2,093
1,990
2,536
2,901 2,949
Number of Members
Association for Computational Linguistics is an organization of world leading Natural Language Processing researchers since 1962.
The goal is to enable computers to understand and generate human language.
USA
Worldwide
The Holy Grail of AI / NLP
Human language is ambiguous, creative, infinite, and ever evolving.
The Holy Grail of AI / NLP
Human language is ambiguous, creative, infinite, and ever evolving.
. . 	. . 	
Photo Credit: Kristy Wigglesworth / AP
The Holy Grail of AI / NLP
word “selfie” in Google Trends
Human language is ambiguous, creative, infinite, and ever evolving.
Images from http://www.ufunk.net/en/gadgets/selfie-arm/
The Holy Grail of AI / NLP
. word
, phrase
. . 	sentence. . 	
Solution: learning large-scale paraphrases
Human language is ambiguous, creative, infinite, and ever evolving.
Wei Xu. “Data-driven Approaches for Paraphrasing Across Language Variations” PhD Thesis (2014)
Natural language understanding
match
. . , . ,
Question Answering
., .
. , .
. , 	 . .
.
Natural language generation
Text Simplification
(adapting machine translation techniques)
Wei Xu, Courtney Napoles, Ellie Pavlick, Chris Callison-Burch. “Optimizing Statistical Machine Translation for Simplification” in TACL (2016)
Designing Various [Machine learning] models
• Multi-instance Learning Models [Xu et al. 2014; Tabassum et al. 2016]
Wei Xu, Alan Ritter, Chris Callison-Burch, Bill Dolan, Yangfeng Ji “Extracting Lexically Divergent Paraphrases from Twitter” in TACL (2014)
(Viterbi approximation + online learning)
Designing Various [Machine learning] models
Wuwei Lan, Wei Xu. “The Important Role of Subword Embeddings in Sentence Pair Modeling” in NAACL (2018)
• Deep Pairwise Neural Networks [He et al. 2015; Lan et al. 2017; Lan and Xu 2018]
Bi-LSTM
Decompose sentence input into word context to reduce modeling difficulty
GloVe
or subword CNN 

Highway Network
Multiple vector similarity measurements used to capture word pair relationship
Designing Various [Machine learning] models
• Deep Pairwise Neural Networks [He et al. 2015; Lan et al. 2017; Lan and Xu 2018]
Wuwei Lan, Siyu Qiu, Hua He, Wei Xu “A Continuously Growing Dataset of Sentential Paraphrases” in EMNLP (2017)
Designing Various [Machine learning] models
Hua He and Jimmy Lin. “Pairwise Word Interaction Modeling with Deep Neural Networks for Semantic Similarity Measurement” in NAACL (2016)
• Deep Pairwise Neural Networks [He et al. 2015; Lan et al. 2017; Lan and Xu 2018]
More attention added to top ranked word pairs.
Designing Various [Machine learning] models
• Deep Pairwise Neural Networks [He et al. 2015; Lan et al. 2017; Lan and Xu 2018]
Sentence pair relationship identified by pattern recognition through ConvNet.
Hua He and Jimmy Lin. “Pairwise Word Interaction Modeling with Deep Neural Networks for Semantic Similarity Measurement” in NAACL (2016)
[data science] for linguistic styles
she says he says
wonderfully delightfully beautifully fine well good nicely superbly
Daniel Preotiuc, Wei Xu, Lyle Ungar. “Discovering User Attribute Stylistic Differences via Paraphrasing” in AAAI (2016)
(also studied age & income)
Machine reading of instructions
Chaitanya Kulkarni, Wei Xu, Alan Ritter, Raghu Machiraju. “An Annotated Corpus for Machine Reading of Instructions in Wet Lab Protocols” in NAACL (2018)
Wet Lab Protocols:
(Photo: Moley Robotic Chef)
http://web.cse.ohio-state.edu/~weixu/
Thank you
Assistant ProfessorWei Xu
Department of Computer Science and Engineering
Ohio State University

More Related Content

Similar to Wei Xu - Innovative Applications of AI Panel

The impact of standardized terminologies and domain-ontologies in multilingua...
The impact of standardized terminologies and domain-ontologies in multilingua...The impact of standardized terminologies and domain-ontologies in multilingua...
The impact of standardized terminologies and domain-ontologies in multilingua...
AIMS (Agricultural Information Management Standards)
 
Current Issue: April 2019, Volume 8, Number 2
Current Issue: April 2019, Volume 8, Number 2Current Issue: April 2019, Volume 8, Number 2
Current Issue: April 2019, Volume 8, Number 2
kevig
 
Vectorland: Brief Notes from Using Text Embeddings for Search
Vectorland: Brief Notes from Using Text Embeddings for SearchVectorland: Brief Notes from Using Text Embeddings for Search
Vectorland: Brief Notes from Using Text Embeddings for Search
Bhaskar Mitra
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
Gabe Wilberscheid
 
Jacob Eisenstein, Assistant Professor, School of Interactive Computing, Georg...
Jacob Eisenstein, Assistant Professor, School of Interactive Computing, Georg...Jacob Eisenstein, Assistant Professor, School of Interactive Computing, Georg...
Jacob Eisenstein, Assistant Professor, School of Interactive Computing, Georg...
MLconf
 
Questions On Natural Language Processing
Questions On Natural Language ProcessingQuestions On Natural Language Processing
Questions On Natural Language Processing
Adriana Wilson
 
Aibdconference chat bot for every product Maksym Volchenko
Aibdconference chat bot for every product Maksym VolchenkoAibdconference chat bot for every product Maksym Volchenko
Aibdconference chat bot for every product Maksym Volchenko
Olga Zinkevych
 
EricRochesterResume
EricRochesterResumeEricRochesterResume
EricRochesterResume
Eric Rochester
 
NLP Introduction.ppt machine learning presentation
NLP  Introduction.ppt machine learning presentationNLP  Introduction.ppt machine learning presentation
NLP Introduction.ppt machine learning presentation
PriyankaRamavath3
 
Should we be afraid of Transformers?
Should we be afraid of Transformers?Should we be afraid of Transformers?
Should we be afraid of Transformers?
Dominik Seisser
 
"The Transformative Power of AI and Open Challenges" by Dr. Manish Gupta, Google
"The Transformative Power of AI and Open Challenges" by Dr. Manish Gupta, Google"The Transformative Power of AI and Open Challenges" by Dr. Manish Gupta, Google
"The Transformative Power of AI and Open Challenges" by Dr. Manish Gupta, Google
ISPMAIndia
 
Using Stanza NLP and TensorFlow to create a summary of a book
Using Stanza NLP and TensorFlow to create a summary of a bookUsing Stanza NLP and TensorFlow to create a summary of a book
Using Stanza NLP and TensorFlow to create a summary of a book
Olusola Amusan
 
Training at AI Frontiers 2018 - Ni Lao: Weakly Supervised Natural Language Un...
Training at AI Frontiers 2018 - Ni Lao: Weakly Supervised Natural Language Un...Training at AI Frontiers 2018 - Ni Lao: Weakly Supervised Natural Language Un...
Training at AI Frontiers 2018 - Ni Lao: Weakly Supervised Natural Language Un...
AI Frontiers
 
Language Grid
Language GridLanguage Grid
Language Grid
lindh
 
Nonparametric Bayesian Word Discovery for Symbol Emergence in Robotics
Nonparametric Bayesian Word Discovery for Symbol Emergence in RoboticsNonparametric Bayesian Word Discovery for Symbol Emergence in Robotics
Nonparametric Bayesian Word Discovery for Symbol Emergence in Robotics
Tadahiro Taniguchi
 
The Evolution of Speech Recognition Datasets: Fueling the Future of AI
The Evolution of Speech Recognition Datasets: Fueling the Future of AIThe Evolution of Speech Recognition Datasets: Fueling the Future of AI
The Evolution of Speech Recognition Datasets: Fueling the Future of AI
GLOBOSE TECHNOLOGY SOLUTIONS PRIVATE LIMITED
 
SLSP 2017 presentation - Attentional Parallel RNNs for Generating Punctuation...
SLSP 2017 presentation - Attentional Parallel RNNs for Generating Punctuation...SLSP 2017 presentation - Attentional Parallel RNNs for Generating Punctuation...
SLSP 2017 presentation - Attentional Parallel RNNs for Generating Punctuation...
Alp Öktem
 
Machines are people too
Machines are people tooMachines are people too
Machines are people too
Paul Groth
 
New Frontiers in IA: Design in the Era of Cognitive Computing
New Frontiers in IA: Design in the Era of Cognitive ComputingNew Frontiers in IA: Design in the Era of Cognitive Computing
New Frontiers in IA: Design in the Era of Cognitive Computing
Paul King
 
XAI LANGUAGE TUTOR - A XAI-BASED LANGUAGE LEARNING CHATBOT USING ONTOLOGY AND...
XAI LANGUAGE TUTOR - A XAI-BASED LANGUAGE LEARNING CHATBOT USING ONTOLOGY AND...XAI LANGUAGE TUTOR - A XAI-BASED LANGUAGE LEARNING CHATBOT USING ONTOLOGY AND...
XAI LANGUAGE TUTOR - A XAI-BASED LANGUAGE LEARNING CHATBOT USING ONTOLOGY AND...
ijnlc
 

Similar to Wei Xu - Innovative Applications of AI Panel (20)

The impact of standardized terminologies and domain-ontologies in multilingua...
The impact of standardized terminologies and domain-ontologies in multilingua...The impact of standardized terminologies and domain-ontologies in multilingua...
The impact of standardized terminologies and domain-ontologies in multilingua...
 
Current Issue: April 2019, Volume 8, Number 2
Current Issue: April 2019, Volume 8, Number 2Current Issue: April 2019, Volume 8, Number 2
Current Issue: April 2019, Volume 8, Number 2
 
Vectorland: Brief Notes from Using Text Embeddings for Search
Vectorland: Brief Notes from Using Text Embeddings for SearchVectorland: Brief Notes from Using Text Embeddings for Search
Vectorland: Brief Notes from Using Text Embeddings for Search
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
Jacob Eisenstein, Assistant Professor, School of Interactive Computing, Georg...
Jacob Eisenstein, Assistant Professor, School of Interactive Computing, Georg...Jacob Eisenstein, Assistant Professor, School of Interactive Computing, Georg...
Jacob Eisenstein, Assistant Professor, School of Interactive Computing, Georg...
 
Questions On Natural Language Processing
Questions On Natural Language ProcessingQuestions On Natural Language Processing
Questions On Natural Language Processing
 
Aibdconference chat bot for every product Maksym Volchenko
Aibdconference chat bot for every product Maksym VolchenkoAibdconference chat bot for every product Maksym Volchenko
Aibdconference chat bot for every product Maksym Volchenko
 
EricRochesterResume
EricRochesterResumeEricRochesterResume
EricRochesterResume
 
NLP Introduction.ppt machine learning presentation
NLP  Introduction.ppt machine learning presentationNLP  Introduction.ppt machine learning presentation
NLP Introduction.ppt machine learning presentation
 
Should we be afraid of Transformers?
Should we be afraid of Transformers?Should we be afraid of Transformers?
Should we be afraid of Transformers?
 
"The Transformative Power of AI and Open Challenges" by Dr. Manish Gupta, Google
"The Transformative Power of AI and Open Challenges" by Dr. Manish Gupta, Google"The Transformative Power of AI and Open Challenges" by Dr. Manish Gupta, Google
"The Transformative Power of AI and Open Challenges" by Dr. Manish Gupta, Google
 
Using Stanza NLP and TensorFlow to create a summary of a book
Using Stanza NLP and TensorFlow to create a summary of a bookUsing Stanza NLP and TensorFlow to create a summary of a book
Using Stanza NLP and TensorFlow to create a summary of a book
 
Training at AI Frontiers 2018 - Ni Lao: Weakly Supervised Natural Language Un...
Training at AI Frontiers 2018 - Ni Lao: Weakly Supervised Natural Language Un...Training at AI Frontiers 2018 - Ni Lao: Weakly Supervised Natural Language Un...
Training at AI Frontiers 2018 - Ni Lao: Weakly Supervised Natural Language Un...
 
Language Grid
Language GridLanguage Grid
Language Grid
 
Nonparametric Bayesian Word Discovery for Symbol Emergence in Robotics
Nonparametric Bayesian Word Discovery for Symbol Emergence in RoboticsNonparametric Bayesian Word Discovery for Symbol Emergence in Robotics
Nonparametric Bayesian Word Discovery for Symbol Emergence in Robotics
 
The Evolution of Speech Recognition Datasets: Fueling the Future of AI
The Evolution of Speech Recognition Datasets: Fueling the Future of AIThe Evolution of Speech Recognition Datasets: Fueling the Future of AI
The Evolution of Speech Recognition Datasets: Fueling the Future of AI
 
SLSP 2017 presentation - Attentional Parallel RNNs for Generating Punctuation...
SLSP 2017 presentation - Attentional Parallel RNNs for Generating Punctuation...SLSP 2017 presentation - Attentional Parallel RNNs for Generating Punctuation...
SLSP 2017 presentation - Attentional Parallel RNNs for Generating Punctuation...
 
Machines are people too
Machines are people tooMachines are people too
Machines are people too
 
New Frontiers in IA: Design in the Era of Cognitive Computing
New Frontiers in IA: Design in the Era of Cognitive ComputingNew Frontiers in IA: Design in the Era of Cognitive Computing
New Frontiers in IA: Design in the Era of Cognitive Computing
 
XAI LANGUAGE TUTOR - A XAI-BASED LANGUAGE LEARNING CHATBOT USING ONTOLOGY AND...
XAI LANGUAGE TUTOR - A XAI-BASED LANGUAGE LEARNING CHATBOT USING ONTOLOGY AND...XAI LANGUAGE TUTOR - A XAI-BASED LANGUAGE LEARNING CHATBOT USING ONTOLOGY AND...
XAI LANGUAGE TUTOR - A XAI-BASED LANGUAGE LEARNING CHATBOT USING ONTOLOGY AND...
 

More from Rehgan Avon

Ezgi Karaesmen - Data Cleaning and Manipulation with R
Ezgi Karaesmen - Data Cleaning and Manipulation with REzgi Karaesmen - Data Cleaning and Manipulation with R
Ezgi Karaesmen - Data Cleaning and Manipulation with R
Rehgan Avon
 
Dr. Karen Amstutz - Digitizing Health: How Analytics are Disrupting Healthca...
Dr. Karen Amstutz - Digitizing Health:  How Analytics are Disrupting Healthca...Dr. Karen Amstutz - Digitizing Health:  How Analytics are Disrupting Healthca...
Dr. Karen Amstutz - Digitizing Health: How Analytics are Disrupting Healthca...
Rehgan Avon
 
Amanda Cinnamon - Treat Your Code Like the Valuable Software It Is
Amanda Cinnamon - Treat Your Code Like the Valuable Software It IsAmanda Cinnamon - Treat Your Code Like the Valuable Software It Is
Amanda Cinnamon - Treat Your Code Like the Valuable Software It Is
Rehgan Avon
 
Cheryl Wiebe - Advanced Analytics in the Industrial World
Cheryl Wiebe - Advanced Analytics in the Industrial WorldCheryl Wiebe - Advanced Analytics in the Industrial World
Cheryl Wiebe - Advanced Analytics in the Industrial World
Rehgan Avon
 
Helen Patton - Governing Big Data: Security, Privacy & Data Management
Helen Patton - Governing Big Data: Security, Privacy & Data ManagementHelen Patton - Governing Big Data: Security, Privacy & Data Management
Helen Patton - Governing Big Data: Security, Privacy & Data Management
Rehgan Avon
 
Dr. Lara Sucheston-Campbell - Building a working farm: Planning and planting ...
Dr. Lara Sucheston-Campbell - Building a working farm: Planning and planting ...Dr. Lara Sucheston-Campbell - Building a working farm: Planning and planting ...
Dr. Lara Sucheston-Campbell - Building a working farm: Planning and planting ...
Rehgan Avon
 
Kelly O'Briant - DataOps in the Cloud: How To Supercharge Data Science with a...
Kelly O'Briant - DataOps in the Cloud: How To Supercharge Data Science with a...Kelly O'Briant - DataOps in the Cloud: How To Supercharge Data Science with a...
Kelly O'Briant - DataOps in the Cloud: How To Supercharge Data Science with a...
Rehgan Avon
 
Bijaya Zenchenko - An Embedding is Worth 1000 Words - Start Using Word Embedd...
Bijaya Zenchenko - An Embedding is Worth 1000 Words - Start Using Word Embedd...Bijaya Zenchenko - An Embedding is Worth 1000 Words - Start Using Word Embedd...
Bijaya Zenchenko - An Embedding is Worth 1000 Words - Start Using Word Embedd...
Rehgan Avon
 
BDAA_Newsletter
BDAA_NewsletterBDAA_Newsletter
BDAA_Newsletter
Rehgan Avon
 

More from Rehgan Avon (9)

Ezgi Karaesmen - Data Cleaning and Manipulation with R
Ezgi Karaesmen - Data Cleaning and Manipulation with REzgi Karaesmen - Data Cleaning and Manipulation with R
Ezgi Karaesmen - Data Cleaning and Manipulation with R
 
Dr. Karen Amstutz - Digitizing Health: How Analytics are Disrupting Healthca...
Dr. Karen Amstutz - Digitizing Health:  How Analytics are Disrupting Healthca...Dr. Karen Amstutz - Digitizing Health:  How Analytics are Disrupting Healthca...
Dr. Karen Amstutz - Digitizing Health: How Analytics are Disrupting Healthca...
 
Amanda Cinnamon - Treat Your Code Like the Valuable Software It Is
Amanda Cinnamon - Treat Your Code Like the Valuable Software It IsAmanda Cinnamon - Treat Your Code Like the Valuable Software It Is
Amanda Cinnamon - Treat Your Code Like the Valuable Software It Is
 
Cheryl Wiebe - Advanced Analytics in the Industrial World
Cheryl Wiebe - Advanced Analytics in the Industrial WorldCheryl Wiebe - Advanced Analytics in the Industrial World
Cheryl Wiebe - Advanced Analytics in the Industrial World
 
Helen Patton - Governing Big Data: Security, Privacy & Data Management
Helen Patton - Governing Big Data: Security, Privacy & Data ManagementHelen Patton - Governing Big Data: Security, Privacy & Data Management
Helen Patton - Governing Big Data: Security, Privacy & Data Management
 
Dr. Lara Sucheston-Campbell - Building a working farm: Planning and planting ...
Dr. Lara Sucheston-Campbell - Building a working farm: Planning and planting ...Dr. Lara Sucheston-Campbell - Building a working farm: Planning and planting ...
Dr. Lara Sucheston-Campbell - Building a working farm: Planning and planting ...
 
Kelly O'Briant - DataOps in the Cloud: How To Supercharge Data Science with a...
Kelly O'Briant - DataOps in the Cloud: How To Supercharge Data Science with a...Kelly O'Briant - DataOps in the Cloud: How To Supercharge Data Science with a...
Kelly O'Briant - DataOps in the Cloud: How To Supercharge Data Science with a...
 
Bijaya Zenchenko - An Embedding is Worth 1000 Words - Start Using Word Embedd...
Bijaya Zenchenko - An Embedding is Worth 1000 Words - Start Using Word Embedd...Bijaya Zenchenko - An Embedding is Worth 1000 Words - Start Using Word Embedd...
Bijaya Zenchenko - An Embedding is Worth 1000 Words - Start Using Word Embedd...
 
BDAA_Newsletter
BDAA_NewsletterBDAA_Newsletter
BDAA_Newsletter
 

Recently uploaded

A presentation that explain the Power BI Licensing
A presentation that explain the Power BI LicensingA presentation that explain the Power BI Licensing
A presentation that explain the Power BI Licensing
AlessioFois2
 
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataPredictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Kiwi Creative
 
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
bopyb
 
一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理
一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理
一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理
1tyxnjpia
 
社内勉強会資料_Hallucination of LLMs               .
社内勉強会資料_Hallucination of LLMs               .社内勉強会資料_Hallucination of LLMs               .
社内勉強会資料_Hallucination of LLMs               .
NABLAS株式会社
 
writing report business partner b1+ .pdf
writing report business partner b1+ .pdfwriting report business partner b1+ .pdf
writing report business partner b1+ .pdf
VyNguyen709676
 
原版一比一爱尔兰都柏林大学毕业证(UCD毕业证书)如何办理
原版一比一爱尔兰都柏林大学毕业证(UCD毕业证书)如何办理 原版一比一爱尔兰都柏林大学毕业证(UCD毕业证书)如何办理
原版一比一爱尔兰都柏林大学毕业证(UCD毕业证书)如何办理
tzu5xla
 
一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理
一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理
一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理
slg6lamcq
 
Sample Devops SRE Product Companies .pdf
Sample Devops SRE  Product Companies .pdfSample Devops SRE  Product Companies .pdf
Sample Devops SRE Product Companies .pdf
Vineet
 
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Kaxil Naik
 
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
ytypuem
 
一比一原版卡尔加里大学毕业证(uc毕业证)如何办理
一比一原版卡尔加里大学毕业证(uc毕业证)如何办理一比一原版卡尔加里大学毕业证(uc毕业证)如何办理
一比一原版卡尔加里大学毕业证(uc毕业证)如何办理
oaxefes
 
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
nuttdpt
 
University of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma TranscriptUniversity of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma Transcript
soxrziqu
 
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
v7oacc3l
 
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
nyfuhyz
 
Template xxxxxxxx ssssssssssss Sertifikat.pptx
Template xxxxxxxx ssssssssssss Sertifikat.pptxTemplate xxxxxxxx ssssssssssss Sertifikat.pptx
Template xxxxxxxx ssssssssssss Sertifikat.pptx
TeukuEriSyahputra
 
Building a Quantum Computer Neutral Atom.pdf
Building a Quantum Computer Neutral Atom.pdfBuilding a Quantum Computer Neutral Atom.pdf
Building a Quantum Computer Neutral Atom.pdf
cjimenez2581
 
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
nyvan3
 
DSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelinesDSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelines
Timothy Spann
 

Recently uploaded (20)

A presentation that explain the Power BI Licensing
A presentation that explain the Power BI LicensingA presentation that explain the Power BI Licensing
A presentation that explain the Power BI Licensing
 
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging DataPredictably Improve Your B2B Tech Company's Performance by Leveraging Data
Predictably Improve Your B2B Tech Company's Performance by Leveraging Data
 
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
一比一原版(GWU,GW文凭证书)乔治·华盛顿大学毕业证如何办理
 
一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理
一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理
一比一原版(Sheffield毕业证书)谢菲尔德大学毕业证如何办理
 
社内勉強会資料_Hallucination of LLMs               .
社内勉強会資料_Hallucination of LLMs               .社内勉強会資料_Hallucination of LLMs               .
社内勉強会資料_Hallucination of LLMs               .
 
writing report business partner b1+ .pdf
writing report business partner b1+ .pdfwriting report business partner b1+ .pdf
writing report business partner b1+ .pdf
 
原版一比一爱尔兰都柏林大学毕业证(UCD毕业证书)如何办理
原版一比一爱尔兰都柏林大学毕业证(UCD毕业证书)如何办理 原版一比一爱尔兰都柏林大学毕业证(UCD毕业证书)如何办理
原版一比一爱尔兰都柏林大学毕业证(UCD毕业证书)如何办理
 
一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理
一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理
一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理
 
Sample Devops SRE Product Companies .pdf
Sample Devops SRE  Product Companies .pdfSample Devops SRE  Product Companies .pdf
Sample Devops SRE Product Companies .pdf
 
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
Orchestrating the Future: Navigating Today's Data Workflow Challenges with Ai...
 
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
 
一比一原版卡尔加里大学毕业证(uc毕业证)如何办理
一比一原版卡尔加里大学毕业证(uc毕业证)如何办理一比一原版卡尔加里大学毕业证(uc毕业证)如何办理
一比一原版卡尔加里大学毕业证(uc毕业证)如何办理
 
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
 
University of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma TranscriptUniversity of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma Transcript
 
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
在线办理(英国UCA毕业证书)创意艺术大学毕业证在读证明一模一样
 
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
一比一原版(UMN文凭证书)明尼苏达大学毕业证如何办理
 
Template xxxxxxxx ssssssssssss Sertifikat.pptx
Template xxxxxxxx ssssssssssss Sertifikat.pptxTemplate xxxxxxxx ssssssssssss Sertifikat.pptx
Template xxxxxxxx ssssssssssss Sertifikat.pptx
 
Building a Quantum Computer Neutral Atom.pdf
Building a Quantum Computer Neutral Atom.pdfBuilding a Quantum Computer Neutral Atom.pdf
Building a Quantum Computer Neutral Atom.pdf
 
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
 
DSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelinesDSSML24_tspann_CodelessGenerativeAIPipelines
DSSML24_tspann_CodelessGenerativeAIPipelines
 

Wei Xu - Innovative Applications of AI Panel

  • 1. How AI understands language Wei Xu Department of Computer Science and Engineering March-15-2018 @ Women in Analytics Conference
  • 2. The Turing Test Alan Turing (1912-1954) mathematician, world-class Marathon runner, forced to chemical castration for homosexuality conviction. . , , . .
  • 3. Natural language processing (NLP) 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 865 770 749 660 860 863 930 894 880 823 871 845 732 887 931 887 1,190 1,104 1,620 1,597 1,315 1,583 1,641 1,562 2,123 2,104 1,602 2,151 2,136 2,028 2,064 2,093 1,990 2,536 2,901 2,949 Number of Members Association for Computational Linguistics is an organization of world leading Natural Language Processing researchers since 1962. The goal is to enable computers to understand and generate human language. USA Worldwide
  • 4. The Holy Grail of AI / NLP Human language is ambiguous, creative, infinite, and ever evolving.
  • 5. The Holy Grail of AI / NLP Human language is ambiguous, creative, infinite, and ever evolving. . . . . Photo Credit: Kristy Wigglesworth / AP
  • 6. The Holy Grail of AI / NLP word “selfie” in Google Trends Human language is ambiguous, creative, infinite, and ever evolving. Images from http://www.ufunk.net/en/gadgets/selfie-arm/
  • 7. The Holy Grail of AI / NLP . word , phrase . . sentence. . Solution: learning large-scale paraphrases Human language is ambiguous, creative, infinite, and ever evolving. Wei Xu. “Data-driven Approaches for Paraphrasing Across Language Variations” PhD Thesis (2014)
  • 8. Natural language understanding match . . , . , Question Answering ., . . , . . , . . .
  • 9. Natural language generation Text Simplification (adapting machine translation techniques) Wei Xu, Courtney Napoles, Ellie Pavlick, Chris Callison-Burch. “Optimizing Statistical Machine Translation for Simplification” in TACL (2016)
  • 10. Designing Various [Machine learning] models • Multi-instance Learning Models [Xu et al. 2014; Tabassum et al. 2016] Wei Xu, Alan Ritter, Chris Callison-Burch, Bill Dolan, Yangfeng Ji “Extracting Lexically Divergent Paraphrases from Twitter” in TACL (2014) (Viterbi approximation + online learning)
  • 11. Designing Various [Machine learning] models Wuwei Lan, Wei Xu. “The Important Role of Subword Embeddings in Sentence Pair Modeling” in NAACL (2018) • Deep Pairwise Neural Networks [He et al. 2015; Lan et al. 2017; Lan and Xu 2018] Bi-LSTM Decompose sentence input into word context to reduce modeling difficulty GloVe or subword CNN 
 Highway Network
  • 12. Multiple vector similarity measurements used to capture word pair relationship Designing Various [Machine learning] models • Deep Pairwise Neural Networks [He et al. 2015; Lan et al. 2017; Lan and Xu 2018] Wuwei Lan, Siyu Qiu, Hua He, Wei Xu “A Continuously Growing Dataset of Sentential Paraphrases” in EMNLP (2017)
  • 13. Designing Various [Machine learning] models Hua He and Jimmy Lin. “Pairwise Word Interaction Modeling with Deep Neural Networks for Semantic Similarity Measurement” in NAACL (2016) • Deep Pairwise Neural Networks [He et al. 2015; Lan et al. 2017; Lan and Xu 2018] More attention added to top ranked word pairs.
  • 14. Designing Various [Machine learning] models • Deep Pairwise Neural Networks [He et al. 2015; Lan et al. 2017; Lan and Xu 2018] Sentence pair relationship identified by pattern recognition through ConvNet. Hua He and Jimmy Lin. “Pairwise Word Interaction Modeling with Deep Neural Networks for Semantic Similarity Measurement” in NAACL (2016)
  • 15. [data science] for linguistic styles she says he says wonderfully delightfully beautifully fine well good nicely superbly Daniel Preotiuc, Wei Xu, Lyle Ungar. “Discovering User Attribute Stylistic Differences via Paraphrasing” in AAAI (2016) (also studied age & income)
  • 16. Machine reading of instructions Chaitanya Kulkarni, Wei Xu, Alan Ritter, Raghu Machiraju. “An Annotated Corpus for Machine Reading of Instructions in Wet Lab Protocols” in NAACL (2018) Wet Lab Protocols: (Photo: Moley Robotic Chef)
  • 17. http://web.cse.ohio-state.edu/~weixu/ Thank you Assistant ProfessorWei Xu Department of Computer Science and Engineering Ohio State University