SlideShare a Scribd company logo
1 of 16
Download to read offline
Coreference Resolution
Natural Language Processing
Emory University

Jinho D. Choi
Coreference Resolution
2
Anaphora Resolution
Link noun phrase to its antecedents.
↑
Mostly noun phrases.
The Tin Woodman went to Emerald City to see the
Wizard of Oz and ask for a heart. After he asked for it,
the Woodman waited there for the master’s response.
Types of noun phrases?
PronounsProper nouns Common nouns
Anaphora Resolution
3
Proper noun ← Pronoun
Jinho bought a car. He was happy.
He bought a car for himself.
Challenges
Jinho ate a cookie. He also ate a cake. It was delicious.
Pronoun ← Pronoun
Common noun ← Pronoun
Jinho bought a car for his wife. She was happy.
Jinho ate a cookie. He also ate a cake. They were delicious.
Anaphora Resolution
4
Proper noun ← Proper noun
Jinho Choi bought a car. Dr. Choi was happy.
While he was studying, Jinho was singing.
Pronoun ← Proper noun
Common noun ← Proper noun
My professor’s name is Jinho Choi.
Proper noun
Pronoun
Common noun
← Common noun
Why Coreference Resolution?
5
In 2004, Obama received national attention during his
campaign to represent Illinois in the United States Senate
with his victory in the March Democratic Party primary, his
keynote address at the Democratic National Convention in
July, and his election to the Senate in November. He began
his presidential campaign in 2007 and, after a close primary
campaign against Hillary Rodham Clinton in 2008, he won
sufficient delegates in the Democratic Party primaries to
receive the presidential nomination. He then defeated
Republican nominee John McCain in the general election,
and was inaugurated as president on January 20, 2009. Nine
months after his inauguration, Obama was named the 2009
Nobel Peace Prize laureate.
Agreements
6
Number Agreement
Singular Plural
I, me, my, mine, myself,
you, your, yours, yourself
he, him, his, himself,
she, her, hers, herself
it, its, itself
you, your, yours, yourselves,
we, us, our, ours, ourselves,
they, them, their, theirs,
themselves
Gender Agreement
Male Female
he, him, his, himself she, her, hers, herself
Agreements
7
Syntactic Agreement
Jinho bought a car for him.
Jinho bought a car for himself.
Jinho?
Selectional Agreement
Jinho bought a book from Amazon. He read it over night.
Which?
Hobb’s Algorithm
8
1.Begin at NP.
2.Go up tree to first NP or S. Call this X, and the path p.
3.Traverse all branches below X to the left of p. Propose as
antecedent any NP that has a NP or S between it and X.
4.If X is the highest S in the sentence, traverse the parse
trees of the previous sentences in the order of recency.
Traverse left-to-right, breadth first. When a NP is
encountered, propose as antecedent. If not the highest
node, go to step 5.
Hobb’s Algorithm
9
5.From node X, go up the tree to the first NP or S. Call it
X, and the path p.
6.If X is an NP and the path to X did not pass through the
nominal that X dominates, propose X as antecedent.
7.Traverse all branches below X to the right of the path, in a
left-to-right, breadth first manner. Propose any NP
encountered as the antecedent.
8.If X is an S node, traverse all branches of X to the right of
the path but do not go below any NP or S encountered.
Propose any NP as the antecedent.
Lappin and Leass’ Algorithm
10
Collect all mentions (NPs) in the sentence.
Apply salience factors to the mentions.
Personal or Possessive

Pronouns
Reciprocal or Reflective

Pronouns
Syntactic Filter Anaphor Binding
If not found, move onto the previous sentence.
Pleonastic-It
11
It is A that S
It is A (for NP) toVP
It is C that S
It R that S
NP S it A (for NP) toVP
It is time toVP
It is thanks to NP that S
Modal adjectives A
necessary, possible, certain, likely, important, good, useful, advisable,
convenient, sufficient, economical, easy, desirable, difficult, legal
Cognitive verbs C
recommend, think, believe, know, anticipate, assume, expect
Raising verbs R
seem, appear, mean, follow
Causal verbs S
make, find
Syntactic Filter
12
A pronoun P is non-coreferential with a noun phrase N if:
P and N have incompatible agreement features.
The woman said that he is funny.
P is in the argument domain of N.
She likes her. John seems to want to see him.
P is in the adjunct domain of N.
She sat near her.
P is an argument of a head H, N is not a pronoun, and N is contained in H.
He believes that the man is amusing.
P is in the NP domain of N.
John’s portrait of him is interesting.
P is a determiner of a noun Q, and N is contained in Q.
His portrait of John is interesting.
His description of the portrait by John is interesting.
Anaphor Binding
13
A noun phrase N is a possible antecedent binder for R iff:
R is in the argument domain of N, and N > R.
They wanted to see themselves.
Mary knows the people who John introduced to each other.
R is in the adjunct domain of N.
He worked by himself.
Which friends plan to travel with each other?
R is in the NP domain of N.
John likes Bill’s portrait of himself.
Argument slot hierarchy
subj > agent > obj > (iobjlpobj)
Lexical anaphor R
reciprocal or reflective pronoun
N and R do not have incompatible agreement features. &
Anaphor Binding
14
A noun phrase N is a possible antecedent binder for R iff:
N is an argument of a verbV,

∃ an NP Q in the argument domain or the adjunct domain of N s.t.

(Q has no noun determiner) and

[(R is an argument of Q) or

(R is an argument of a preposition P and P is an adjunct of Q)].
They told stories about themselves.
Argument slot hierarchy
subj > agent > obj > (iobjlpobj)
Lexical anaphor R
reciprocal or reflective pronoun
(R is a determiner of a noun Q) and

[(Q is in the argument domain of N and N > Q) or

(Q is in the adjunct domain of N)].
John and Mary like each other’s portraits.
Salience Weighting
15
Salience Factor Weight Example
Sentence recency 100
Subject emphasis 80 John likes the dog.
Head noun emphasis 80 The dog in the house is here.
Existential emphasis 70 There is a dog at John’s place.
Accusative emphasis 50 John bought the dog last night.
Non-adverbial emphasis 50 According to John, Mary likes the dog.
Indirect object and
oblique comp. emphasis
40 John bought the dog to Mary.
Lappin and Leass’ Algorithm
16
John is a good professor.
Tony hated him until he talked with him.

More Related Content

What's hot

Meaning Representations for Natural Languages: Design, Models and Applications
Meaning Representations for Natural Languages:  Design, Models and ApplicationsMeaning Representations for Natural Languages:  Design, Models and Applications
Meaning Representations for Natural Languages: Design, Models and ApplicationsYunyao Li
 
NLP_KASHK:Context-Free Grammar for English
NLP_KASHK:Context-Free Grammar for EnglishNLP_KASHK:Context-Free Grammar for English
NLP_KASHK:Context-Free Grammar for EnglishHemantha Kulathilake
 
Phrase structure rule
Phrase structure rulePhrase structure rule
Phrase structure ruleSila Chaniago
 
Systemic functional grammar
Systemic functional grammarSystemic functional grammar
Systemic functional grammarmumayouth
 
The Different Theories of Semantics
The Different Theories of Semantics The Different Theories of Semantics
The Different Theories of Semantics Nusrat Nishat
 
Language Model (N-Gram).pptx
Language Model (N-Gram).pptxLanguage Model (N-Gram).pptx
Language Model (N-Gram).pptxHeneWijaya
 
NLP_KASHK:Parsing with Context-Free Grammar
NLP_KASHK:Parsing with Context-Free Grammar NLP_KASHK:Parsing with Context-Free Grammar
NLP_KASHK:Parsing with Context-Free Grammar Hemantha Kulathilake
 
Morphological Analysis
Morphological AnalysisMorphological Analysis
Morphological AnalysisAkshat Pandey
 
Natural Language processing Parts of speech tagging, its classes, and how to ...
Natural Language processing Parts of speech tagging, its classes, and how to ...Natural Language processing Parts of speech tagging, its classes, and how to ...
Natural Language processing Parts of speech tagging, its classes, and how to ...Rajnish Raj
 
Phrase Structure Grammar
Phrase Structure GrammarPhrase Structure Grammar
Phrase Structure GrammarAnusha Das
 
Syntax & syntactic analysis,lec.1, dr. shadia.ppt [compatibility mode]
Syntax & syntactic analysis,lec.1, dr. shadia.ppt [compatibility mode]Syntax & syntactic analysis,lec.1, dr. shadia.ppt [compatibility mode]
Syntax & syntactic analysis,lec.1, dr. shadia.ppt [compatibility mode]Dr. Shadia Banjar
 
Diversity and novelty for recommendation system
Diversity and novelty for recommendation systemDiversity and novelty for recommendation system
Diversity and novelty for recommendation systemZhenv5
 

What's hot (20)

Lexical semantics
Lexical semanticsLexical semantics
Lexical semantics
 
Meaning Representations for Natural Languages: Design, Models and Applications
Meaning Representations for Natural Languages:  Design, Models and ApplicationsMeaning Representations for Natural Languages:  Design, Models and Applications
Meaning Representations for Natural Languages: Design, Models and Applications
 
Anaphora resolution
Anaphora resolutionAnaphora resolution
Anaphora resolution
 
NLP_KASHK:Context-Free Grammar for English
NLP_KASHK:Context-Free Grammar for EnglishNLP_KASHK:Context-Free Grammar for English
NLP_KASHK:Context-Free Grammar for English
 
Phrase structure rule
Phrase structure rulePhrase structure rule
Phrase structure rule
 
Bleu vs rouge
Bleu vs rougeBleu vs rouge
Bleu vs rouge
 
Systemic functional grammar
Systemic functional grammarSystemic functional grammar
Systemic functional grammar
 
Word embedding
Word embedding Word embedding
Word embedding
 
A Sample of CDA
A Sample of CDAA Sample of CDA
A Sample of CDA
 
Using lexical chains for text summarization
Using lexical chains for text summarizationUsing lexical chains for text summarization
Using lexical chains for text summarization
 
The Different Theories of Semantics
The Different Theories of Semantics The Different Theories of Semantics
The Different Theories of Semantics
 
Language Model (N-Gram).pptx
Language Model (N-Gram).pptxLanguage Model (N-Gram).pptx
Language Model (N-Gram).pptx
 
NLP_KASHK:Parsing with Context-Free Grammar
NLP_KASHK:Parsing with Context-Free Grammar NLP_KASHK:Parsing with Context-Free Grammar
NLP_KASHK:Parsing with Context-Free Grammar
 
Morphological Analysis
Morphological AnalysisMorphological Analysis
Morphological Analysis
 
Natural Language processing Parts of speech tagging, its classes, and how to ...
Natural Language processing Parts of speech tagging, its classes, and how to ...Natural Language processing Parts of speech tagging, its classes, and how to ...
Natural Language processing Parts of speech tagging, its classes, and how to ...
 
Syntax analysis
Syntax analysisSyntax analysis
Syntax analysis
 
Phrase Structure Grammar
Phrase Structure GrammarPhrase Structure Grammar
Phrase Structure Grammar
 
Distributional semantics
Distributional semanticsDistributional semantics
Distributional semantics
 
Syntax & syntactic analysis,lec.1, dr. shadia.ppt [compatibility mode]
Syntax & syntactic analysis,lec.1, dr. shadia.ppt [compatibility mode]Syntax & syntactic analysis,lec.1, dr. shadia.ppt [compatibility mode]
Syntax & syntactic analysis,lec.1, dr. shadia.ppt [compatibility mode]
 
Diversity and novelty for recommendation system
Diversity and novelty for recommendation systemDiversity and novelty for recommendation system
Diversity and novelty for recommendation system
 

Viewers also liked

CS571: Dependency Parsing
CS571: Dependency ParsingCS571: Dependency Parsing
CS571: Dependency ParsingJinho Choi
 
CS571: Tree Adjoining Grammar
CS571: Tree Adjoining GrammarCS571: Tree Adjoining Grammar
CS571: Tree Adjoining GrammarJinho Choi
 
CS571: Combinatory Categorial Grammar
CS571: Combinatory Categorial GrammarCS571: Combinatory Categorial Grammar
CS571: Combinatory Categorial GrammarJinho Choi
 
CS571: Introduction
CS571: IntroductionCS571: Introduction
CS571: IntroductionJinho Choi
 
CS571: Gradient Descent
CS571: Gradient DescentCS571: Gradient Descent
CS571: Gradient DescentJinho Choi
 
CS571:: Part of-Speech Tagging
CS571:: Part of-Speech TaggingCS571:: Part of-Speech Tagging
CS571:: Part of-Speech TaggingJinho Choi
 

Viewers also liked (6)

CS571: Dependency Parsing
CS571: Dependency ParsingCS571: Dependency Parsing
CS571: Dependency Parsing
 
CS571: Tree Adjoining Grammar
CS571: Tree Adjoining GrammarCS571: Tree Adjoining Grammar
CS571: Tree Adjoining Grammar
 
CS571: Combinatory Categorial Grammar
CS571: Combinatory Categorial GrammarCS571: Combinatory Categorial Grammar
CS571: Combinatory Categorial Grammar
 
CS571: Introduction
CS571: IntroductionCS571: Introduction
CS571: Introduction
 
CS571: Gradient Descent
CS571: Gradient DescentCS571: Gradient Descent
CS571: Gradient Descent
 
CS571:: Part of-Speech Tagging
CS571:: Part of-Speech TaggingCS571:: Part of-Speech Tagging
CS571:: Part of-Speech Tagging
 

Similar to CS571: Coreference Resolution

Parts of Speech _ Tests and Activities.pdf
 Parts of Speech _ Tests and Activities.pdf Parts of Speech _ Tests and Activities.pdf
Parts of Speech _ Tests and Activities.pdfAbdulSamad614286
 
Pronouns PP (1).ppt
Pronouns PP (1).pptPronouns PP (1).ppt
Pronouns PP (1).ppttinEspiritu2
 
Pronouns RELATED POWERPOINT --HELLO HI HI
Pronouns RELATED POWERPOINT --HELLO HI HIPronouns RELATED POWERPOINT --HELLO HI HI
Pronouns RELATED POWERPOINT --HELLO HI HILavanyaPriyaSathyan
 
English grammar(16.11.2012) 2
English grammar(16.11.2012) 2English grammar(16.11.2012) 2
English grammar(16.11.2012) 2Tehmina Gulfam
 
Part of spech with exam
Part of spech with examPart of spech with exam
Part of spech with examNarithKIM1
 
Pronouns
PronounsPronouns
PronounsTere Gf
 
Foundations of Grammar 7: What is a pronoun?
Foundations of Grammar 7: What is a pronoun?Foundations of Grammar 7: What is a pronoun?
Foundations of Grammar 7: What is a pronoun?HUSS-Elearning
 
Pronouns Slideshow
Pronouns Slideshow Pronouns Slideshow
Pronouns Slideshow SamG62
 
All about Pronouns and types of pronouns
All about Pronouns and types of pronounsAll about Pronouns and types of pronouns
All about Pronouns and types of pronounsssuser86b4b3
 
Pronouns For Kids, Adults, High School, Middle School
Pronouns For Kids, Adults, High School, Middle SchoolPronouns For Kids, Adults, High School, Middle School
Pronouns For Kids, Adults, High School, Middle Schoolssuser9af6d5
 

Similar to CS571: Coreference Resolution (20)

Articlesppt
ArticlespptArticlesppt
Articlesppt
 
anaphora resolution.pptx
anaphora resolution.pptxanaphora resolution.pptx
anaphora resolution.pptx
 
Pronouns[1]
Pronouns[1]Pronouns[1]
Pronouns[1]
 
Pronouns PP.pptx
Pronouns PP.pptxPronouns PP.pptx
Pronouns PP.pptx
 
Parts of Speech _ Tests and Activities.pdf
 Parts of Speech _ Tests and Activities.pdf Parts of Speech _ Tests and Activities.pdf
Parts of Speech _ Tests and Activities.pdf
 
Pronouns PP.ppt
Pronouns PP.pptPronouns PP.ppt
Pronouns PP.ppt
 
Pronouns PP.ppt
Pronouns PP.pptPronouns PP.ppt
Pronouns PP.ppt
 
Pronouns PP (1).ppt
Pronouns PP (1).pptPronouns PP (1).ppt
Pronouns PP (1).ppt
 
Pronouns RELATED POWERPOINT --HELLO HI HI
Pronouns RELATED POWERPOINT --HELLO HI HIPronouns RELATED POWERPOINT --HELLO HI HI
Pronouns RELATED POWERPOINT --HELLO HI HI
 
Pronouns PP.ppt
Pronouns PP.pptPronouns PP.ppt
Pronouns PP.ppt
 
Pronouns PP.ppt
Pronouns PP.pptPronouns PP.ppt
Pronouns PP.ppt
 
English grammar(16.11.2012) 2
English grammar(16.11.2012) 2English grammar(16.11.2012) 2
English grammar(16.11.2012) 2
 
Part of spech with exam
Part of spech with examPart of spech with exam
Part of spech with exam
 
Pronouns
PronounsPronouns
Pronouns
 
Foundations of Grammar 7: What is a pronoun?
Foundations of Grammar 7: What is a pronoun?Foundations of Grammar 7: What is a pronoun?
Foundations of Grammar 7: What is a pronoun?
 
Pronouns Slideshow
Pronouns Slideshow Pronouns Slideshow
Pronouns Slideshow
 
All about Pronouns and types of pronouns
All about Pronouns and types of pronounsAll about Pronouns and types of pronouns
All about Pronouns and types of pronouns
 
Pronouns.ppt
Pronouns.pptPronouns.ppt
Pronouns.ppt
 
Pronouns For Kids, Adults, High School, Middle School
Pronouns For Kids, Adults, High School, Middle SchoolPronouns For Kids, Adults, High School, Middle School
Pronouns For Kids, Adults, High School, Middle School
 
English Parts of Speech
English Parts of SpeechEnglish Parts of Speech
English Parts of Speech
 

More from Jinho Choi

Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...
Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...
Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...Jinho Choi
 
Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...
Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...
Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...Jinho Choi
 
Competence-Level Prediction and Resume & Job Description Matching Using Conte...
Competence-Level Prediction and Resume & Job Description Matching Using Conte...Competence-Level Prediction and Resume & Job Description Matching Using Conte...
Competence-Level Prediction and Resume & Job Description Matching Using Conte...Jinho Choi
 
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...Jinho Choi
 
The Myth of Higher-Order Inference in Coreference Resolution
The Myth of Higher-Order Inference in Coreference ResolutionThe Myth of Higher-Order Inference in Coreference Resolution
The Myth of Higher-Order Inference in Coreference ResolutionJinho Choi
 
Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...
Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...
Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...Jinho Choi
 
Abstract Meaning Representation
Abstract Meaning RepresentationAbstract Meaning Representation
Abstract Meaning RepresentationJinho Choi
 
Semantic Role Labeling
Semantic Role LabelingSemantic Role Labeling
Semantic Role LabelingJinho Choi
 
CS329 - WordNet Similarities
CS329 - WordNet SimilaritiesCS329 - WordNet Similarities
CS329 - WordNet SimilaritiesJinho Choi
 
CS329 - Lexical Relations
CS329 - Lexical RelationsCS329 - Lexical Relations
CS329 - Lexical RelationsJinho Choi
 
Automatic Knowledge Base Expansion for Dialogue Management
Automatic Knowledge Base Expansion for Dialogue ManagementAutomatic Knowledge Base Expansion for Dialogue Management
Automatic Knowledge Base Expansion for Dialogue ManagementJinho Choi
 
Attention is All You Need for AMR Parsing
Attention is All You Need for AMR ParsingAttention is All You Need for AMR Parsing
Attention is All You Need for AMR ParsingJinho Choi
 
Graph-to-Text Generation and its Applications to Dialogue
Graph-to-Text Generation and its Applications to DialogueGraph-to-Text Generation and its Applications to Dialogue
Graph-to-Text Generation and its Applications to DialogueJinho Choi
 
Real-time Coreference Resolution for Dialogue Understanding
Real-time Coreference Resolution for Dialogue UnderstandingReal-time Coreference Resolution for Dialogue Understanding
Real-time Coreference Resolution for Dialogue UnderstandingJinho Choi
 
Topological Sort
Topological SortTopological Sort
Topological SortJinho Choi
 
Multi-modal Embedding Learning for Early Detection of Alzheimer's Disease
Multi-modal Embedding Learning for Early Detection of Alzheimer's DiseaseMulti-modal Embedding Learning for Early Detection of Alzheimer's Disease
Multi-modal Embedding Learning for Early Detection of Alzheimer's DiseaseJinho Choi
 
Building Widely-Interpretable Semantic Networks for Dialogue Contexts
Building Widely-Interpretable Semantic Networks for Dialogue ContextsBuilding Widely-Interpretable Semantic Networks for Dialogue Contexts
Building Widely-Interpretable Semantic Networks for Dialogue ContextsJinho Choi
 
How to make Emora talk about Sports Intelligently
How to make Emora talk about Sports IntelligentlyHow to make Emora talk about Sports Intelligently
How to make Emora talk about Sports IntelligentlyJinho Choi
 

More from Jinho Choi (20)

Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...
Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...
Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...
 
Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...
Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...
Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...
 
Competence-Level Prediction and Resume & Job Description Matching Using Conte...
Competence-Level Prediction and Resume & Job Description Matching Using Conte...Competence-Level Prediction and Resume & Job Description Matching Using Conte...
Competence-Level Prediction and Resume & Job Description Matching Using Conte...
 
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...
 
The Myth of Higher-Order Inference in Coreference Resolution
The Myth of Higher-Order Inference in Coreference ResolutionThe Myth of Higher-Order Inference in Coreference Resolution
The Myth of Higher-Order Inference in Coreference Resolution
 
Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...
Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...
Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...
 
Abstract Meaning Representation
Abstract Meaning RepresentationAbstract Meaning Representation
Abstract Meaning Representation
 
Semantic Role Labeling
Semantic Role LabelingSemantic Role Labeling
Semantic Role Labeling
 
CKY Parsing
CKY ParsingCKY Parsing
CKY Parsing
 
CS329 - WordNet Similarities
CS329 - WordNet SimilaritiesCS329 - WordNet Similarities
CS329 - WordNet Similarities
 
CS329 - Lexical Relations
CS329 - Lexical RelationsCS329 - Lexical Relations
CS329 - Lexical Relations
 
Automatic Knowledge Base Expansion for Dialogue Management
Automatic Knowledge Base Expansion for Dialogue ManagementAutomatic Knowledge Base Expansion for Dialogue Management
Automatic Knowledge Base Expansion for Dialogue Management
 
Attention is All You Need for AMR Parsing
Attention is All You Need for AMR ParsingAttention is All You Need for AMR Parsing
Attention is All You Need for AMR Parsing
 
Graph-to-Text Generation and its Applications to Dialogue
Graph-to-Text Generation and its Applications to DialogueGraph-to-Text Generation and its Applications to Dialogue
Graph-to-Text Generation and its Applications to Dialogue
 
Real-time Coreference Resolution for Dialogue Understanding
Real-time Coreference Resolution for Dialogue UnderstandingReal-time Coreference Resolution for Dialogue Understanding
Real-time Coreference Resolution for Dialogue Understanding
 
Topological Sort
Topological SortTopological Sort
Topological Sort
 
Tries - Put
Tries - PutTries - Put
Tries - Put
 
Multi-modal Embedding Learning for Early Detection of Alzheimer's Disease
Multi-modal Embedding Learning for Early Detection of Alzheimer's DiseaseMulti-modal Embedding Learning for Early Detection of Alzheimer's Disease
Multi-modal Embedding Learning for Early Detection of Alzheimer's Disease
 
Building Widely-Interpretable Semantic Networks for Dialogue Contexts
Building Widely-Interpretable Semantic Networks for Dialogue ContextsBuilding Widely-Interpretable Semantic Networks for Dialogue Contexts
Building Widely-Interpretable Semantic Networks for Dialogue Contexts
 
How to make Emora talk about Sports Intelligently
How to make Emora talk about Sports IntelligentlyHow to make Emora talk about Sports Intelligently
How to make Emora talk about Sports Intelligently
 

Recently uploaded

A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 

Recently uploaded (20)

A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 

CS571: Coreference Resolution

  • 1. Coreference Resolution Natural Language Processing Emory University
 Jinho D. Choi
  • 2. Coreference Resolution 2 Anaphora Resolution Link noun phrase to its antecedents. ↑ Mostly noun phrases. The Tin Woodman went to Emerald City to see the Wizard of Oz and ask for a heart. After he asked for it, the Woodman waited there for the master’s response. Types of noun phrases? PronounsProper nouns Common nouns
  • 3. Anaphora Resolution 3 Proper noun ← Pronoun Jinho bought a car. He was happy. He bought a car for himself. Challenges Jinho ate a cookie. He also ate a cake. It was delicious. Pronoun ← Pronoun Common noun ← Pronoun Jinho bought a car for his wife. She was happy. Jinho ate a cookie. He also ate a cake. They were delicious.
  • 4. Anaphora Resolution 4 Proper noun ← Proper noun Jinho Choi bought a car. Dr. Choi was happy. While he was studying, Jinho was singing. Pronoun ← Proper noun Common noun ← Proper noun My professor’s name is Jinho Choi. Proper noun Pronoun Common noun ← Common noun
  • 5. Why Coreference Resolution? 5 In 2004, Obama received national attention during his campaign to represent Illinois in the United States Senate with his victory in the March Democratic Party primary, his keynote address at the Democratic National Convention in July, and his election to the Senate in November. He began his presidential campaign in 2007 and, after a close primary campaign against Hillary Rodham Clinton in 2008, he won sufficient delegates in the Democratic Party primaries to receive the presidential nomination. He then defeated Republican nominee John McCain in the general election, and was inaugurated as president on January 20, 2009. Nine months after his inauguration, Obama was named the 2009 Nobel Peace Prize laureate.
  • 6. Agreements 6 Number Agreement Singular Plural I, me, my, mine, myself, you, your, yours, yourself he, him, his, himself, she, her, hers, herself it, its, itself you, your, yours, yourselves, we, us, our, ours, ourselves, they, them, their, theirs, themselves Gender Agreement Male Female he, him, his, himself she, her, hers, herself
  • 7. Agreements 7 Syntactic Agreement Jinho bought a car for him. Jinho bought a car for himself. Jinho? Selectional Agreement Jinho bought a book from Amazon. He read it over night. Which?
  • 8. Hobb’s Algorithm 8 1.Begin at NP. 2.Go up tree to first NP or S. Call this X, and the path p. 3.Traverse all branches below X to the left of p. Propose as antecedent any NP that has a NP or S between it and X. 4.If X is the highest S in the sentence, traverse the parse trees of the previous sentences in the order of recency. Traverse left-to-right, breadth first. When a NP is encountered, propose as antecedent. If not the highest node, go to step 5.
  • 9. Hobb’s Algorithm 9 5.From node X, go up the tree to the first NP or S. Call it X, and the path p. 6.If X is an NP and the path to X did not pass through the nominal that X dominates, propose X as antecedent. 7.Traverse all branches below X to the right of the path, in a left-to-right, breadth first manner. Propose any NP encountered as the antecedent. 8.If X is an S node, traverse all branches of X to the right of the path but do not go below any NP or S encountered. Propose any NP as the antecedent.
  • 10. Lappin and Leass’ Algorithm 10 Collect all mentions (NPs) in the sentence. Apply salience factors to the mentions. Personal or Possessive
 Pronouns Reciprocal or Reflective
 Pronouns Syntactic Filter Anaphor Binding If not found, move onto the previous sentence.
  • 11. Pleonastic-It 11 It is A that S It is A (for NP) toVP It is C that S It R that S NP S it A (for NP) toVP It is time toVP It is thanks to NP that S Modal adjectives A necessary, possible, certain, likely, important, good, useful, advisable, convenient, sufficient, economical, easy, desirable, difficult, legal Cognitive verbs C recommend, think, believe, know, anticipate, assume, expect Raising verbs R seem, appear, mean, follow Causal verbs S make, find
  • 12. Syntactic Filter 12 A pronoun P is non-coreferential with a noun phrase N if: P and N have incompatible agreement features. The woman said that he is funny. P is in the argument domain of N. She likes her. John seems to want to see him. P is in the adjunct domain of N. She sat near her. P is an argument of a head H, N is not a pronoun, and N is contained in H. He believes that the man is amusing. P is in the NP domain of N. John’s portrait of him is interesting. P is a determiner of a noun Q, and N is contained in Q. His portrait of John is interesting. His description of the portrait by John is interesting.
  • 13. Anaphor Binding 13 A noun phrase N is a possible antecedent binder for R iff: R is in the argument domain of N, and N > R. They wanted to see themselves. Mary knows the people who John introduced to each other. R is in the adjunct domain of N. He worked by himself. Which friends plan to travel with each other? R is in the NP domain of N. John likes Bill’s portrait of himself. Argument slot hierarchy subj > agent > obj > (iobjlpobj) Lexical anaphor R reciprocal or reflective pronoun N and R do not have incompatible agreement features. &
  • 14. Anaphor Binding 14 A noun phrase N is a possible antecedent binder for R iff: N is an argument of a verbV,
 ∃ an NP Q in the argument domain or the adjunct domain of N s.t.
 (Q has no noun determiner) and
 [(R is an argument of Q) or
 (R is an argument of a preposition P and P is an adjunct of Q)]. They told stories about themselves. Argument slot hierarchy subj > agent > obj > (iobjlpobj) Lexical anaphor R reciprocal or reflective pronoun (R is a determiner of a noun Q) and
 [(Q is in the argument domain of N and N > Q) or
 (Q is in the adjunct domain of N)]. John and Mary like each other’s portraits.
  • 15. Salience Weighting 15 Salience Factor Weight Example Sentence recency 100 Subject emphasis 80 John likes the dog. Head noun emphasis 80 The dog in the house is here. Existential emphasis 70 There is a dog at John’s place. Accusative emphasis 50 John bought the dog last night. Non-adverbial emphasis 50 According to John, Mary likes the dog. Indirect object and oblique comp. emphasis 40 John bought the dog to Mary.
  • 16. Lappin and Leass’ Algorithm 16 John is a good professor. Tony hated him until he talked with him.