SlideShare a Scribd company logo
Coreference Resolution
Natural Language Processing
Emory University

Jinho D. Choi
Coreference Resolution
2
Anaphora Resolution
Link noun phrase to its antecedents.
↑
Mostly noun phrases.
The Tin Woodman went to Emerald City to see the
Wizard of Oz and ask for a heart. After he asked for it,
the Woodman waited there for the master’s response.
Types of noun phrases?
PronounsProper nouns Common nouns
Anaphora Resolution
3
Proper noun ← Pronoun
Jinho bought a car. He was happy.
He bought a car for himself.
Challenges
Jinho ate a cookie. He also ate a cake. It was delicious.
Pronoun ← Pronoun
Common noun ← Pronoun
Jinho bought a car for his wife. She was happy.
Jinho ate a cookie. He also ate a cake. They were delicious.
Anaphora Resolution
4
Proper noun ← Proper noun
Jinho Choi bought a car. Dr. Choi was happy.
While he was studying, Jinho was singing.
Pronoun ← Proper noun
Common noun ← Proper noun
My professor’s name is Jinho Choi.
Proper noun
Pronoun
Common noun
← Common noun
Why Coreference Resolution?
5
In 2004, Obama received national attention during his
campaign to represent Illinois in the United States Senate
with his victory in the March Democratic Party primary, his
keynote address at the Democratic National Convention in
July, and his election to the Senate in November. He began
his presidential campaign in 2007 and, after a close primary
campaign against Hillary Rodham Clinton in 2008, he won
sufficient delegates in the Democratic Party primaries to
receive the presidential nomination. He then defeated
Republican nominee John McCain in the general election,
and was inaugurated as president on January 20, 2009. Nine
months after his inauguration, Obama was named the 2009
Nobel Peace Prize laureate.
Agreements
6
Number Agreement
Singular Plural
I, me, my, mine, myself,
you, your, yours, yourself
he, him, his, himself,
she, her, hers, herself
it, its, itself
you, your, yours, yourselves,
we, us, our, ours, ourselves,
they, them, their, theirs,
themselves
Gender Agreement
Male Female
he, him, his, himself she, her, hers, herself
Agreements
7
Syntactic Agreement
Jinho bought a car for him.
Jinho bought a car for himself.
Jinho?
Selectional Agreement
Jinho bought a book from Amazon. He read it over night.
Which?
Hobb’s Algorithm
8
1.Begin at NP.
2.Go up tree to first NP or S. Call this X, and the path p.
3.Traverse all branches below X to the left of p. Propose as
antecedent any NP that has a NP or S between it and X.
4.If X is the highest S in the sentence, traverse the parse
trees of the previous sentences in the order of recency.
Traverse left-to-right, breadth first. When a NP is
encountered, propose as antecedent. If not the highest
node, go to step 5.
Hobb’s Algorithm
9
5.From node X, go up the tree to the first NP or S. Call it
X, and the path p.
6.If X is an NP and the path to X did not pass through the
nominal that X dominates, propose X as antecedent.
7.Traverse all branches below X to the right of the path, in a
left-to-right, breadth first manner. Propose any NP
encountered as the antecedent.
8.If X is an S node, traverse all branches of X to the right of
the path but do not go below any NP or S encountered.
Propose any NP as the antecedent.
Lappin and Leass’ Algorithm
10
Collect all mentions (NPs) in the sentence.
Apply salience factors to the mentions.
Personal or Possessive

Pronouns
Reciprocal or Reflective

Pronouns
Syntactic Filter Anaphor Binding
If not found, move onto the previous sentence.
Pleonastic-It
11
It is A that S
It is A (for NP) toVP
It is C that S
It R that S
NP S it A (for NP) toVP
It is time toVP
It is thanks to NP that S
Modal adjectives A
necessary, possible, certain, likely, important, good, useful, advisable,
convenient, sufficient, economical, easy, desirable, difficult, legal
Cognitive verbs C
recommend, think, believe, know, anticipate, assume, expect
Raising verbs R
seem, appear, mean, follow
Causal verbs S
make, find
Syntactic Filter
12
A pronoun P is non-coreferential with a noun phrase N if:
P and N have incompatible agreement features.
The woman said that he is funny.
P is in the argument domain of N.
She likes her. John seems to want to see him.
P is in the adjunct domain of N.
She sat near her.
P is an argument of a head H, N is not a pronoun, and N is contained in H.
He believes that the man is amusing.
P is in the NP domain of N.
John’s portrait of him is interesting.
P is a determiner of a noun Q, and N is contained in Q.
His portrait of John is interesting.
His description of the portrait by John is interesting.
Anaphor Binding
13
A noun phrase N is a possible antecedent binder for R iff:
R is in the argument domain of N, and N > R.
They wanted to see themselves.
Mary knows the people who John introduced to each other.
R is in the adjunct domain of N.
He worked by himself.
Which friends plan to travel with each other?
R is in the NP domain of N.
John likes Bill’s portrait of himself.
Argument slot hierarchy
subj > agent > obj > (iobjlpobj)
Lexical anaphor R
reciprocal or reflective pronoun
N and R do not have incompatible agreement features. &
Anaphor Binding
14
A noun phrase N is a possible antecedent binder for R iff:
N is an argument of a verbV,

∃ an NP Q in the argument domain or the adjunct domain of N s.t.

(Q has no noun determiner) and

[(R is an argument of Q) or

(R is an argument of a preposition P and P is an adjunct of Q)].
They told stories about themselves.
Argument slot hierarchy
subj > agent > obj > (iobjlpobj)
Lexical anaphor R
reciprocal or reflective pronoun
(R is a determiner of a noun Q) and

[(Q is in the argument domain of N and N > Q) or

(Q is in the adjunct domain of N)].
John and Mary like each other’s portraits.
Salience Weighting
15
Salience Factor Weight Example
Sentence recency 100
Subject emphasis 80 John likes the dog.
Head noun emphasis 80 The dog in the house is here.
Existential emphasis 70 There is a dog at John’s place.
Accusative emphasis 50 John bought the dog last night.
Non-adverbial emphasis 50 According to John, Mary likes the dog.
Indirect object and
oblique comp. emphasis
40 John bought the dog to Mary.
Lappin and Leass’ Algorithm
16
John is a good professor.
Tony hated him until he talked with him.

More Related Content

What's hot

Natural lanaguage processing
Natural lanaguage processingNatural lanaguage processing
Natural lanaguage processing
gulshan kumar
 
Natural language processing
Natural language processingNatural language processing
Natural language processing
Hansi Thenuwara
 
Regular Grammar
Regular GrammarRegular Grammar
Regular Grammar
Ruchika Sinha
 
Natural language processing
Natural language processingNatural language processing
Natural language processing
KarenVacca
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
VeenaSKumar2
 
Алгоритмы на ruby: перебор и рекурсия
Алгоритмы на ruby: перебор и рекурсияАлгоритмы на ruby: перебор и рекурсия
Алгоритмы на ruby: перебор и рекурсияEvgeny Smirnov
 
Introduction to Natural Language Processing
Introduction to Natural Language ProcessingIntroduction to Natural Language Processing
Introduction to Natural Language Processing
Pranav Gupta
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
Varunjeet Singh Rekhi
 
NLTK - Natural Language Processing in Python
NLTK - Natural Language Processing in PythonNLTK - Natural Language Processing in Python
NLTK - Natural Language Processing in Python
shanbady
 
Dependency Parsing
Dependency ParsingDependency Parsing
Dependency Parsing
Jinho Choi
 
Deep Learning for Natural Language Processing: Word Embeddings
Deep Learning for Natural Language Processing: Word EmbeddingsDeep Learning for Natural Language Processing: Word Embeddings
Deep Learning for Natural Language Processing: Word Embeddings
Roelof Pieters
 
Information Retrieval using Semantic Similarity
Information Retrieval using Semantic SimilarityInformation Retrieval using Semantic Similarity
Information Retrieval using Semantic SimilaritySaswat Padhi
 
Syntactic analysis in NLP
Syntactic analysis in NLPSyntactic analysis in NLP
Syntactic analysis in NLP
kartikaVashisht
 
Lecture 10 semantic analysis 01
Lecture 10 semantic analysis 01Lecture 10 semantic analysis 01
Lecture 10 semantic analysis 01
Iffat Anjum
 
Natural Language Processing (NLP)
Natural Language Processing (NLP)Natural Language Processing (NLP)
Natural Language Processing (NLP)
Yuriy Guts
 

What's hot (20)

Natural lanaguage processing
Natural lanaguage processingNatural lanaguage processing
Natural lanaguage processing
 
Natural language processing
Natural language processingNatural language processing
Natural language processing
 
NLP
NLPNLP
NLP
 
Regular Grammar
Regular GrammarRegular Grammar
Regular Grammar
 
Natural language processing
Natural language processingNatural language processing
Natural language processing
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
Алгоритмы на ruby: перебор и рекурсия
Алгоритмы на ruby: перебор и рекурсияАлгоритмы на ruby: перебор и рекурсия
Алгоритмы на ruby: перебор и рекурсия
 
Introduction to Natural Language Processing
Introduction to Natural Language ProcessingIntroduction to Natural Language Processing
Introduction to Natural Language Processing
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
Introduction to linguistics
Introduction to linguisticsIntroduction to linguistics
Introduction to linguistics
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
NLTK - Natural Language Processing in Python
NLTK - Natural Language Processing in PythonNLTK - Natural Language Processing in Python
NLTK - Natural Language Processing in Python
 
Unit 1
Unit 1Unit 1
Unit 1
 
Dependency Parsing
Dependency ParsingDependency Parsing
Dependency Parsing
 
Deep Learning for Natural Language Processing: Word Embeddings
Deep Learning for Natural Language Processing: Word EmbeddingsDeep Learning for Natural Language Processing: Word Embeddings
Deep Learning for Natural Language Processing: Word Embeddings
 
Information Retrieval using Semantic Similarity
Information Retrieval using Semantic SimilarityInformation Retrieval using Semantic Similarity
Information Retrieval using Semantic Similarity
 
Natural language processing
Natural language processingNatural language processing
Natural language processing
 
Syntactic analysis in NLP
Syntactic analysis in NLPSyntactic analysis in NLP
Syntactic analysis in NLP
 
Lecture 10 semantic analysis 01
Lecture 10 semantic analysis 01Lecture 10 semantic analysis 01
Lecture 10 semantic analysis 01
 
Natural Language Processing (NLP)
Natural Language Processing (NLP)Natural Language Processing (NLP)
Natural Language Processing (NLP)
 

Viewers also liked

CS571: Dependency Parsing
CS571: Dependency ParsingCS571: Dependency Parsing
CS571: Dependency Parsing
Jinho Choi
 
CS571: Tree Adjoining Grammar
CS571: Tree Adjoining GrammarCS571: Tree Adjoining Grammar
CS571: Tree Adjoining Grammar
Jinho Choi
 
CS571: Combinatory Categorial Grammar
CS571: Combinatory Categorial GrammarCS571: Combinatory Categorial Grammar
CS571: Combinatory Categorial Grammar
Jinho Choi
 
CS571: Phrase Structure Grammar
CS571: Phrase Structure GrammarCS571: Phrase Structure Grammar
CS571: Phrase Structure Grammar
Jinho Choi
 
CS571: Introduction
CS571: IntroductionCS571: Introduction
CS571: Introduction
Jinho Choi
 
CS571: Gradient Descent
CS571: Gradient DescentCS571: Gradient Descent
CS571: Gradient Descent
Jinho Choi
 
CS571:: Part of-Speech Tagging
CS571:: Part of-Speech TaggingCS571:: Part of-Speech Tagging
CS571:: Part of-Speech Tagging
Jinho Choi
 

Viewers also liked (7)

CS571: Dependency Parsing
CS571: Dependency ParsingCS571: Dependency Parsing
CS571: Dependency Parsing
 
CS571: Tree Adjoining Grammar
CS571: Tree Adjoining GrammarCS571: Tree Adjoining Grammar
CS571: Tree Adjoining Grammar
 
CS571: Combinatory Categorial Grammar
CS571: Combinatory Categorial GrammarCS571: Combinatory Categorial Grammar
CS571: Combinatory Categorial Grammar
 
CS571: Phrase Structure Grammar
CS571: Phrase Structure GrammarCS571: Phrase Structure Grammar
CS571: Phrase Structure Grammar
 
CS571: Introduction
CS571: IntroductionCS571: Introduction
CS571: Introduction
 
CS571: Gradient Descent
CS571: Gradient DescentCS571: Gradient Descent
CS571: Gradient Descent
 
CS571:: Part of-Speech Tagging
CS571:: Part of-Speech TaggingCS571:: Part of-Speech Tagging
CS571:: Part of-Speech Tagging
 

Similar to CS571: Coreference Resolution

Articlesppt
ArticlespptArticlesppt
Articlesppt
windafebriis
 
anaphora resolution.pptx
anaphora resolution.pptxanaphora resolution.pptx
anaphora resolution.pptx
aishaahmed324049
 
Pronouns PP.pptx
Pronouns PP.pptxPronouns PP.pptx
Pronouns PP.pptx
GilbertGarcia40
 
Parts of Speech _ Tests and Activities.pdf
 Parts of Speech _ Tests and Activities.pdf Parts of Speech _ Tests and Activities.pdf
Parts of Speech _ Tests and Activities.pdf
AbdulSamad614286
 
Pronouns PP.ppt
Pronouns PP.pptPronouns PP.ppt
Pronouns PP.ppt
Janicequirley1
 
Pronouns PP.ppt
Pronouns PP.pptPronouns PP.ppt
Pronouns PP.ppt
MestizaRosane2
 
Pronouns PP (1).ppt
Pronouns PP (1).pptPronouns PP (1).ppt
Pronouns PP (1).ppt
tinEspiritu2
 
Pronouns PP.ppt
Pronouns PP.pptPronouns PP.ppt
Pronouns PP.ppt
MichelleRoseNaynes
 
Pronouns PP.ppt
Pronouns PP.pptPronouns PP.ppt
Pronouns PP.ppt
mehdimoqadamtabrizi1
 
Pronouns RELATED POWERPOINT --HELLO HI HI
Pronouns RELATED POWERPOINT --HELLO HI HIPronouns RELATED POWERPOINT --HELLO HI HI
Pronouns RELATED POWERPOINT --HELLO HI HI
LavanyaPriyaSathyan
 
English grammar(16.11.2012) 2
English grammar(16.11.2012) 2English grammar(16.11.2012) 2
English grammar(16.11.2012) 2Tehmina Gulfam
 
Part of spech with exam
Part of spech with examPart of spech with exam
Part of spech with exam
NarithKIM1
 
Pronouns
PronounsPronouns
Pronouns
Tere Gf
 
Foundations of Grammar 7: What is a pronoun?
Foundations of Grammar 7: What is a pronoun?Foundations of Grammar 7: What is a pronoun?
Foundations of Grammar 7: What is a pronoun?HUSS-Elearning
 
Pronouns Slideshow
Pronouns Slideshow Pronouns Slideshow
Pronouns Slideshow
SamG62
 
Pronouns.ppt.g2.emglish.lowergrades.nouns
Pronouns.ppt.g2.emglish.lowergrades.nounsPronouns.ppt.g2.emglish.lowergrades.nouns
Pronouns.ppt.g2.emglish.lowergrades.nouns
DalalAbdullah12
 
Pronouns For Kids, Adults, High School, Middle School
Pronouns For Kids, Adults, High School, Middle SchoolPronouns For Kids, Adults, High School, Middle School
Pronouns For Kids, Adults, High School, Middle School
ssuser9af6d5
 
All about Pronouns and types of pronouns
All about Pronouns and types of pronounsAll about Pronouns and types of pronouns
All about Pronouns and types of pronouns
ssuser86b4b3
 
Pronouns.ppt
Pronouns.pptPronouns.ppt
Pronouns.ppt
GenrevGarcia2
 

Similar to CS571: Coreference Resolution (20)

Articlesppt
ArticlespptArticlesppt
Articlesppt
 
anaphora resolution.pptx
anaphora resolution.pptxanaphora resolution.pptx
anaphora resolution.pptx
 
Pronouns[1]
Pronouns[1]Pronouns[1]
Pronouns[1]
 
Pronouns PP.pptx
Pronouns PP.pptxPronouns PP.pptx
Pronouns PP.pptx
 
Parts of Speech _ Tests and Activities.pdf
 Parts of Speech _ Tests and Activities.pdf Parts of Speech _ Tests and Activities.pdf
Parts of Speech _ Tests and Activities.pdf
 
Pronouns PP.ppt
Pronouns PP.pptPronouns PP.ppt
Pronouns PP.ppt
 
Pronouns PP.ppt
Pronouns PP.pptPronouns PP.ppt
Pronouns PP.ppt
 
Pronouns PP (1).ppt
Pronouns PP (1).pptPronouns PP (1).ppt
Pronouns PP (1).ppt
 
Pronouns PP.ppt
Pronouns PP.pptPronouns PP.ppt
Pronouns PP.ppt
 
Pronouns PP.ppt
Pronouns PP.pptPronouns PP.ppt
Pronouns PP.ppt
 
Pronouns RELATED POWERPOINT --HELLO HI HI
Pronouns RELATED POWERPOINT --HELLO HI HIPronouns RELATED POWERPOINT --HELLO HI HI
Pronouns RELATED POWERPOINT --HELLO HI HI
 
English grammar(16.11.2012) 2
English grammar(16.11.2012) 2English grammar(16.11.2012) 2
English grammar(16.11.2012) 2
 
Part of spech with exam
Part of spech with examPart of spech with exam
Part of spech with exam
 
Pronouns
PronounsPronouns
Pronouns
 
Foundations of Grammar 7: What is a pronoun?
Foundations of Grammar 7: What is a pronoun?Foundations of Grammar 7: What is a pronoun?
Foundations of Grammar 7: What is a pronoun?
 
Pronouns Slideshow
Pronouns Slideshow Pronouns Slideshow
Pronouns Slideshow
 
Pronouns.ppt.g2.emglish.lowergrades.nouns
Pronouns.ppt.g2.emglish.lowergrades.nounsPronouns.ppt.g2.emglish.lowergrades.nouns
Pronouns.ppt.g2.emglish.lowergrades.nouns
 
Pronouns For Kids, Adults, High School, Middle School
Pronouns For Kids, Adults, High School, Middle SchoolPronouns For Kids, Adults, High School, Middle School
Pronouns For Kids, Adults, High School, Middle School
 
All about Pronouns and types of pronouns
All about Pronouns and types of pronounsAll about Pronouns and types of pronouns
All about Pronouns and types of pronouns
 
Pronouns.ppt
Pronouns.pptPronouns.ppt
Pronouns.ppt
 

More from Jinho Choi

Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...
Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...
Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...
Jinho Choi
 
Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...
Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...
Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...
Jinho Choi
 
Competence-Level Prediction and Resume & Job Description Matching Using Conte...
Competence-Level Prediction and Resume & Job Description Matching Using Conte...Competence-Level Prediction and Resume & Job Description Matching Using Conte...
Competence-Level Prediction and Resume & Job Description Matching Using Conte...
Jinho Choi
 
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...
Jinho Choi
 
The Myth of Higher-Order Inference in Coreference Resolution
The Myth of Higher-Order Inference in Coreference ResolutionThe Myth of Higher-Order Inference in Coreference Resolution
The Myth of Higher-Order Inference in Coreference Resolution
Jinho Choi
 
Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...
Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...
Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...
Jinho Choi
 
Abstract Meaning Representation
Abstract Meaning RepresentationAbstract Meaning Representation
Abstract Meaning Representation
Jinho Choi
 
Semantic Role Labeling
Semantic Role LabelingSemantic Role Labeling
Semantic Role Labeling
Jinho Choi
 
CKY Parsing
CKY ParsingCKY Parsing
CKY Parsing
Jinho Choi
 
CS329 - WordNet Similarities
CS329 - WordNet SimilaritiesCS329 - WordNet Similarities
CS329 - WordNet Similarities
Jinho Choi
 
CS329 - Lexical Relations
CS329 - Lexical RelationsCS329 - Lexical Relations
CS329 - Lexical Relations
Jinho Choi
 
Automatic Knowledge Base Expansion for Dialogue Management
Automatic Knowledge Base Expansion for Dialogue ManagementAutomatic Knowledge Base Expansion for Dialogue Management
Automatic Knowledge Base Expansion for Dialogue Management
Jinho Choi
 
Attention is All You Need for AMR Parsing
Attention is All You Need for AMR ParsingAttention is All You Need for AMR Parsing
Attention is All You Need for AMR Parsing
Jinho Choi
 
Graph-to-Text Generation and its Applications to Dialogue
Graph-to-Text Generation and its Applications to DialogueGraph-to-Text Generation and its Applications to Dialogue
Graph-to-Text Generation and its Applications to Dialogue
Jinho Choi
 
Real-time Coreference Resolution for Dialogue Understanding
Real-time Coreference Resolution for Dialogue UnderstandingReal-time Coreference Resolution for Dialogue Understanding
Real-time Coreference Resolution for Dialogue Understanding
Jinho Choi
 
Topological Sort
Topological SortTopological Sort
Topological Sort
Jinho Choi
 
Tries - Put
Tries - PutTries - Put
Tries - Put
Jinho Choi
 
Multi-modal Embedding Learning for Early Detection of Alzheimer's Disease
Multi-modal Embedding Learning for Early Detection of Alzheimer's DiseaseMulti-modal Embedding Learning for Early Detection of Alzheimer's Disease
Multi-modal Embedding Learning for Early Detection of Alzheimer's Disease
Jinho Choi
 
Building Widely-Interpretable Semantic Networks for Dialogue Contexts
Building Widely-Interpretable Semantic Networks for Dialogue ContextsBuilding Widely-Interpretable Semantic Networks for Dialogue Contexts
Building Widely-Interpretable Semantic Networks for Dialogue Contexts
Jinho Choi
 
How to make Emora talk about Sports Intelligently
How to make Emora talk about Sports IntelligentlyHow to make Emora talk about Sports Intelligently
How to make Emora talk about Sports Intelligently
Jinho Choi
 

More from Jinho Choi (20)

Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...
Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...
Adaptation of Multilingual Transformer Encoder for Robust Enhanced Universal ...
 
Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...
Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...
Analysis of Hierarchical Multi-Content Text Classification Model on B-SHARP D...
 
Competence-Level Prediction and Resume & Job Description Matching Using Conte...
Competence-Level Prediction and Resume & Job Description Matching Using Conte...Competence-Level Prediction and Resume & Job Description Matching Using Conte...
Competence-Level Prediction and Resume & Job Description Matching Using Conte...
 
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...
Transformers to Learn Hierarchical Contexts in Multiparty Dialogue for Span-b...
 
The Myth of Higher-Order Inference in Coreference Resolution
The Myth of Higher-Order Inference in Coreference ResolutionThe Myth of Higher-Order Inference in Coreference Resolution
The Myth of Higher-Order Inference in Coreference Resolution
 
Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...
Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...
Noise Pollution in Hospital Readmission Prediction: Long Document Classificat...
 
Abstract Meaning Representation
Abstract Meaning RepresentationAbstract Meaning Representation
Abstract Meaning Representation
 
Semantic Role Labeling
Semantic Role LabelingSemantic Role Labeling
Semantic Role Labeling
 
CKY Parsing
CKY ParsingCKY Parsing
CKY Parsing
 
CS329 - WordNet Similarities
CS329 - WordNet SimilaritiesCS329 - WordNet Similarities
CS329 - WordNet Similarities
 
CS329 - Lexical Relations
CS329 - Lexical RelationsCS329 - Lexical Relations
CS329 - Lexical Relations
 
Automatic Knowledge Base Expansion for Dialogue Management
Automatic Knowledge Base Expansion for Dialogue ManagementAutomatic Knowledge Base Expansion for Dialogue Management
Automatic Knowledge Base Expansion for Dialogue Management
 
Attention is All You Need for AMR Parsing
Attention is All You Need for AMR ParsingAttention is All You Need for AMR Parsing
Attention is All You Need for AMR Parsing
 
Graph-to-Text Generation and its Applications to Dialogue
Graph-to-Text Generation and its Applications to DialogueGraph-to-Text Generation and its Applications to Dialogue
Graph-to-Text Generation and its Applications to Dialogue
 
Real-time Coreference Resolution for Dialogue Understanding
Real-time Coreference Resolution for Dialogue UnderstandingReal-time Coreference Resolution for Dialogue Understanding
Real-time Coreference Resolution for Dialogue Understanding
 
Topological Sort
Topological SortTopological Sort
Topological Sort
 
Tries - Put
Tries - PutTries - Put
Tries - Put
 
Multi-modal Embedding Learning for Early Detection of Alzheimer's Disease
Multi-modal Embedding Learning for Early Detection of Alzheimer's DiseaseMulti-modal Embedding Learning for Early Detection of Alzheimer's Disease
Multi-modal Embedding Learning for Early Detection of Alzheimer's Disease
 
Building Widely-Interpretable Semantic Networks for Dialogue Contexts
Building Widely-Interpretable Semantic Networks for Dialogue ContextsBuilding Widely-Interpretable Semantic Networks for Dialogue Contexts
Building Widely-Interpretable Semantic Networks for Dialogue Contexts
 
How to make Emora talk about Sports Intelligently
How to make Emora talk about Sports IntelligentlyHow to make Emora talk about Sports Intelligently
How to make Emora talk about Sports Intelligently
 

Recently uploaded

Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
nkrafacyberclub
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
DianaGray10
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
KatiaHIMEUR1
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
UiPathCommunity
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
Peter Spielvogel
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 

Recently uploaded (20)

Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4UiPath Test Automation using UiPath Test Suite series, part 4
UiPath Test Automation using UiPath Test Suite series, part 4
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !Securing your Kubernetes cluster_ a step-by-step guide to success !
Securing your Kubernetes cluster_ a step-by-step guide to success !
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 

CS571: Coreference Resolution

  • 1. Coreference Resolution Natural Language Processing Emory University
 Jinho D. Choi
  • 2. Coreference Resolution 2 Anaphora Resolution Link noun phrase to its antecedents. ↑ Mostly noun phrases. The Tin Woodman went to Emerald City to see the Wizard of Oz and ask for a heart. After he asked for it, the Woodman waited there for the master’s response. Types of noun phrases? PronounsProper nouns Common nouns
  • 3. Anaphora Resolution 3 Proper noun ← Pronoun Jinho bought a car. He was happy. He bought a car for himself. Challenges Jinho ate a cookie. He also ate a cake. It was delicious. Pronoun ← Pronoun Common noun ← Pronoun Jinho bought a car for his wife. She was happy. Jinho ate a cookie. He also ate a cake. They were delicious.
  • 4. Anaphora Resolution 4 Proper noun ← Proper noun Jinho Choi bought a car. Dr. Choi was happy. While he was studying, Jinho was singing. Pronoun ← Proper noun Common noun ← Proper noun My professor’s name is Jinho Choi. Proper noun Pronoun Common noun ← Common noun
  • 5. Why Coreference Resolution? 5 In 2004, Obama received national attention during his campaign to represent Illinois in the United States Senate with his victory in the March Democratic Party primary, his keynote address at the Democratic National Convention in July, and his election to the Senate in November. He began his presidential campaign in 2007 and, after a close primary campaign against Hillary Rodham Clinton in 2008, he won sufficient delegates in the Democratic Party primaries to receive the presidential nomination. He then defeated Republican nominee John McCain in the general election, and was inaugurated as president on January 20, 2009. Nine months after his inauguration, Obama was named the 2009 Nobel Peace Prize laureate.
  • 6. Agreements 6 Number Agreement Singular Plural I, me, my, mine, myself, you, your, yours, yourself he, him, his, himself, she, her, hers, herself it, its, itself you, your, yours, yourselves, we, us, our, ours, ourselves, they, them, their, theirs, themselves Gender Agreement Male Female he, him, his, himself she, her, hers, herself
  • 7. Agreements 7 Syntactic Agreement Jinho bought a car for him. Jinho bought a car for himself. Jinho? Selectional Agreement Jinho bought a book from Amazon. He read it over night. Which?
  • 8. Hobb’s Algorithm 8 1.Begin at NP. 2.Go up tree to first NP or S. Call this X, and the path p. 3.Traverse all branches below X to the left of p. Propose as antecedent any NP that has a NP or S between it and X. 4.If X is the highest S in the sentence, traverse the parse trees of the previous sentences in the order of recency. Traverse left-to-right, breadth first. When a NP is encountered, propose as antecedent. If not the highest node, go to step 5.
  • 9. Hobb’s Algorithm 9 5.From node X, go up the tree to the first NP or S. Call it X, and the path p. 6.If X is an NP and the path to X did not pass through the nominal that X dominates, propose X as antecedent. 7.Traverse all branches below X to the right of the path, in a left-to-right, breadth first manner. Propose any NP encountered as the antecedent. 8.If X is an S node, traverse all branches of X to the right of the path but do not go below any NP or S encountered. Propose any NP as the antecedent.
  • 10. Lappin and Leass’ Algorithm 10 Collect all mentions (NPs) in the sentence. Apply salience factors to the mentions. Personal or Possessive
 Pronouns Reciprocal or Reflective
 Pronouns Syntactic Filter Anaphor Binding If not found, move onto the previous sentence.
  • 11. Pleonastic-It 11 It is A that S It is A (for NP) toVP It is C that S It R that S NP S it A (for NP) toVP It is time toVP It is thanks to NP that S Modal adjectives A necessary, possible, certain, likely, important, good, useful, advisable, convenient, sufficient, economical, easy, desirable, difficult, legal Cognitive verbs C recommend, think, believe, know, anticipate, assume, expect Raising verbs R seem, appear, mean, follow Causal verbs S make, find
  • 12. Syntactic Filter 12 A pronoun P is non-coreferential with a noun phrase N if: P and N have incompatible agreement features. The woman said that he is funny. P is in the argument domain of N. She likes her. John seems to want to see him. P is in the adjunct domain of N. She sat near her. P is an argument of a head H, N is not a pronoun, and N is contained in H. He believes that the man is amusing. P is in the NP domain of N. John’s portrait of him is interesting. P is a determiner of a noun Q, and N is contained in Q. His portrait of John is interesting. His description of the portrait by John is interesting.
  • 13. Anaphor Binding 13 A noun phrase N is a possible antecedent binder for R iff: R is in the argument domain of N, and N > R. They wanted to see themselves. Mary knows the people who John introduced to each other. R is in the adjunct domain of N. He worked by himself. Which friends plan to travel with each other? R is in the NP domain of N. John likes Bill’s portrait of himself. Argument slot hierarchy subj > agent > obj > (iobjlpobj) Lexical anaphor R reciprocal or reflective pronoun N and R do not have incompatible agreement features. &
  • 14. Anaphor Binding 14 A noun phrase N is a possible antecedent binder for R iff: N is an argument of a verbV,
 ∃ an NP Q in the argument domain or the adjunct domain of N s.t.
 (Q has no noun determiner) and
 [(R is an argument of Q) or
 (R is an argument of a preposition P and P is an adjunct of Q)]. They told stories about themselves. Argument slot hierarchy subj > agent > obj > (iobjlpobj) Lexical anaphor R reciprocal or reflective pronoun (R is a determiner of a noun Q) and
 [(Q is in the argument domain of N and N > Q) or
 (Q is in the adjunct domain of N)]. John and Mary like each other’s portraits.
  • 15. Salience Weighting 15 Salience Factor Weight Example Sentence recency 100 Subject emphasis 80 John likes the dog. Head noun emphasis 80 The dog in the house is here. Existential emphasis 70 There is a dog at John’s place. Accusative emphasis 50 John bought the dog last night. Non-adverbial emphasis 50 According to John, Mary likes the dog. Indirect object and oblique comp. emphasis 40 John bought the dog to Mary.
  • 16. Lappin and Leass’ Algorithm 16 John is a good professor. Tony hated him until he talked with him.