SlideShare a Scribd company logo
Building a Dictionary of
Affixal Negations
1
Chantal van Son, Emiel van Miltenburg, Roser Morante (VU Amsterdam)
c.m.van.son@vu.nl
ExProM Workshop @ COLING 2016
Special Session on Negation

December 12, 2016 - Osaka, Japan
Introduction: Affixal negations
• Words marked with negative affix; typically flag
the absence of particular features
• English: un-, in-, dis-, a-, an-, non-, im-, il-, ir-, -less

e.g. unable, disagree, impossible
• Automatic detection could benefit NLP tasks
such as text mining, recognizing textual
entailment, paraphrasing and QA
2
Introduction: Affixal negations
• Blanco & Moldovan (2011): very difficult to
detect without substantial false positive rate
• how to distinguish between ineffective and invite?

—> check whether word is still valid after removing prefix:
how to prevent inform from being annotated?
• how do deal with ambiguity: invalid (a) vs. invalid (n)?
• Automatic detection might benefit from
dictionary-based approach
3
Eduardo Blanco and Dan Moldovan. 2011. Some issues on detecting negation from text. In Proceedings of the
24th International Florida Artificial Intelligence Research Society Conference , pages 228–233.
Overview of today’s talk
1. Defining lexical negation
1. affixal negations and regular antonyms
2. typology of affixal negations (Joshi 2012)

2. Building a negation dictionary (preliminary study)
1. annotation tasks
2. evaluation

3. Discussion & Conclusion
4
Defining lexical
negation
5
Affixal negation
• Morante and Daelemans (2012): annotation of (affixal)
negation in two Conan Doyle stories
• Main goal: to annotate information relative to the negative
polarity of an event (negation + scope)
• ‘Narrow’ definition: only annotated if they are direct
antonyms of their non-affixed base
• unclear (not clear)
• disappear (*not appear), unspoken (*not spoken)
• What is considered an affixal negation should depend on the
task at hand
6
Roser Morante and Walter Daelemans. 2012. Conan Doyleneg: Annotation of negation in Conan Doyle stories.
In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC) .
Semantic categories (Joshi 2012)
• Joshi (2012): distinction between direct and
indirect affixal negations
• Direct: direct opposition with its positive counterpart
and characterized by the NOT-element (e.g. unhappy)
• Indirect: does not logically negate the existence of its
base, yet still maintains a negative connotation (e.g.
disconnect, debug)
7Shrikant Joshi. 2012. Affixal negation – direct, indirect and their subtypes. Syntaxe et semantique, (1):49–63.
Semantic categories (Joshi 2012)
8Shrikant Joshi. 2012. Affixal negation – direct, indirect and their subtypes. Syntaxe et semantique, (1):49–63.
Table: Subtypes of indirect negation from (Joshi, 2012, p. 27).
Relation to regular antonyms
• Full range of lexical opposites
• The difference between affixal negations and
regular antonyms is only morphological
9
a. distasteful (a ‘true’ affixal negation)
b. disgusting (only etymologically an affixal negation)
c. dead (a regular antonym)

continuous scale going from explicitly (a) to implicitly (c) marked
Full range of negation
10
Figure: Taxonomy of negations, based on (Joshi, 2012)
Antonymy in WordNet
• Direct antonymy: a lexical relation between
individual lexemes that have clear opposite
meanings (wet:dry, clear:unclear)
• Indirect antonymy: results from similarity relations
defined for the members of direct antonym pairs
(moist:dry, legible:unclear)
11
Antonymy in WordNet
12
Figure: Similarity and antonymy relations in WordNet, from (Gross and Miller, 1990).
Building a negation
dictionary
13
Annotation of WordNet antonyms
• Ideal lexical negation dictionary: regular antonyms + affixal
negations specified for their subtypes
• Starting point: all direct antonyms in WordNet (3,557 pairs,
including verbs, nouns, adjectives and adverbs)
• We included the following information from WordNet:

• the lemmas of both antonyms
• the lemma identifiers of both antonyms
• the definitions of both antonyms
• the part of speech
14
Annotation tasks
• Two expert annotators
• Three annotation tasks
1. Affixal or non-affixal
2. Direct or indirect (if affixal)
3. Subtype: 9 subtypes by (Joshi 2012) + additional
label LACKING (if indirect)
15
Example of entries
16
Table: Simplified examples of entries of affixal negations in the dictionary
Evaluation: IAA
17
Subtask 1:
Affixal or non-
affixal
Subtask 2:
Direct or indirect
Subtask 3:
Subtype
n (antonym pairs) n = 500 n = 268 n = 43
Cohen’s kappa 0.80 0.55 0.76
Evaluation: confusion matrix
18
Table: Confusion matrix for the annotation of subtypes
Evaluation: confusion
19
Table: Antonym pairs where both annotators recognized an indirect affixal negation but disagreed on the subtype.
Discussion
20
Discussion: doubt case (1)
fasten:unfasten Reversal of Action

fastened:unfastened Direct negation
States expressed by participles (adjectives) with a negative
affix can be interpreted as:
A. Indirect negation: a result of the action expressed by its verbal
base (unfasten)
B. Direct negation: the opposite of another state, i.e. its antonym
(fastened)
21
Discussion: doubt case (2)
Another example: spinous:spineless
• Affix -less indicates indirect negation (lacking something)
w.r.t. its base spine
• But: spineless is direct negation w.r.t. spinous
22
Discussion
• Two options to consider for annotation:
A. relation between affixed form and its base
(spine:spineless)
B. relation between two members of antonym pair
(spinous:spineless)
• In case of (a): what exactly should be considered
the base? E.g. unfastened: fastened vs. fasten
23
Discussion
• A negation dictionary is only as good as its
coverage
• Affixal negation is productive phenomenon; what
could be a fallback strategy? —> training a
classifier for detection and classification
• We still need to think about what relations this
classifier should learn (annotation guidelines)
24
Conclusion
• Set out the full scope of (lexical) negation
• Explored the possibility of an affixal negation/regular
antonyms dictionary to support automatic detection
• Preliminary study: annotated WordNet’s direct antonym pairs
• No definite solution, but we hope it contributes its share to the
discussion by highlighting some of the main issues to be considered
• The annotations are openly available at: 

https://github.com/cltl/lexical-negation-dictionary
25
Thank you for your
attention
26
c.m.van.son@vu.nl
This work was supported by the Amsterdam Academic Alliance Data Science (AAA-DS) Program
Award to the UvA and VU Universities, and by the Netherlands Organization for Scientific Research
(NWO) via the Spinoza-prize awarded to Piek Vossen (SPI 30-673, 2014-2019).

More Related Content

Similar to Building a Dictionary of Affixal Negations

CHAPTER 3. Lexeme Formation (Morphology (Linguistics)
CHAPTER 3. Lexeme Formation (Morphology (Linguistics)CHAPTER 3. Lexeme Formation (Morphology (Linguistics)
CHAPTER 3. Lexeme Formation (Morphology (Linguistics)
MehakAli97
 
Chinese Grammar vs English Grammar in Universal Dependency
Chinese Grammar vs English Grammar in Universal DependencyChinese Grammar vs English Grammar in Universal Dependency
Chinese Grammar vs English Grammar in Universal Dependency
Jinho Choi
 
relational maintenance
relational maintenancerelational maintenance
relational maintenance
Rich Murphy
 
DETECTING OXYMORON IN A SINGLE STATEMENT
DETECTING OXYMORON IN A SINGLE STATEMENTDETECTING OXYMORON IN A SINGLE STATEMENT
DETECTING OXYMORON IN A SINGLE STATEMENT
WarNik Chow
 
The scope of semantics made simple
The scope of semantics made simpleThe scope of semantics made simple
The scope of semantics made simple
Sudan University of Science and Technology (SUST)
 
the scope of semantics
the scope of semanticsthe scope of semantics
the scope of semantics
Ayi Yulianty
 
Sentiment Analysis in Twitter with Lightweight Discourse Analysis
Sentiment Analysis in Twitter with Lightweight Discourse AnalysisSentiment Analysis in Twitter with Lightweight Discourse Analysis
Sentiment Analysis in Twitter with Lightweight Discourse Analysis
Subhabrata Mukherjee
 
Ontology quality, ontology design patterns, and competency questions
Ontology quality, ontology design patterns, and competency questionsOntology quality, ontology design patterns, and competency questions
Ontology quality, ontology design patterns, and competency questions
Nicola Guarino
 

Similar to Building a Dictionary of Affixal Negations (8)

CHAPTER 3. Lexeme Formation (Morphology (Linguistics)
CHAPTER 3. Lexeme Formation (Morphology (Linguistics)CHAPTER 3. Lexeme Formation (Morphology (Linguistics)
CHAPTER 3. Lexeme Formation (Morphology (Linguistics)
 
Chinese Grammar vs English Grammar in Universal Dependency
Chinese Grammar vs English Grammar in Universal DependencyChinese Grammar vs English Grammar in Universal Dependency
Chinese Grammar vs English Grammar in Universal Dependency
 
relational maintenance
relational maintenancerelational maintenance
relational maintenance
 
DETECTING OXYMORON IN A SINGLE STATEMENT
DETECTING OXYMORON IN A SINGLE STATEMENTDETECTING OXYMORON IN A SINGLE STATEMENT
DETECTING OXYMORON IN A SINGLE STATEMENT
 
The scope of semantics made simple
The scope of semantics made simpleThe scope of semantics made simple
The scope of semantics made simple
 
the scope of semantics
the scope of semanticsthe scope of semantics
the scope of semantics
 
Sentiment Analysis in Twitter with Lightweight Discourse Analysis
Sentiment Analysis in Twitter with Lightweight Discourse AnalysisSentiment Analysis in Twitter with Lightweight Discourse Analysis
Sentiment Analysis in Twitter with Lightweight Discourse Analysis
 
Ontology quality, ontology design patterns, and competency questions
Ontology quality, ontology design patterns, and competency questionsOntology quality, ontology design patterns, and competency questions
Ontology quality, ontology design patterns, and competency questions
 

Recently uploaded

一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
nyvan3
 
一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理
一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理
一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理
actyx
 
Ahmedabad Call Girls 7339748667 With Free Home Delivery At Your Door
Ahmedabad Call Girls 7339748667 With Free Home Delivery At Your DoorAhmedabad Call Girls 7339748667 With Free Home Delivery At Your Door
Ahmedabad Call Girls 7339748667 With Free Home Delivery At Your Door
Russian Escorts in Delhi 9711199171 with low rate Book online
 
Senior Engineering Sample EM DOE - Sheet1.pdf
Senior Engineering Sample EM DOE  - Sheet1.pdfSenior Engineering Sample EM DOE  - Sheet1.pdf
Senior Engineering Sample EM DOE - Sheet1.pdf
Vineet
 
[VCOSA] Monthly Report - Cotton & Yarn Statistics March 2024
[VCOSA] Monthly Report - Cotton & Yarn Statistics March 2024[VCOSA] Monthly Report - Cotton & Yarn Statistics March 2024
[VCOSA] Monthly Report - Cotton & Yarn Statistics March 2024
Vietnam Cotton & Spinning Association
 
Discovering Digital Process Twins for What-if Analysis: a Process Mining Appr...
Discovering Digital Process Twins for What-if Analysis: a Process Mining Appr...Discovering Digital Process Twins for What-if Analysis: a Process Mining Appr...
Discovering Digital Process Twins for What-if Analysis: a Process Mining Appr...
Marlon Dumas
 
Data Scientist Machine Learning Profiles .pdf
Data Scientist Machine Learning  Profiles .pdfData Scientist Machine Learning  Profiles .pdf
Data Scientist Machine Learning Profiles .pdf
Vineet
 
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
agdhot
 
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
PsychoTech Services
 
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
Call Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call GirlCall Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call Girl
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
sapna sharmap11
 
How To Control IO Usage using Resource Manager
How To Control IO Usage using Resource ManagerHow To Control IO Usage using Resource Manager
How To Control IO Usage using Resource Manager
Alireza Kamrani
 
一比一原版澳洲西澳大学毕业证(uwa毕业证书)如何办理
一比一原版澳洲西澳大学毕业证(uwa毕业证书)如何办理一比一原版澳洲西澳大学毕业证(uwa毕业证书)如何办理
一比一原版澳洲西澳大学毕业证(uwa毕业证书)如何办理
aguty
 
PyData London 2024: Mistakes were made (Dr. Rebecca Bilbro)
PyData London 2024: Mistakes were made (Dr. Rebecca Bilbro)PyData London 2024: Mistakes were made (Dr. Rebecca Bilbro)
PyData London 2024: Mistakes were made (Dr. Rebecca Bilbro)
Rebecca Bilbro
 
Call Girls Lucknow 0000000000 Independent Call Girl Service Lucknow
Call Girls Lucknow 0000000000 Independent Call Girl Service LucknowCall Girls Lucknow 0000000000 Independent Call Girl Service Lucknow
Call Girls Lucknow 0000000000 Independent Call Girl Service Lucknow
hiju9823
 
Drownings spike from May to August in children
Drownings spike from May to August in childrenDrownings spike from May to August in children
Drownings spike from May to August in children
Bisnar Chase Personal Injury Attorneys
 
Bangalore ℂall Girl 000000 Bangalore Escorts Service
Bangalore ℂall Girl 000000 Bangalore Escorts ServiceBangalore ℂall Girl 000000 Bangalore Escorts Service
Bangalore ℂall Girl 000000 Bangalore Escorts Service
nhero3888
 
Sample Devops SRE Product Companies .pdf
Sample Devops SRE  Product Companies .pdfSample Devops SRE  Product Companies .pdf
Sample Devops SRE Product Companies .pdf
Vineet
 
Health care analysis using sentimental analysis
Health care analysis using sentimental analysisHealth care analysis using sentimental analysis
Health care analysis using sentimental analysis
krishnasrigannavarap
 
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
ytypuem
 
CAP Excel Formulas & Functions July - Copy (4).pdf
CAP Excel Formulas & Functions July - Copy (4).pdfCAP Excel Formulas & Functions July - Copy (4).pdf
CAP Excel Formulas & Functions July - Copy (4).pdf
frp60658
 

Recently uploaded (20)

一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
一比一原版英国赫特福德大学毕业证(hertfordshire毕业证书)如何办理
 
一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理
一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理
一比一原版斯威本理工大学毕业证(swinburne毕业证)如何办理
 
Ahmedabad Call Girls 7339748667 With Free Home Delivery At Your Door
Ahmedabad Call Girls 7339748667 With Free Home Delivery At Your DoorAhmedabad Call Girls 7339748667 With Free Home Delivery At Your Door
Ahmedabad Call Girls 7339748667 With Free Home Delivery At Your Door
 
Senior Engineering Sample EM DOE - Sheet1.pdf
Senior Engineering Sample EM DOE  - Sheet1.pdfSenior Engineering Sample EM DOE  - Sheet1.pdf
Senior Engineering Sample EM DOE - Sheet1.pdf
 
[VCOSA] Monthly Report - Cotton & Yarn Statistics March 2024
[VCOSA] Monthly Report - Cotton & Yarn Statistics March 2024[VCOSA] Monthly Report - Cotton & Yarn Statistics March 2024
[VCOSA] Monthly Report - Cotton & Yarn Statistics March 2024
 
Discovering Digital Process Twins for What-if Analysis: a Process Mining Appr...
Discovering Digital Process Twins for What-if Analysis: a Process Mining Appr...Discovering Digital Process Twins for What-if Analysis: a Process Mining Appr...
Discovering Digital Process Twins for What-if Analysis: a Process Mining Appr...
 
Data Scientist Machine Learning Profiles .pdf
Data Scientist Machine Learning  Profiles .pdfData Scientist Machine Learning  Profiles .pdf
Data Scientist Machine Learning Profiles .pdf
 
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
一比一原版加拿大麦吉尔大学毕业证(mcgill毕业证书)如何办理
 
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
Essential Skills for Family Assessment - Marital and Family Therapy and Couns...
 
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
Call Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call GirlCall Girls Hyderabad  (india) ☎️ +91-7426014248 Hyderabad  Call Girl
Call Girls Hyderabad (india) ☎️ +91-7426014248 Hyderabad Call Girl
 
How To Control IO Usage using Resource Manager
How To Control IO Usage using Resource ManagerHow To Control IO Usage using Resource Manager
How To Control IO Usage using Resource Manager
 
一比一原版澳洲西澳大学毕业证(uwa毕业证书)如何办理
一比一原版澳洲西澳大学毕业证(uwa毕业证书)如何办理一比一原版澳洲西澳大学毕业证(uwa毕业证书)如何办理
一比一原版澳洲西澳大学毕业证(uwa毕业证书)如何办理
 
PyData London 2024: Mistakes were made (Dr. Rebecca Bilbro)
PyData London 2024: Mistakes were made (Dr. Rebecca Bilbro)PyData London 2024: Mistakes were made (Dr. Rebecca Bilbro)
PyData London 2024: Mistakes were made (Dr. Rebecca Bilbro)
 
Call Girls Lucknow 0000000000 Independent Call Girl Service Lucknow
Call Girls Lucknow 0000000000 Independent Call Girl Service LucknowCall Girls Lucknow 0000000000 Independent Call Girl Service Lucknow
Call Girls Lucknow 0000000000 Independent Call Girl Service Lucknow
 
Drownings spike from May to August in children
Drownings spike from May to August in childrenDrownings spike from May to August in children
Drownings spike from May to August in children
 
Bangalore ℂall Girl 000000 Bangalore Escorts Service
Bangalore ℂall Girl 000000 Bangalore Escorts ServiceBangalore ℂall Girl 000000 Bangalore Escorts Service
Bangalore ℂall Girl 000000 Bangalore Escorts Service
 
Sample Devops SRE Product Companies .pdf
Sample Devops SRE  Product Companies .pdfSample Devops SRE  Product Companies .pdf
Sample Devops SRE Product Companies .pdf
 
Health care analysis using sentimental analysis
Health care analysis using sentimental analysisHealth care analysis using sentimental analysis
Health care analysis using sentimental analysis
 
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
一比一原版(曼大毕业证书)曼尼托巴大学毕业证如何办理
 
CAP Excel Formulas & Functions July - Copy (4).pdf
CAP Excel Formulas & Functions July - Copy (4).pdfCAP Excel Formulas & Functions July - Copy (4).pdf
CAP Excel Formulas & Functions July - Copy (4).pdf
 

Building a Dictionary of Affixal Negations

  • 1. Building a Dictionary of Affixal Negations 1 Chantal van Son, Emiel van Miltenburg, Roser Morante (VU Amsterdam) c.m.van.son@vu.nl ExProM Workshop @ COLING 2016 Special Session on Negation
 December 12, 2016 - Osaka, Japan
  • 2. Introduction: Affixal negations • Words marked with negative affix; typically flag the absence of particular features • English: un-, in-, dis-, a-, an-, non-, im-, il-, ir-, -less
 e.g. unable, disagree, impossible • Automatic detection could benefit NLP tasks such as text mining, recognizing textual entailment, paraphrasing and QA 2
  • 3. Introduction: Affixal negations • Blanco & Moldovan (2011): very difficult to detect without substantial false positive rate • how to distinguish between ineffective and invite?
 —> check whether word is still valid after removing prefix: how to prevent inform from being annotated? • how do deal with ambiguity: invalid (a) vs. invalid (n)? • Automatic detection might benefit from dictionary-based approach 3 Eduardo Blanco and Dan Moldovan. 2011. Some issues on detecting negation from text. In Proceedings of the 24th International Florida Artificial Intelligence Research Society Conference , pages 228–233.
  • 4. Overview of today’s talk 1. Defining lexical negation 1. affixal negations and regular antonyms 2. typology of affixal negations (Joshi 2012)
 2. Building a negation dictionary (preliminary study) 1. annotation tasks 2. evaluation
 3. Discussion & Conclusion 4
  • 6. Affixal negation • Morante and Daelemans (2012): annotation of (affixal) negation in two Conan Doyle stories • Main goal: to annotate information relative to the negative polarity of an event (negation + scope) • ‘Narrow’ definition: only annotated if they are direct antonyms of their non-affixed base • unclear (not clear) • disappear (*not appear), unspoken (*not spoken) • What is considered an affixal negation should depend on the task at hand 6 Roser Morante and Walter Daelemans. 2012. Conan Doyleneg: Annotation of negation in Conan Doyle stories. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC) .
  • 7. Semantic categories (Joshi 2012) • Joshi (2012): distinction between direct and indirect affixal negations • Direct: direct opposition with its positive counterpart and characterized by the NOT-element (e.g. unhappy) • Indirect: does not logically negate the existence of its base, yet still maintains a negative connotation (e.g. disconnect, debug) 7Shrikant Joshi. 2012. Affixal negation – direct, indirect and their subtypes. Syntaxe et semantique, (1):49–63.
  • 8. Semantic categories (Joshi 2012) 8Shrikant Joshi. 2012. Affixal negation – direct, indirect and their subtypes. Syntaxe et semantique, (1):49–63. Table: Subtypes of indirect negation from (Joshi, 2012, p. 27).
  • 9. Relation to regular antonyms • Full range of lexical opposites • The difference between affixal negations and regular antonyms is only morphological 9 a. distasteful (a ‘true’ affixal negation) b. disgusting (only etymologically an affixal negation) c. dead (a regular antonym)
 continuous scale going from explicitly (a) to implicitly (c) marked
  • 10. Full range of negation 10 Figure: Taxonomy of negations, based on (Joshi, 2012)
  • 11. Antonymy in WordNet • Direct antonymy: a lexical relation between individual lexemes that have clear opposite meanings (wet:dry, clear:unclear) • Indirect antonymy: results from similarity relations defined for the members of direct antonym pairs (moist:dry, legible:unclear) 11
  • 12. Antonymy in WordNet 12 Figure: Similarity and antonymy relations in WordNet, from (Gross and Miller, 1990).
  • 14. Annotation of WordNet antonyms • Ideal lexical negation dictionary: regular antonyms + affixal negations specified for their subtypes • Starting point: all direct antonyms in WordNet (3,557 pairs, including verbs, nouns, adjectives and adverbs) • We included the following information from WordNet:
 • the lemmas of both antonyms • the lemma identifiers of both antonyms • the definitions of both antonyms • the part of speech 14
  • 15. Annotation tasks • Two expert annotators • Three annotation tasks 1. Affixal or non-affixal 2. Direct or indirect (if affixal) 3. Subtype: 9 subtypes by (Joshi 2012) + additional label LACKING (if indirect) 15
  • 16. Example of entries 16 Table: Simplified examples of entries of affixal negations in the dictionary
  • 17. Evaluation: IAA 17 Subtask 1: Affixal or non- affixal Subtask 2: Direct or indirect Subtask 3: Subtype n (antonym pairs) n = 500 n = 268 n = 43 Cohen’s kappa 0.80 0.55 0.76
  • 18. Evaluation: confusion matrix 18 Table: Confusion matrix for the annotation of subtypes
  • 19. Evaluation: confusion 19 Table: Antonym pairs where both annotators recognized an indirect affixal negation but disagreed on the subtype.
  • 21. Discussion: doubt case (1) fasten:unfasten Reversal of Action
 fastened:unfastened Direct negation States expressed by participles (adjectives) with a negative affix can be interpreted as: A. Indirect negation: a result of the action expressed by its verbal base (unfasten) B. Direct negation: the opposite of another state, i.e. its antonym (fastened) 21
  • 22. Discussion: doubt case (2) Another example: spinous:spineless • Affix -less indicates indirect negation (lacking something) w.r.t. its base spine • But: spineless is direct negation w.r.t. spinous 22
  • 23. Discussion • Two options to consider for annotation: A. relation between affixed form and its base (spine:spineless) B. relation between two members of antonym pair (spinous:spineless) • In case of (a): what exactly should be considered the base? E.g. unfastened: fastened vs. fasten 23
  • 24. Discussion • A negation dictionary is only as good as its coverage • Affixal negation is productive phenomenon; what could be a fallback strategy? —> training a classifier for detection and classification • We still need to think about what relations this classifier should learn (annotation guidelines) 24
  • 25. Conclusion • Set out the full scope of (lexical) negation • Explored the possibility of an affixal negation/regular antonyms dictionary to support automatic detection • Preliminary study: annotated WordNet’s direct antonym pairs • No definite solution, but we hope it contributes its share to the discussion by highlighting some of the main issues to be considered • The annotations are openly available at: 
 https://github.com/cltl/lexical-negation-dictionary 25
  • 26. Thank you for your attention 26 c.m.van.son@vu.nl This work was supported by the Amsterdam Academic Alliance Data Science (AAA-DS) Program Award to the UvA and VU Universities, and by the Netherlands Organization for Scientific Research (NWO) via the Spinoza-prize awarded to Piek Vossen (SPI 30-673, 2014-2019).