SlideShare a Scribd company logo

Joakim Nivre - 2017 - Presidential Address ACL 2017: Challenges for ACL

Presidential Address to the ACL by Professor Joakim Nivre (Uppsala Universitet) for ACL 2017. 31 Jul 2017. Vancouver, Canada License: CC BY 4.0

1 of 82
Download to read offline
Challenges for ACL
ACL Presidential Address 2017
Joakim Nivre
(A)CL is booming!
0
300
600
900
1200
1500
2008 2009 2010 2011 2012 2013 2014 2015 2016 2017
ACL submissions
(A)CL is booming!
0
300
600
900
1200
1500
2008 2009 2010 2011 2012 2013 2014 2015 2016 2017
ACL submissions
92
93
94
95
96
2008 2009 2010 2011 2012 2013 2014 2015 2016 2017
UAS on WSJ
(A)CL is booming!
The future is bright!
Joakim Nivre - 2017 - Presidential Address ACL 2017: Challenges for ACL
Ad

Recommended

Xiaohan zeng research
Xiaohan zeng researchXiaohan zeng research
Xiaohan zeng researchXiaohan Zeng
 
WE16 - Practical Integration of Diversity and Inclusion Competencies into Eng...
WE16 - Practical Integration of Diversity and Inclusion Competencies into Eng...WE16 - Practical Integration of Diversity and Inclusion Competencies into Eng...
WE16 - Practical Integration of Diversity and Inclusion Competencies into Eng...Society of Women Engineers
 
Gender diversity on management and supervisory boards
Gender diversity on management and supervisory boardsGender diversity on management and supervisory boards
Gender diversity on management and supervisory boardsGRAPE
 
The second WiNLP Workshop at NAACL 2018
The second WiNLP Workshop at NAACL 2018The second WiNLP Workshop at NAACL 2018
The second WiNLP Workshop at NAACL 2018Diyi Yang
 

More Related Content

Similar to Joakim Nivre - 2017 - Presidential Address ACL 2017: Challenges for ACL

UKSG Conference 2015 - “Peer review is dead, long live peer review.” Michael ...
UKSG Conference 2015 - “Peer review is dead, long live peer review.” Michael ...UKSG Conference 2015 - “Peer review is dead, long live peer review.” Michael ...
UKSG Conference 2015 - “Peer review is dead, long live peer review.” Michael ...UKSG: connecting the knowledge community
 
Publishing tips UNISA 2019
Publishing tips UNISA  2019Publishing tips UNISA  2019
Publishing tips UNISA 2019Terry Anderson
 
Legal scholarship and OA publishing: developing radical pathways to free, op...
 Legal scholarship and OA publishing: developing radical pathways to free, op... Legal scholarship and OA publishing: developing radical pathways to free, op...
Legal scholarship and OA publishing: developing radical pathways to free, op...York University - Osgoode Hall Law School
 
Opening the Academy: Why Research Results Should be Accessible
Opening the Academy: Why Research Results Should be AccessibleOpening the Academy: Why Research Results Should be Accessible
Opening the Academy: Why Research Results Should be AccessibleTown Peterson
 
Publication in International Journals: Tips, traps and a look at IRRODL
Publication in International Journals: Tips, traps and a look at IRRODLPublication in International Journals: Tips, traps and a look at IRRODL
Publication in International Journals: Tips, traps and a look at IRRODLTerry Anderson
 
Scholarly Communication - Not just for scholars anymore
Scholarly Communication - Not just for scholars anymoreScholarly Communication - Not just for scholars anymore
Scholarly Communication - Not just for scholars anymoreJoseph Kraus
 
Open Access: an introduction
Open Access: an introductionOpen Access: an introduction
Open Access: an introductionElizabeth Yates
 
The past, present, and future of publishing
The past, present, and future of publishingThe past, present, and future of publishing
The past, present, and future of publishingJonathan Tennant
 
Using Wikipedia for Research
Using Wikipedia for ResearchUsing Wikipedia for Research
Using Wikipedia for ResearchMandi Goodsett
 
Week 4 - JournalRough Draft Review Process Evaluation[WLOs 1, 2.docx
Week 4 - JournalRough Draft Review Process Evaluation[WLOs 1, 2.docxWeek 4 - JournalRough Draft Review Process Evaluation[WLOs 1, 2.docx
Week 4 - JournalRough Draft Review Process Evaluation[WLOs 1, 2.docxcockekeshia
 
Surbiton High School Oct 2018
Surbiton High School Oct 2018 Surbiton High School Oct 2018
Surbiton High School Oct 2018 EISLibrarian
 
Humanities info mgmt diss
Humanities info mgmt dissHumanities info mgmt diss
Humanities info mgmt dissRLS-Johnrylands
 
Geog 4311 historical geography
Geog 4311 historical geographyGeog 4311 historical geography
Geog 4311 historical geographyciakov
 
Poster Presentation.pptx
Poster Presentation.pptxPoster Presentation.pptx
Poster Presentation.pptxWasiqAli28
 

Similar to Joakim Nivre - 2017 - Presidential Address ACL 2017: Challenges for ACL (20)

UKSG Conference 2015 - “Peer review is dead, long live peer review.” Michael ...
UKSG Conference 2015 - “Peer review is dead, long live peer review.” Michael ...UKSG Conference 2015 - “Peer review is dead, long live peer review.” Michael ...
UKSG Conference 2015 - “Peer review is dead, long live peer review.” Michael ...
 
Publishing tips UNISA 2019
Publishing tips UNISA  2019Publishing tips UNISA  2019
Publishing tips UNISA 2019
 
Dove, "A Model of the User's Psychological State as a Framework for Understan...
Dove, "A Model of the User's Psychological State as a Framework for Understan...Dove, "A Model of the User's Psychological State as a Framework for Understan...
Dove, "A Model of the User's Psychological State as a Framework for Understan...
 
Ivone Cabral – WG5: Scientific Publishing Innovations and the Future of Peer ...
Ivone Cabral – WG5: Scientific Publishing Innovations and the Future of Peer ...Ivone Cabral – WG5: Scientific Publishing Innovations and the Future of Peer ...
Ivone Cabral – WG5: Scientific Publishing Innovations and the Future of Peer ...
 
Legal scholarship and OA publishing: developing radical pathways to free, op...
 Legal scholarship and OA publishing: developing radical pathways to free, op... Legal scholarship and OA publishing: developing radical pathways to free, op...
Legal scholarship and OA publishing: developing radical pathways to free, op...
 
Opening the Academy: Why Research Results Should be Accessible
Opening the Academy: Why Research Results Should be AccessibleOpening the Academy: Why Research Results Should be Accessible
Opening the Academy: Why Research Results Should be Accessible
 
Publication in International Journals: Tips, traps and a look at IRRODL
Publication in International Journals: Tips, traps and a look at IRRODLPublication in International Journals: Tips, traps and a look at IRRODL
Publication in International Journals: Tips, traps and a look at IRRODL
 
Scholarly Communication - Not just for scholars anymore
Scholarly Communication - Not just for scholars anymoreScholarly Communication - Not just for scholars anymore
Scholarly Communication - Not just for scholars anymore
 
Open Access: an introduction
Open Access: an introductionOpen Access: an introduction
Open Access: an introduction
 
The past, present, and future of publishing
The past, present, and future of publishingThe past, present, and future of publishing
The past, present, and future of publishing
 
NISO Webinar: New Perspectives on Assessment How Altmetrics Measure Scholarly...
NISO Webinar: New Perspectives on Assessment How Altmetrics Measure Scholarly...NISO Webinar: New Perspectives on Assessment How Altmetrics Measure Scholarly...
NISO Webinar: New Perspectives on Assessment How Altmetrics Measure Scholarly...
 
Using Wikipedia for Research
Using Wikipedia for ResearchUsing Wikipedia for Research
Using Wikipedia for Research
 
Gunn Designing Metrics that Serve Academica
Gunn Designing Metrics that Serve AcademicaGunn Designing Metrics that Serve Academica
Gunn Designing Metrics that Serve Academica
 
Week 4 - JournalRough Draft Review Process Evaluation[WLOs 1, 2.docx
Week 4 - JournalRough Draft Review Process Evaluation[WLOs 1, 2.docxWeek 4 - JournalRough Draft Review Process Evaluation[WLOs 1, 2.docx
Week 4 - JournalRough Draft Review Process Evaluation[WLOs 1, 2.docx
 
Surbiton High School Oct 2018
Surbiton High School Oct 2018 Surbiton High School Oct 2018
Surbiton High School Oct 2018
 
Writing for publication… Some tentative ideas
Writing for publication… Some tentative ideasWriting for publication… Some tentative ideas
Writing for publication… Some tentative ideas
 
Humanities info mgmt diss
Humanities info mgmt dissHumanities info mgmt diss
Humanities info mgmt diss
 
Geog 4311 historical geography
Geog 4311 historical geographyGeog 4311 historical geography
Geog 4311 historical geography
 
Poster Presentation.pptx
Poster Presentation.pptxPoster Presentation.pptx
Poster Presentation.pptx
 
Maccallum
MaccallumMaccallum
Maccallum
 

More from Association for Computational Linguistics

Castro - 2018 - A High Coverage Method for Automatic False Friends Detection ...
Castro - 2018 - A High Coverage Method for Automatic False Friends Detection ...Castro - 2018 - A High Coverage Method for Automatic False Friends Detection ...
Castro - 2018 - A High Coverage Method for Automatic False Friends Detection ...Association for Computational Linguistics
 
Muthu Kumar Chandrasekaran - 2018 - Countering Position Bias in Instructor In...
Muthu Kumar Chandrasekaran - 2018 - Countering Position Bias in Instructor In...Muthu Kumar Chandrasekaran - 2018 - Countering Position Bias in Instructor In...
Muthu Kumar Chandrasekaran - 2018 - Countering Position Bias in Instructor In...Association for Computational Linguistics
 
Daniel Gildea - 2018 - The ACL Anthology: Current State and Future Directions
Daniel Gildea - 2018 - The ACL Anthology: Current State and Future DirectionsDaniel Gildea - 2018 - The ACL Anthology: Current State and Future Directions
Daniel Gildea - 2018 - The ACL Anthology: Current State and Future DirectionsAssociation for Computational Linguistics
 
Daniel Gildea - 2018 - The ACL Anthology: Current State and Future Directions
Daniel Gildea - 2018 - The ACL Anthology: Current State and Future DirectionsDaniel Gildea - 2018 - The ACL Anthology: Current State and Future Directions
Daniel Gildea - 2018 - The ACL Anthology: Current State and Future DirectionsAssociation for Computational Linguistics
 
Wenqiang Lei - 2018 - Sequicity: Simplifying Task-oriented Dialogue Systems w...
Wenqiang Lei - 2018 - Sequicity: Simplifying Task-oriented Dialogue Systems w...Wenqiang Lei - 2018 - Sequicity: Simplifying Task-oriented Dialogue Systems w...
Wenqiang Lei - 2018 - Sequicity: Simplifying Task-oriented Dialogue Systems w...Association for Computational Linguistics
 
Matthew Marge - 2017 - Exploring Variation of Natural Human Commands to a Rob...
Matthew Marge - 2017 - Exploring Variation of Natural Human Commands to a Rob...Matthew Marge - 2017 - Exploring Variation of Natural Human Commands to a Rob...
Matthew Marge - 2017 - Exploring Variation of Natural Human Commands to a Rob...Association for Computational Linguistics
 
Venkatesh Duppada - 2017 - SeerNet at EmoInt-2017: Tweet Emotion Intensity Es...
Venkatesh Duppada - 2017 - SeerNet at EmoInt-2017: Tweet Emotion Intensity Es...Venkatesh Duppada - 2017 - SeerNet at EmoInt-2017: Tweet Emotion Intensity Es...
Venkatesh Duppada - 2017 - SeerNet at EmoInt-2017: Tweet Emotion Intensity Es...Association for Computational Linguistics
 
Satoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 Workshop
Satoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 WorkshopSatoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 Workshop
Satoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 WorkshopAssociation for Computational Linguistics
 
John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...
John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...
John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...Association for Computational Linguistics
 
John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...
John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...
John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...Association for Computational Linguistics
 
Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...
Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...
Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...Association for Computational Linguistics
 
Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...
Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...
Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...Association for Computational Linguistics
 
Satoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 Workshop
Satoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 WorkshopSatoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 Workshop
Satoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 WorkshopAssociation for Computational Linguistics
 
Graham Neubig - 2015 - Neural Reranking Improves Subjective Quality of Machin...
Graham Neubig - 2015 - Neural Reranking Improves Subjective Quality of Machin...Graham Neubig - 2015 - Neural Reranking Improves Subjective Quality of Machin...
Graham Neubig - 2015 - Neural Reranking Improves Subjective Quality of Machin...Association for Computational Linguistics
 

More from Association for Computational Linguistics (20)

Muis - 2016 - Weak Semi-Markov CRFs for NP Chunking in Informal Text
Muis - 2016 - Weak Semi-Markov CRFs for NP Chunking in Informal TextMuis - 2016 - Weak Semi-Markov CRFs for NP Chunking in Informal Text
Muis - 2016 - Weak Semi-Markov CRFs for NP Chunking in Informal Text
 
Castro - 2018 - A High Coverage Method for Automatic False Friends Detection ...
Castro - 2018 - A High Coverage Method for Automatic False Friends Detection ...Castro - 2018 - A High Coverage Method for Automatic False Friends Detection ...
Castro - 2018 - A High Coverage Method for Automatic False Friends Detection ...
 
Castro - 2018 - A Crowd-Annotated Spanish Corpus for Humour Analysis
Castro - 2018 - A Crowd-Annotated Spanish Corpus for Humour AnalysisCastro - 2018 - A Crowd-Annotated Spanish Corpus for Humour Analysis
Castro - 2018 - A Crowd-Annotated Spanish Corpus for Humour Analysis
 
Muthu Kumar Chandrasekaran - 2018 - Countering Position Bias in Instructor In...
Muthu Kumar Chandrasekaran - 2018 - Countering Position Bias in Instructor In...Muthu Kumar Chandrasekaran - 2018 - Countering Position Bias in Instructor In...
Muthu Kumar Chandrasekaran - 2018 - Countering Position Bias in Instructor In...
 
Daniel Gildea - 2018 - The ACL Anthology: Current State and Future Directions
Daniel Gildea - 2018 - The ACL Anthology: Current State and Future DirectionsDaniel Gildea - 2018 - The ACL Anthology: Current State and Future Directions
Daniel Gildea - 2018 - The ACL Anthology: Current State and Future Directions
 
Elior Sulem - 2018 - Semantic Structural Evaluation for Text Simplification
Elior Sulem - 2018 - Semantic Structural Evaluation for Text SimplificationElior Sulem - 2018 - Semantic Structural Evaluation for Text Simplification
Elior Sulem - 2018 - Semantic Structural Evaluation for Text Simplification
 
Daniel Gildea - 2018 - The ACL Anthology: Current State and Future Directions
Daniel Gildea - 2018 - The ACL Anthology: Current State and Future DirectionsDaniel Gildea - 2018 - The ACL Anthology: Current State and Future Directions
Daniel Gildea - 2018 - The ACL Anthology: Current State and Future Directions
 
Wenqiang Lei - 2018 - Sequicity: Simplifying Task-oriented Dialogue Systems w...
Wenqiang Lei - 2018 - Sequicity: Simplifying Task-oriented Dialogue Systems w...Wenqiang Lei - 2018 - Sequicity: Simplifying Task-oriented Dialogue Systems w...
Wenqiang Lei - 2018 - Sequicity: Simplifying Task-oriented Dialogue Systems w...
 
Matthew Marge - 2017 - Exploring Variation of Natural Human Commands to a Rob...
Matthew Marge - 2017 - Exploring Variation of Natural Human Commands to a Rob...Matthew Marge - 2017 - Exploring Variation of Natural Human Commands to a Rob...
Matthew Marge - 2017 - Exploring Variation of Natural Human Commands to a Rob...
 
Venkatesh Duppada - 2017 - SeerNet at EmoInt-2017: Tweet Emotion Intensity Es...
Venkatesh Duppada - 2017 - SeerNet at EmoInt-2017: Tweet Emotion Intensity Es...Venkatesh Duppada - 2017 - SeerNet at EmoInt-2017: Tweet Emotion Intensity Es...
Venkatesh Duppada - 2017 - SeerNet at EmoInt-2017: Tweet Emotion Intensity Es...
 
Satoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 Workshop
Satoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 WorkshopSatoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 Workshop
Satoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 Workshop
 
Chenchen Ding - 2015 - NICT at WAT 2015
Chenchen Ding - 2015 - NICT at WAT 2015Chenchen Ding - 2015 - NICT at WAT 2015
Chenchen Ding - 2015 - NICT at WAT 2015
 
John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...
John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...
John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...
 
John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...
John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...
John Richardson - 2015 - KyotoEBMT System Description for the 2nd Workshop on...
 
Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...
Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...
Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...
 
Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...
Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...
Zhongyuan Zhu - 2015 - Evaluating Neural Machine Translation in English-Japan...
 
Hyoung-Gyu Lee - 2015 - NAVER Machine Translation System for WAT 2015
Hyoung-Gyu Lee - 2015 - NAVER Machine Translation System for WAT 2015Hyoung-Gyu Lee - 2015 - NAVER Machine Translation System for WAT 2015
Hyoung-Gyu Lee - 2015 - NAVER Machine Translation System for WAT 2015
 
Satoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 Workshop
Satoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 WorkshopSatoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 Workshop
Satoshi Sonoh - 2015 - Toshiba MT System Description for the WAT2015 Workshop
 
Chenchen Ding - 2015 - NICT at WAT 2015
Chenchen Ding - 2015 - NICT at WAT 2015Chenchen Ding - 2015 - NICT at WAT 2015
Chenchen Ding - 2015 - NICT at WAT 2015
 
Graham Neubig - 2015 - Neural Reranking Improves Subjective Quality of Machin...
Graham Neubig - 2015 - Neural Reranking Improves Subjective Quality of Machin...Graham Neubig - 2015 - Neural Reranking Improves Subjective Quality of Machin...
Graham Neubig - 2015 - Neural Reranking Improves Subjective Quality of Machin...
 

Recently uploaded

Persuasive Speaking and Means of Persuasion
Persuasive Speaking and Means of PersuasionPersuasive Speaking and Means of Persuasion
Persuasive Speaking and Means of PersuasionCorinne Weisgerber
 
Chromatography-Gas chromatography-Principle
Chromatography-Gas chromatography-PrincipleChromatography-Gas chromatography-Principle
Chromatography-Gas chromatography-Principleblessipriyanka
 
ICSE English Literature Class X Handwritten Notes
ICSE English Literature Class X Handwritten NotesICSE English Literature Class X Handwritten Notes
ICSE English Literature Class X Handwritten NotesGauri S
 
11 CI SINIF SINAQLARI - 5-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 5-2023-Aynura-Hamidova.pdf11 CI SINIF SINAQLARI - 5-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 5-2023-Aynura-Hamidova.pdfAynouraHamidova
 
Nzinga Kika - The story of the queen
Nzinga Kika    -  The story of the queenNzinga Kika    -  The story of the queen
Nzinga Kika - The story of the queenDeanAmory1
 
spring_bee_bot_creations_erd primary.pdf
spring_bee_bot_creations_erd primary.pdfspring_bee_bot_creations_erd primary.pdf
spring_bee_bot_creations_erd primary.pdfKonstantina Koutsodimou
 
Food Web SlideShare for Ecology Notes Quiz in Canvas
Food Web SlideShare for Ecology Notes Quiz in CanvasFood Web SlideShare for Ecology Notes Quiz in Canvas
Food Web SlideShare for Ecology Notes Quiz in CanvasAlexandraSwartzwelde
 
New Features in the Odoo 17 Sales Module
New Features in  the Odoo 17 Sales ModuleNew Features in  the Odoo 17 Sales Module
New Features in the Odoo 17 Sales ModuleCeline George
 
BEZA or Bangladesh Economic Zone Authority recruitment exam question solution...
BEZA or Bangladesh Economic Zone Authority recruitment exam question solution...BEZA or Bangladesh Economic Zone Authority recruitment exam question solution...
BEZA or Bangladesh Economic Zone Authority recruitment exam question solution...MohonDas
 
Creative, Technical, and Academic Writing
Creative, Technical, and Academic WritingCreative, Technical, and Academic Writing
Creative, Technical, and Academic WritingMYDA ANGELICA SUAN
 
Practical Research 1: Qualitative Research and Its Importance in Daily Life.pptx
Practical Research 1: Qualitative Research and Its Importance in Daily Life.pptxPractical Research 1: Qualitative Research and Its Importance in Daily Life.pptx
Practical Research 1: Qualitative Research and Its Importance in Daily Life.pptxKatherine Villaluna
 
11 CI SINIF SINAQLARI - 10-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 10-2023-Aynura-Hamidova.pdf11 CI SINIF SINAQLARI - 10-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 10-2023-Aynura-Hamidova.pdfAynouraHamidova
 
11 CI SINIF SINAQLARI - 2-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 2-2023-Aynura-Hamidova.pdf11 CI SINIF SINAQLARI - 2-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 2-2023-Aynura-Hamidova.pdfAynouraHamidova
 
Diploma 2nd yr PHARMACOLOGY chapter 5 part 1.pdf
Diploma 2nd yr PHARMACOLOGY chapter 5 part 1.pdfDiploma 2nd yr PHARMACOLOGY chapter 5 part 1.pdf
Diploma 2nd yr PHARMACOLOGY chapter 5 part 1.pdfSUMIT TIWARI
 
11 CI SINIF SINAQLARI - 1-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 1-2023-Aynura-Hamidova.pdf11 CI SINIF SINAQLARI - 1-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 1-2023-Aynura-Hamidova.pdfAynouraHamidova
 
ADAPTABILITY, Types of Adaptability AND STABILITY ANALYSIS method.pptx
ADAPTABILITY, Types of Adaptability AND STABILITY ANALYSIS  method.pptxADAPTABILITY, Types of Adaptability AND STABILITY ANALYSIS  method.pptx
ADAPTABILITY, Types of Adaptability AND STABILITY ANALYSIS method.pptxAKSHAYMAGAR17
 
Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...
Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...
Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...EduSkills OECD
 
Grades 7 to 8 Anti- OSAEC and CSAEM session.pptx
Grades 7 to 8 Anti- OSAEC and CSAEM session.pptxGrades 7 to 8 Anti- OSAEC and CSAEM session.pptx
Grades 7 to 8 Anti- OSAEC and CSAEM session.pptxGladysValencia13
 

Recently uploaded (20)

Persuasive Speaking and Means of Persuasion
Persuasive Speaking and Means of PersuasionPersuasive Speaking and Means of Persuasion
Persuasive Speaking and Means of Persuasion
 
Chromatography-Gas chromatography-Principle
Chromatography-Gas chromatography-PrincipleChromatography-Gas chromatography-Principle
Chromatography-Gas chromatography-Principle
 
ICSE English Literature Class X Handwritten Notes
ICSE English Literature Class X Handwritten NotesICSE English Literature Class X Handwritten Notes
ICSE English Literature Class X Handwritten Notes
 
11 CI SINIF SINAQLARI - 5-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 5-2023-Aynura-Hamidova.pdf11 CI SINIF SINAQLARI - 5-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 5-2023-Aynura-Hamidova.pdf
 
Nzinga Kika - The story of the queen
Nzinga Kika    -  The story of the queenNzinga Kika    -  The story of the queen
Nzinga Kika - The story of the queen
 
spring_bee_bot_creations_erd primary.pdf
spring_bee_bot_creations_erd primary.pdfspring_bee_bot_creations_erd primary.pdf
spring_bee_bot_creations_erd primary.pdf
 
Food Web SlideShare for Ecology Notes Quiz in Canvas
Food Web SlideShare for Ecology Notes Quiz in CanvasFood Web SlideShare for Ecology Notes Quiz in Canvas
Food Web SlideShare for Ecology Notes Quiz in Canvas
 
New Features in the Odoo 17 Sales Module
New Features in  the Odoo 17 Sales ModuleNew Features in  the Odoo 17 Sales Module
New Features in the Odoo 17 Sales Module
 
BEZA or Bangladesh Economic Zone Authority recruitment exam question solution...
BEZA or Bangladesh Economic Zone Authority recruitment exam question solution...BEZA or Bangladesh Economic Zone Authority recruitment exam question solution...
BEZA or Bangladesh Economic Zone Authority recruitment exam question solution...
 
Creative, Technical, and Academic Writing
Creative, Technical, and Academic WritingCreative, Technical, and Academic Writing
Creative, Technical, and Academic Writing
 
Practical Research 1: Qualitative Research and Its Importance in Daily Life.pptx
Practical Research 1: Qualitative Research and Its Importance in Daily Life.pptxPractical Research 1: Qualitative Research and Its Importance in Daily Life.pptx
Practical Research 1: Qualitative Research and Its Importance in Daily Life.pptx
 
11 CI SINIF SINAQLARI - 10-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 10-2023-Aynura-Hamidova.pdf11 CI SINIF SINAQLARI - 10-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 10-2023-Aynura-Hamidova.pdf
 
Lipids as Biopolymer
Lipids as Biopolymer Lipids as Biopolymer
Lipids as Biopolymer
 
11 CI SINIF SINAQLARI - 2-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 2-2023-Aynura-Hamidova.pdf11 CI SINIF SINAQLARI - 2-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 2-2023-Aynura-Hamidova.pdf
 
Diploma 2nd yr PHARMACOLOGY chapter 5 part 1.pdf
Diploma 2nd yr PHARMACOLOGY chapter 5 part 1.pdfDiploma 2nd yr PHARMACOLOGY chapter 5 part 1.pdf
Diploma 2nd yr PHARMACOLOGY chapter 5 part 1.pdf
 
11 CI SINIF SINAQLARI - 1-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 1-2023-Aynura-Hamidova.pdf11 CI SINIF SINAQLARI - 1-2023-Aynura-Hamidova.pdf
11 CI SINIF SINAQLARI - 1-2023-Aynura-Hamidova.pdf
 
ADAPTABILITY, Types of Adaptability AND STABILITY ANALYSIS method.pptx
ADAPTABILITY, Types of Adaptability AND STABILITY ANALYSIS  method.pptxADAPTABILITY, Types of Adaptability AND STABILITY ANALYSIS  method.pptx
ADAPTABILITY, Types of Adaptability AND STABILITY ANALYSIS method.pptx
 
Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...
Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...
Andreas Schleicher - 20 Feb 2024 - How pop music, podcasts, and Tik Tok are i...
 
Grades 7 to 8 Anti- OSAEC and CSAEM session.pptx
Grades 7 to 8 Anti- OSAEC and CSAEM session.pptxGrades 7 to 8 Anti- OSAEC and CSAEM session.pptx
Grades 7 to 8 Anti- OSAEC and CSAEM session.pptx
 
ThinkTech 2024 Prelims- U25 BizTech Quiz by Pragya
ThinkTech 2024 Prelims- U25 BizTech Quiz by PragyaThinkTech 2024 Prelims- U25 BizTech Quiz by Pragya
ThinkTech 2024 Prelims- U25 BizTech Quiz by Pragya
 

Joakim Nivre - 2017 - Presidential Address ACL 2017: Challenges for ACL

  • 1. Challenges for ACL ACL Presidential Address 2017 Joakim Nivre
  • 3. 0 300 600 900 1200 1500 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 ACL submissions (A)CL is booming!
  • 4. 0 300 600 900 1200 1500 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 ACL submissions 92 93 94 95 96 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 UAS on WSJ (A)CL is booming!
  • 5. The future is bright!
  • 8. Challenges for ACL Equity and Diversity Publishing and Reviewing Good Science
  • 9. Can you spot the mistake? ACL Presidents 2009–2017
  • 10. Only four of them are wearing funny hats? Can you spot the mistake? ACL Presidents 2009–2017
  • 11. Can you spot the mistake? ACL Presidents 2009–2017 Has Jack Lemmon really 
 been ACL president?
  • 12. Can you spot the mistake? ACL Presidents 2009–2017
  • 13. Can you spot the mistake? ACL Presidents 2009–2017 I didn’t spot it three years ago!
  • 15. A biased world? The Matthew/Matilda effect in science Robert K. Merton, Science, 1968 Margaret W. Rossiter, Social Studies of Science, 1993
  • 16. A biased world? The Matthew/Matilda effect in science Robert K. Merton, Science, 1968 Margaret W. Rossiter, Social Studies of Science, 1993 Nepotism and sexism in peer-review Christine Wennerås and Agnes Wold, Nature, 1997
  • 17. A biased world? The Matthew/Matilda effect in science Robert K. Merton, Science, 1968 Margaret W. Rossiter, Social Studies of Science, 1993 Nepotism and sexism in peer-review Christine Wennerås and Agnes Wold, Nature, 1997 Awards and prizes in the US, 1990s and 2000s Anne E. Lincoln, Stephanie Pincus, Janet Bandows Koster 
 and Phoebe S. Leboy, Social Studies of Science, 2012
  • 18. A biased world? The Matthew/Matilda effect in science Robert K. Merton, Science, 1968 Margaret W. Rossiter, Social Studies of Science, 1993 Nepotism and sexism in peer-review Christine Wennerås and Agnes Wold, Nature, 1997 Awards and prizes in the US, 1990s and 2000s Anne E. Lincoln, Stephanie Pincus, Janet Bandows Koster 
 and Phoebe S. Leboy, Social Studies of Science, 2012 Nationality, ethnicity, religion, gender, sexual orientation, …
  • 19. Why does it matter?
  • 20. Why does it matter? Equity “The acceptance or rejection of claims entering the lists of science is not to depend on the personal or social attributes of their protagonist; […] race, nationality, religion, class, and personal qualities are as such irrelevant.” Robert K. Merton. Science and Technology in a Democratic Order. 
 Journal of Legal and Political Sociology, 1: 115–126, 1942.
  • 21. Why does it matter? Equity “The acceptance or rejection of claims entering the lists of science is not to depend on the personal or social attributes of their protagonist; […] race, nationality, religion, class, and personal qualities are as such irrelevant.” Diversity “Decades of research by organizational scientists, psychologists, sociologists, economists and demographers show that socially diverse groups (that is, those with a diversity of race, ethnicity, gender and sexual orientation) are more innovative than homogeneous groups.” Robert K. Merton. Science and Technology in a Democratic Order. 
 Journal of Legal and Political Sociology, 1: 115–126, 1942. Katherine W. Phillips. How Diversity Makes Us Smarter. 
 Scientific American, October 1, 2014.
  • 22. What is ACL doing?
  • 23. What is ACL doing? A new nominating committee
  • 24. What is ACL doing? Revised selection criteria for ACL fellows A new nominating committee
  • 25. What is ACL doing? Revised selection criteria for ACL fellows Promoting a large and diverse pool of nominations A new nominating committee
  • 26. What is ACL doing? Revised selection criteria for ACL fellows Promoting a large and diverse pool of nominations Resources for promoting diversity and preventing bias A new nominating committee
  • 33. CL TACL ACL NAACL EMNLP 264 182 328 3926 • We like conferences The ACL Publishing Model
  • 34. • We like conferences • We use anonymous peer review (almost everywhere) The ACL Publishing Model
  • 35. • We like conferences • We use anonymous peer review (almost everywhere) • And then there is this thing called arXiv … The ACL Publishing Model
  • 37. Peer review • First used by PhilosophicalTransactions of the Royal Society, London, 1665 • Standard in scientific journals from the mid-20th century • Meant to guarantee scientific quality – “organized scepticism”
  • 38. Peer review • First used by PhilosophicalTransactions of the Royal Society, London, 1665 • Standard in scientific journals from the mid-20th century • Meant to guarantee scientific quality – “organized scepticism” Double-blind peer review • Popularized by sociology journals in the 1950s • Less common in natural sciences and engineering • Meant to reduce author bias – the Matthew/Matilda effect
  • 40. Odds multipliers from double-blind to single-blind review: • Famous authors: 1.66 • Top universities: 1.61 • Top companies: 2.10
  • 41. • 701 reviewers participated in a survey in June 2017 • 30% claimed they could identify the authors of a paper • 17% contributed 196 unique guesses Exact Partial Institution Incorrect Aurélie Névéol Karën Fort EMNLP 2017 Reviewer Survey on Double-Blind Reviewing Report available at: 
 https://www.aclweb.org/portal/ 41%16%38%5% Rebecca Hwa
  • 43. 0 300 600 900 1200 1500 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 ACL submissions Are we overusing peer review? • Increased volumes lead to reviewer fatigue and lower quality • Conferences lose their role as a discussion forum for new ideas • Scientific gatekeeping should be left to journals?
  • 44. Are we overusing peer review? • Increased volumes lead to reviewer fatigue and lower quality • Conferences lose their role as a discussion forum for new ideas • Scientific gatekeeping should be left to journals? Ideas to consider • Prescreening to reduce reviewer load (and increase quality) • Journal-style reviewing with rolling deadline for long papers • Abstract submission for short papers/posters
  • 45. Are we overusing peer review? • Increased volumes lead to reviewer fatigue and lower quality • Conferences lose their role as a discussion forum for new ideas • Scientific gatekeeping should be left to journals? Ideas to consider • Prescreening to reduce reviewer load (and increase quality) • Journal-style reviewing with rolling deadline for long papers • Abstract submission for short papers/posters How to combine our model with preprints on arXiv?
  • 47. FAST Speeds up scientific advances? Threatens scholarly thoroughness?
  • 48. OPEN Anyone can publish, anyone can read and discuss Papers can be revised with version control
  • 49. PEER REVIEW Openness undermines double-blind review Should preprints be cited in peer reviewed work?
  • 50. ACL Survey on Preprint Publishing and Reviewing • Run during three weeks in June 2017 • 623 complete responses • Full report available at: https://www.aclweb.org/portal/ Jennifer Foster Marti Hearst Shiqi Zhao
  • 51. 22% upload to preprint servers always or often • More likely user: graduate student, male • Less likely user: academic researcher, female 27% cite preprints often or very often • Frequent users are more likely to cite often ACL Survey on Preprint Publishing and Reviewing Do you upload preprints? Do you cite preprints? Never Seldom Sometimes Often Always 8%14%25%19%34% 11%16%27%30%15%
  • 52. 88% consider double-blind reviewing important • 65% consider it more important than preprint publishing • 9% consider preprint publishing more important ACL Survey on Preprint Publishing and Reviewing Which is more important? Double-blind Both Preprint Neither 9%65% 23%
  • 53. 87% would submit to ACL if preprints were banned • 5% would probably stop submitting to ACL ACL Survey on Preprint Publishing and Reviewing Would you still submit? Definitely yes Probably yes Maybe Probably not Definitely not 70% 17% 8% 4%
  • 54. ACL Survey on Preprint Publishing and Reviewing 0 75 150 225 300 No reviewing Open reviewing Single-blind reviewing Status quo Discourage preprints Ban preprints How would you like to see ACL’s reviewing model working in the future?
  • 55. ACL Survey on Preprint Publishing and Reviewing 0 90 180 270 360 Lobby preprint servers to allow papers to be anonymously uploaded Make available author guidelines for citing preprint papers Have a separate track at ACL for preprint papers Journal-style reviewing with a rolling deadline (with CL and/or TACL) The following are some actions suggested by members of the community. 
 Please indicate which, if any, you would like to see implemented.
  • 57. Conclusions – Survey • Strong support for double-blind reviewing in community
  • 58. Conclusions – Survey • Strong support for double-blind reviewing in community • Weak support for completely banning preprints
  • 59. Conclusions – Survey • Strong support for double-blind reviewing in community • Weak support for completely banning preprints • Temporarily anonymous preprints is worth looking into
  • 60. Conclusions – Survey • Strong support for double-blind reviewing in community • Weak support for completely banning preprints • Temporarily anonymous preprints is worth looking into • Guidelines for citing preprints are needed
  • 61. Conclusions – Survey • Strong support for double-blind reviewing in community • Weak support for completely banning preprints • Temporarily anonymous preprints is worth looking into • Guidelines for citing preprints are needed • Many are concerned about reviewing quality
  • 62. Conclusions – Survey • Strong support for double-blind reviewing in community • Weak support for completely banning preprints • Temporarily anonymous preprints is worth looking into • Guidelines for citing preprints are needed • Many are concerned about reviewing quality • We have to work both long-term and short-term
  • 63. • More detailed analysis of the survey • Invited quick-fire position statements • Open discussion about publishing and reviewing ACL Business Meeting Wednesday, August 2, 13:00-14:30
  • 65. Good Science 92 93 94 95 96 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 UAS on WSJ
  • 66. Good Science 92 93 94 95 96 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 UAS on WSJ “Measurement as a virtue in itself”
  • 67. Good Science “Lots of numbers with very small differences” 92 93 94 95 96 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 UAS on WSJ “Measurement as a virtue in itself”
  • 68. Good Science “Lots of numbers with very small differences” “What are the research questions?” 92 93 94 95 96 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 UAS on WSJ “Measurement as a virtue in itself”
  • 70. Experimental Science • Experiments are run to test hypotheses
  • 71. Experimental Science • Experiments are run to test hypotheses • Hypotheses are tentative theoretical explanations morphological segmentation facilitates syntactic parsing system A outperforms system B on data set C
  • 72. Experimental Science • Experiments are run to test hypotheses • Hypotheses are tentative theoretical explanations morphological segmentation facilitates syntactic parsing system A outperforms system B on data set C • Validating hypotheses requires repeated testing
  • 74. Replicability • Repeating the same experiment with the same result • Necessary to establish the reliability of measurements • Enables benchmarking and “fair” comparisons – fast science Reproducible Science
  • 75. Replicability • Repeating the same experiment with the same result • Necessary to establish the reliability of measurements • Enables benchmarking and “fair” comparisons – fast science Reproducibility • Repeating a similar experiment with a similar result • Necessary to establish the validity of hypotheses • Requires repeated testing and comparative analysis – slow science Reproducible Science
  • 76. Replicability • Repeating the same experiment with the same result • Necessary to establish the reliability of measurements • Enables benchmarking and “fair” comparisons – fast science Reproducibility • Repeating a similar experiment with a similar result • Necessary to establish the validity of hypotheses • Requires repeated testing and comparative analysis – slow science Reproducible Science We need both!
  • 77. Replicability • Repeating the same experiment with the same result • Necessary to establish the reliability of measurements • Enables benchmarking and “fair” comparisons – fast science Reproducibility • Repeating a similar experiment with a similar result • Necessary to establish the validity of hypotheses • Requires repeated testing and comparative analysis – slow science Reproducible Science We need both! We need diversity!
  • 79. Everything is connected … Publishing and reviewing • Our traditional publishing model has a bias towards fast science • Reinforced by increasing reviewer loads • Accelerated by preprint publishing
  • 80. Everything is connected … Publishing and reviewing • Our traditional publishing model has a bias towards fast science • Reinforced by increasing reviewer loads • Accelerated by preprint publishing Equity and diversity • We need diversity and innovation in research and publishing • A more inclusive and diverse community is more likely to give us that
  • 82. Keep up the good work!