SlideShare a Scribd company logo
1 of 8
FEAR AND LOATHING IN
OPEN PEER REVIEW?
JonTennant
No one really knows what it is
• Open identities
• Open reports
• Open participation
• Open interaction
• Open pre-review manuscripts
• Open final-version commenting
• Open platforms
https://f1000research.com/articles/6-588/v1
122
COMPETING
DEFINITIONS
Peer review changed your relationship status
to “It’s complicated.”
https://f1000research.com/articles/6-1151/v1
The debate
1. How can referees receive credit or recognition for their work, and what
form should this take.
2. Should referee reports be published alongside manuscripts.
3. Should referees remain anonymous or have their identities disclosed.
4. Should peer review occur prior or subsequent to the publication process
(i.e., publish then filter).
Fear governs all
• Refusal to perform peer review.
• Appearing confrontational in public.
• Abuse of power dynamics and intimidation.
• Backlash from senior researchers.
• Empowerment of bad actors.
• Marginalisation of those with less power.
• Researchers won’t be honest or critical.
Solutions I
• Built-in accountability processes.
• Transparency by default to level the playing field.
• Assholes gonna asshole, so let’s find ways to deal
with that (e.g., COPE).
• Increase quality through accountability and
identification.
• Attach CC BY license and DOIs to peer reviews –
make them citable.
• Make peer reviews valued and part of permanent
academic records.
https://f1000research.com/articles/6-1151/v1
Solutions II
• Make sure arguments and policies are evidence-
based.
• No, seriously. No evidence, no case.That includes
your anecdata.Take it elsewhere.
• Because we’re not talking about individuals here –
we’re talking about systems comprising millions of
individuals.
• So you have to remain flexible. No one-size fits all.
• Account for social and cultural norms and differences.
https://f1000research.com/articles/6-1151/v1

More Related Content

More from Open Science Fair

OSFair2017 Worksop | Innovative dissemination practices & Altmetrics
OSFair2017 Worksop | Innovative dissemination practices & AltmetricsOSFair2017 Worksop | Innovative dissemination practices & Altmetrics
OSFair2017 Worksop | Innovative dissemination practices & Altmetrics
Open Science Fair
 
OSFair2017 | Barriers to Open Science for junior researchers
OSFair2017 | Barriers to Open Science for junior researchersOSFair2017 | Barriers to Open Science for junior researchers
OSFair2017 | Barriers to Open Science for junior researchers
Open Science Fair
 
OSFair2017 | The role of women in exploring, understanding and archiving the ...
OSFair2017 | The role of women in exploring, understanding and archiving the ...OSFair2017 | The role of women in exploring, understanding and archiving the ...
OSFair2017 | The role of women in exploring, understanding and archiving the ...
Open Science Fair
 

More from Open Science Fair (20)

OSFair2017 Workshop | EOSCpilot governance
OSFair2017 Workshop | EOSCpilot governanceOSFair2017 Workshop | EOSCpilot governance
OSFair2017 Workshop | EOSCpilot governance
 
OSFair2017 Workshop | Brokering services facilitating interoperability and da...
OSFair2017 Workshop | Brokering services facilitating interoperability and da...OSFair2017 Workshop | Brokering services facilitating interoperability and da...
OSFair2017 Workshop | Brokering services facilitating interoperability and da...
 
OSFair2017 Workshop | Service provisioning for excellent sciences
OSFair2017 Workshop | Service provisioning for excellent sciencesOSFair2017 Workshop | Service provisioning for excellent sciences
OSFair2017 Workshop | Service provisioning for excellent sciences
 
OSFair2017 Theatrical Workshop | Are you ready to perform in the rri ecosystem
OSFair2017 Theatrical Workshop | Are you ready to perform in the rri ecosystemOSFair2017 Theatrical Workshop | Are you ready to perform in the rri ecosystem
OSFair2017 Theatrical Workshop | Are you ready to perform in the rri ecosystem
 
OSFair2017 Theatrical Workshop | Nucleus H2020 EU project
OSFair2017 Theatrical Workshop | Nucleus H2020 EU projectOSFair2017 Theatrical Workshop | Nucleus H2020 EU project
OSFair2017 Theatrical Workshop | Nucleus H2020 EU project
 
OSFair2017 Workshop | Open Knowledge Maps, A visual interface to the world's ...
OSFair2017 Workshop | Open Knowledge Maps, A visual interface to the world's ...OSFair2017 Workshop | Open Knowledge Maps, A visual interface to the world's ...
OSFair2017 Workshop | Open Knowledge Maps, A visual interface to the world's ...
 
OSFair2017 Training | Reproducibility in critical care research
OSFair2017 Training | Reproducibility in critical care researchOSFair2017 Training | Reproducibility in critical care research
OSFair2017 Training | Reproducibility in critical care research
 
OSFair2017 Training | Big data and evidence-based medicine in Greece
OSFair2017 Training | Big data and evidence-based medicine in GreeceOSFair2017 Training | Big data and evidence-based medicine in Greece
OSFair2017 Training | Big data and evidence-based medicine in Greece
 
OSFair2017 Training | What is Open Science and why should I care?
OSFair2017 Training | What is Open Science and why should I care?OSFair2017 Training | What is Open Science and why should I care?
OSFair2017 Training | What is Open Science and why should I care?
 
OSFair2017 Training | OpenAIRE monitoring services, EC FP7 & H2020 & other na...
OSFair2017 Training | OpenAIRE monitoring services, EC FP7 & H2020 & other na...OSFair2017 Training | OpenAIRE monitoring services, EC FP7 & H2020 & other na...
OSFair2017 Training | OpenAIRE monitoring services, EC FP7 & H2020 & other na...
 
OSFair2017 Training | Designing & implementing open access, open data & open ...
OSFair2017 Training | Designing & implementing open access, open data & open ...OSFair2017 Training | Designing & implementing open access, open data & open ...
OSFair2017 Training | Designing & implementing open access, open data & open ...
 
OSFair2017 Training | Best practice in Open Science
OSFair2017 Training | Best practice in Open ScienceOSFair2017 Training | Best practice in Open Science
OSFair2017 Training | Best practice in Open Science
 
OSFair2017 Worksop | Innovative dissemination practices & Altmetrics
OSFair2017 Worksop | Innovative dissemination practices & AltmetricsOSFair2017 Worksop | Innovative dissemination practices & Altmetrics
OSFair2017 Worksop | Innovative dissemination practices & Altmetrics
 
OSFair2017 | Barriers to Open Science for junior researchers
OSFair2017 | Barriers to Open Science for junior researchersOSFair2017 | Barriers to Open Science for junior researchers
OSFair2017 | Barriers to Open Science for junior researchers
 
OSFair2017 | The role of women in exploring, understanding and archiving the ...
OSFair2017 | The role of women in exploring, understanding and archiving the ...OSFair2017 | The role of women in exploring, understanding and archiving the ...
OSFair2017 | The role of women in exploring, understanding and archiving the ...
 
OSFair2017 | Open Science: A Global South Perspective
OSFair2017 | Open Science: A Global South PerspectiveOSFair2017 | Open Science: A Global South Perspective
OSFair2017 | Open Science: A Global South Perspective
 
OSFair2017 Workshop overview | The roadmap to better food using ICT and open ...
OSFair2017 Workshop overview | The roadmap to better food using ICT and open ...OSFair2017 Workshop overview | The roadmap to better food using ICT and open ...
OSFair2017 Workshop overview | The roadmap to better food using ICT and open ...
 
OSFair2017 training | Open Science check list for repositories and publishers
OSFair2017 training | Open Science check list for repositories and publishersOSFair2017 training | Open Science check list for repositories and publishers
OSFair2017 training | Open Science check list for repositories and publishers
 
OSFair2017 training | Machine accessibility of Open Access scientific publica...
OSFair2017 training | Machine accessibility of Open Access scientific publica...OSFair2017 training | Machine accessibility of Open Access scientific publica...
OSFair2017 training | Machine accessibility of Open Access scientific publica...
 
OSFair2017 training | Explore, model, analyze and visualize systematic resear...
OSFair2017 training | Explore, model, analyze and visualize systematic resear...OSFair2017 training | Explore, model, analyze and visualize systematic resear...
OSFair2017 training | Explore, model, analyze and visualize systematic resear...
 

Recently uploaded

Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Sérgio Sacani
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learning
levieagacer
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Sérgio Sacani
 
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
Scintica Instrumentation
 
Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.
Silpa
 

Recently uploaded (20)

GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)GBSN - Biochemistry (Unit 1)
GBSN - Biochemistry (Unit 1)
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
 
Use of mutants in understanding seedling development.pptx
Use of mutants in understanding seedling development.pptxUse of mutants in understanding seedling development.pptx
Use of mutants in understanding seedling development.pptx
 
Dr. E. Muralinath_ Blood indices_clinical aspects
Dr. E. Muralinath_ Blood indices_clinical  aspectsDr. E. Muralinath_ Blood indices_clinical  aspects
Dr. E. Muralinath_ Blood indices_clinical aspects
 
Call Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort ServiceCall Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort Service
 
module for grade 9 for distance learning
module for grade 9 for distance learningmodule for grade 9 for distance learning
module for grade 9 for distance learning
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learning
 
Introduction of DNA analysis in Forensic's .pptx
Introduction of DNA analysis in Forensic's .pptxIntroduction of DNA analysis in Forensic's .pptx
Introduction of DNA analysis in Forensic's .pptx
 
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit flypumpkin fruit fly, water melon fruit fly, cucumber fruit fly
pumpkin fruit fly, water melon fruit fly, cucumber fruit fly
 
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
Human & Veterinary Respiratory Physilogy_DR.E.Muralinath_Associate Professor....
 
Velocity and Acceleration PowerPoint.ppt
Velocity and Acceleration PowerPoint.pptVelocity and Acceleration PowerPoint.ppt
Velocity and Acceleration PowerPoint.ppt
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
 
FAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical ScienceFAIRSpectra - Enabling the FAIRification of Analytical Science
FAIRSpectra - Enabling the FAIRification of Analytical Science
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)
 
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
 
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticsPulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
 
Factory Acceptance Test( FAT).pptx .
Factory Acceptance Test( FAT).pptx       .Factory Acceptance Test( FAT).pptx       .
Factory Acceptance Test( FAT).pptx .
 
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
Locating and isolating a gene, FISH, GISH, Chromosome walking and jumping, te...
 
Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.Porella : features, morphology, anatomy, reproduction etc.
Porella : features, morphology, anatomy, reproduction etc.
 
Chemistry 5th semester paper 1st Notes.pdf
Chemistry 5th semester paper 1st Notes.pdfChemistry 5th semester paper 1st Notes.pdf
Chemistry 5th semester paper 1st Notes.pdf
 

OSFair2017 Workshop | Fear and loathing in Open Peer Review

  • 1. FEAR AND LOATHING IN OPEN PEER REVIEW? JonTennant
  • 2. No one really knows what it is • Open identities • Open reports • Open participation • Open interaction • Open pre-review manuscripts • Open final-version commenting • Open platforms https://f1000research.com/articles/6-588/v1 122 COMPETING DEFINITIONS
  • 3. Peer review changed your relationship status to “It’s complicated.” https://f1000research.com/articles/6-1151/v1
  • 4. The debate 1. How can referees receive credit or recognition for their work, and what form should this take. 2. Should referee reports be published alongside manuscripts. 3. Should referees remain anonymous or have their identities disclosed. 4. Should peer review occur prior or subsequent to the publication process (i.e., publish then filter).
  • 5. Fear governs all • Refusal to perform peer review. • Appearing confrontational in public. • Abuse of power dynamics and intimidation. • Backlash from senior researchers. • Empowerment of bad actors. • Marginalisation of those with less power. • Researchers won’t be honest or critical.
  • 6. Solutions I • Built-in accountability processes. • Transparency by default to level the playing field. • Assholes gonna asshole, so let’s find ways to deal with that (e.g., COPE). • Increase quality through accountability and identification. • Attach CC BY license and DOIs to peer reviews – make them citable. • Make peer reviews valued and part of permanent academic records. https://f1000research.com/articles/6-1151/v1
  • 7. Solutions II • Make sure arguments and policies are evidence- based. • No, seriously. No evidence, no case.That includes your anecdata.Take it elsewhere. • Because we’re not talking about individuals here – we’re talking about systems comprising millions of individuals. • So you have to remain flexible. No one-size fits all. • Account for social and cultural norms and differences.