SlideShare a Scribd company logo
1 of 10
{
Open Peer ReviewThe Good, the Bad and the Ugly
What IS “Open”?
 More openness to provide assurance that you did what you said you
would
 Openness to share more, but not all, information about the process
 Open the box to show everything you did
 Open to all to view and participate
There’s not just one “right” approach
One size does not fit all
Before Opening the Box
PROS
 Increased level of trust & transparency
 Reviewers will think more carefully about the research and provide more
attentive, detailed comments
 May expose possible conflicts of interest
 Reduction of antagonistic comments and unsupported criticisms
 Post-publication open review may result in a larger pool of reviewers
 Faster speed to publication
 Reviewers are acknowledged and get credit for their contributions
CONS
 Increased difficulty in finding reviewers (Reality check!)
 Younger scientists may feel it difficult to be completely candid, knowing that the
author they are reviewing may have influence over their future
 Well-known authors could receive preferential treatment
 There may be legal and copyright issues to consider
Pros & Cons of Open Review
I’d like your honest opinion on something…..
 We support validation of all approaches to peer review
 We support sharing additional information around the peer
review process while respecting the need for anonymity
 We support more open approaches, if desired
 We want to help reviewers get credit for the valuable service
they perform
How Can PRE-score Help?
Online Demo
Thank You!
Adam Etkin
aetkin@prescore.org
www.prescore.org
Twitter: @prescore1 and @adametkin
Info about peer review
process:
• COPE member?
• Rounds of review
• Plagiarism screening?
• Roles who participated
Additional Info:
• Reviewer comments
• Reviewer names

More Related Content

Viewers also liked

Introduction to the CTDA
Introduction to the CTDAIntroduction to the CTDA
Introduction to the CTDAGreg Colati
 
1 info line_burmisrov_mebel_2012
1 info line_burmisrov_mebel_20121 info line_burmisrov_mebel_2012
1 info line_burmisrov_mebel_2012Imperiaforum
 
Итоги исследования «Ключевые изменения и проблемы в сфере обращения медицинск...
Итоги исследования «Ключевые изменения и проблемы в сфере обращения медицинск...Итоги исследования «Ключевые изменения и проблемы в сфере обращения медицинск...
Итоги исследования «Ключевые изменения и проблемы в сфере обращения медицинск...Imperiaforum
 
демо обзор компании неокон 1 14 апреля
демо обзор компании неокон 1 14 апрелядемо обзор компании неокон 1 14 апреля
демо обзор компании неокон 1 14 апреляImperiaforum
 
The Connecticut Digital Archive
The Connecticut Digital ArchiveThe Connecticut Digital Archive
The Connecticut Digital ArchiveGreg Colati
 
Рынок Мебели 2013 Исследование от Экспресс Обзор и КВК Империя
Рынок Мебели 2013  Исследование от Экспресс Обзор и КВК ИмперияРынок Мебели 2013  Исследование от Экспресс Обзор и КВК Империя
Рынок Мебели 2013 Исследование от Экспресс Обзор и КВК ИмперияImperiaforum
 
CTDA Services for Academic Institutions
CTDA Services for Academic InstitutionsCTDA Services for Academic Institutions
CTDA Services for Academic InstitutionsGreg Colati
 

Viewers also liked (10)

Introduction to the CTDA
Introduction to the CTDAIntroduction to the CTDA
Introduction to the CTDA
 
1 info line_burmisrov_mebel_2012
1 info line_burmisrov_mebel_20121 info line_burmisrov_mebel_2012
1 info line_burmisrov_mebel_2012
 
Итоги исследования «Ключевые изменения и проблемы в сфере обращения медицинск...
Итоги исследования «Ключевые изменения и проблемы в сфере обращения медицинск...Итоги исследования «Ключевые изменения и проблемы в сфере обращения медицинск...
Итоги исследования «Ключевые изменения и проблемы в сфере обращения медицинск...
 
демо обзор компании неокон 1 14 апреля
демо обзор компании неокон 1 14 апрелядемо обзор компании неокон 1 14 апреля
демо обзор компании неокон 1 14 апреля
 
1 info line_b
1 info line_b1 info line_b
1 info line_b
 
INFOLine2012
INFOLine2012INFOLine2012
INFOLine2012
 
The Connecticut Digital Archive
The Connecticut Digital ArchiveThe Connecticut Digital Archive
The Connecticut Digital Archive
 
Рынок Мебели 2013 Исследование от Экспресс Обзор и КВК Империя
Рынок Мебели 2013  Исследование от Экспресс Обзор и КВК ИмперияРынок Мебели 2013  Исследование от Экспресс Обзор и КВК Империя
Рынок Мебели 2013 Исследование от Экспресс Обзор и КВК Империя
 
CTDA Services for Academic Institutions
CTDA Services for Academic InstitutionsCTDA Services for Academic Institutions
CTDA Services for Academic Institutions
 
Armageddon
ArmageddonArmageddon
Armageddon
 

Similar to Adam Etkin's Open Peer Review Presentation from CSE 2014

Open Peer Review- Benefits and Concerns
Open Peer Review- Benefits and ConcernsOpen Peer Review- Benefits and Concerns
Open Peer Review- Benefits and ConcernsLaurie Goodman
 
The discussion in this module will be focused on the idea of truth. .docx
The discussion in this module will be focused on the idea of truth. .docxThe discussion in this module will be focused on the idea of truth. .docx
The discussion in this module will be focused on the idea of truth. .docxbob8allen25075
 
Judgments and decisions in health care review: how to undertake ethical revie...
Judgments and decisions in health care review: how to undertake ethical revie...Judgments and decisions in health care review: how to undertake ethical revie...
Judgments and decisions in health care review: how to undertake ethical revie...Hugh Davies
 
Critical ReasoningWeek 8 Class 1.docx
Critical ReasoningWeek 8 Class 1.docxCritical ReasoningWeek 8 Class 1.docx
Critical ReasoningWeek 8 Class 1.docxfaithxdunce63732
 
Collaboration in student learning
Collaboration in student learningCollaboration in student learning
Collaboration in student learningGeoff Rebbeck
 
Great presentations
Great presentationsGreat presentations
Great presentationsGraham Jones
 
1 persuasive logic
1 persuasive logic1 persuasive logic
1 persuasive logicspepley
 
Intellectual honesty and research integrity abu saleh
Intellectual honesty and research integrity abu salehIntellectual honesty and research integrity abu saleh
Intellectual honesty and research integrity abu salehAbuSaleh51
 
Fsn ethics panel
Fsn ethics panelFsn ethics panel
Fsn ethics panelRuth Deller
 
How to Review a Manuscript (By Elesvier)
How to Review a Manuscript (By Elesvier)How to Review a Manuscript (By Elesvier)
How to Review a Manuscript (By Elesvier)Atiqa khan
 
2013 corportate culture final
2013 corportate culture final2013 corportate culture final
2013 corportate culture finalChris Boos
 
Thesis Presentation
Thesis PresentationThesis Presentation
Thesis Presentationtklatour
 
[Type here]Analytical Your Analytical theme challenges
[Type here]Analytical Your Analytical theme challenges [Type here]Analytical Your Analytical theme challenges
[Type here]Analytical Your Analytical theme challenges TatianaMajor22
 
Advice to junior researchers: High or low road to success?
Advice to junior researchers: High or low road to success?Advice to junior researchers: High or low road to success?
Advice to junior researchers: High or low road to success?James Coyne
 
Beware Biases: Path to better UX research
Beware Biases: Path to better UX researchBeware Biases: Path to better UX research
Beware Biases: Path to better UX researchHP
 
Gsp hpsds l2_6.3_critical thinking
Gsp hpsds l2_6.3_critical thinkingGsp hpsds l2_6.3_critical thinking
Gsp hpsds l2_6.3_critical thinkingglobalstudypass
 
014-015_May16.pdf (medium quality)
014-015_May16.pdf (medium quality)014-015_May16.pdf (medium quality)
014-015_May16.pdf (medium quality)Alex Clapson
 
Confirmation Bias - May 2016 Professional Social Work magazine article
Confirmation Bias - May 2016 Professional Social Work magazine articleConfirmation Bias - May 2016 Professional Social Work magazine article
Confirmation Bias - May 2016 Professional Social Work magazine articleAlex Clapson
 

Similar to Adam Etkin's Open Peer Review Presentation from CSE 2014 (20)

Open Peer Review- Benefits and Concerns
Open Peer Review- Benefits and ConcernsOpen Peer Review- Benefits and Concerns
Open Peer Review- Benefits and Concerns
 
The discussion in this module will be focused on the idea of truth. .docx
The discussion in this module will be focused on the idea of truth. .docxThe discussion in this module will be focused on the idea of truth. .docx
The discussion in this module will be focused on the idea of truth. .docx
 
Peer review in scholarly journals
Peer review in scholarly journalsPeer review in scholarly journals
Peer review in scholarly journals
 
Judgments and decisions in health care review: how to undertake ethical revie...
Judgments and decisions in health care review: how to undertake ethical revie...Judgments and decisions in health care review: how to undertake ethical revie...
Judgments and decisions in health care review: how to undertake ethical revie...
 
Critical ReasoningWeek 8 Class 1.docx
Critical ReasoningWeek 8 Class 1.docxCritical ReasoningWeek 8 Class 1.docx
Critical ReasoningWeek 8 Class 1.docx
 
Collaboration in student learning
Collaboration in student learningCollaboration in student learning
Collaboration in student learning
 
Great presentations
Great presentationsGreat presentations
Great presentations
 
1 persuasive logic
1 persuasive logic1 persuasive logic
1 persuasive logic
 
Intellectual honesty and research integrity abu saleh
Intellectual honesty and research integrity abu salehIntellectual honesty and research integrity abu saleh
Intellectual honesty and research integrity abu saleh
 
Fsn ethics panel
Fsn ethics panelFsn ethics panel
Fsn ethics panel
 
How to Review a Manuscript (By Elesvier)
How to Review a Manuscript (By Elesvier)How to Review a Manuscript (By Elesvier)
How to Review a Manuscript (By Elesvier)
 
2013 corportate culture final
2013 corportate culture final2013 corportate culture final
2013 corportate culture final
 
Thesis Presentation
Thesis PresentationThesis Presentation
Thesis Presentation
 
[Type here]Analytical Your Analytical theme challenges
[Type here]Analytical Your Analytical theme challenges [Type here]Analytical Your Analytical theme challenges
[Type here]Analytical Your Analytical theme challenges
 
Advice to junior researchers: High or low road to success?
Advice to junior researchers: High or low road to success?Advice to junior researchers: High or low road to success?
Advice to junior researchers: High or low road to success?
 
Beware Biases: Path to better UX research
Beware Biases: Path to better UX researchBeware Biases: Path to better UX research
Beware Biases: Path to better UX research
 
Gsp hpsds l2_6.3_critical thinking
Gsp hpsds l2_6.3_critical thinkingGsp hpsds l2_6.3_critical thinking
Gsp hpsds l2_6.3_critical thinking
 
Evalauting Text
Evalauting TextEvalauting Text
Evalauting Text
 
014-015_May16.pdf (medium quality)
014-015_May16.pdf (medium quality)014-015_May16.pdf (medium quality)
014-015_May16.pdf (medium quality)
 
Confirmation Bias - May 2016 Professional Social Work magazine article
Confirmation Bias - May 2016 Professional Social Work magazine articleConfirmation Bias - May 2016 Professional Social Work magazine article
Confirmation Bias - May 2016 Professional Social Work magazine article
 

Recently uploaded

Cultivation of KODO MILLET . made by Ghanshyam pptx
Cultivation of KODO MILLET . made by Ghanshyam pptxCultivation of KODO MILLET . made by Ghanshyam pptx
Cultivation of KODO MILLET . made by Ghanshyam pptxpradhanghanshyam7136
 
Botany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questionsBotany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questionsSumit Kumar yadav
 
Isotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on IoIsotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on IoSérgio Sacani
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...Sérgio Sacani
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...RohitNehra6
 
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...ssifa0344
 
A relative description on Sonoporation.pdf
A relative description on Sonoporation.pdfA relative description on Sonoporation.pdf
A relative description on Sonoporation.pdfnehabiju2046
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSarthak Sekhar Mondal
 
Raman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral Analysis
Raman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral AnalysisRaman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral Analysis
Raman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral AnalysisDiwakar Mishra
 
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptxSOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptxkessiyaTpeter
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsSérgio Sacani
 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfSumit Kumar yadav
 
Broad bean, Lima Bean, Jack bean, Ullucus.pptx
Broad bean, Lima Bean, Jack bean, Ullucus.pptxBroad bean, Lima Bean, Jack bean, Ullucus.pptx
Broad bean, Lima Bean, Jack bean, Ullucus.pptxjana861314
 
Bentham & Hooker's Classification. along with the merits and demerits of the ...
Bentham & Hooker's Classification. along with the merits and demerits of the ...Bentham & Hooker's Classification. along with the merits and demerits of the ...
Bentham & Hooker's Classification. along with the merits and demerits of the ...Nistarini College, Purulia (W.B) India
 
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service 🪡
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service  🪡CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service  🪡
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service 🪡anilsa9823
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPirithiRaju
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...Sérgio Sacani
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTSérgio Sacani
 

Recently uploaded (20)

Cultivation of KODO MILLET . made by Ghanshyam pptx
Cultivation of KODO MILLET . made by Ghanshyam pptxCultivation of KODO MILLET . made by Ghanshyam pptx
Cultivation of KODO MILLET . made by Ghanshyam pptx
 
Botany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questionsBotany krishna series 2nd semester Only Mcq type questions
Botany krishna series 2nd semester Only Mcq type questions
 
Isotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on IoIsotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on Io
 
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
All-domain Anomaly Resolution Office U.S. Department of Defense (U) Case: “Eg...
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
 
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
 
A relative description on Sonoporation.pdf
A relative description on Sonoporation.pdfA relative description on Sonoporation.pdf
A relative description on Sonoporation.pdf
 
The Philosophy of Science
The Philosophy of ScienceThe Philosophy of Science
The Philosophy of Science
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
 
Raman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral Analysis
Raman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral AnalysisRaman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral Analysis
Raman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral Analysis
 
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptxSOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
SOLUBLE PATTERN RECOGNITION RECEPTORS.pptx
 
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroidsHubble Asteroid Hunter III. Physical properties of newly found asteroids
Hubble Asteroid Hunter III. Physical properties of newly found asteroids
 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdf
 
Broad bean, Lima Bean, Jack bean, Ullucus.pptx
Broad bean, Lima Bean, Jack bean, Ullucus.pptxBroad bean, Lima Bean, Jack bean, Ullucus.pptx
Broad bean, Lima Bean, Jack bean, Ullucus.pptx
 
Bentham & Hooker's Classification. along with the merits and demerits of the ...
Bentham & Hooker's Classification. along with the merits and demerits of the ...Bentham & Hooker's Classification. along with the merits and demerits of the ...
Bentham & Hooker's Classification. along with the merits and demerits of the ...
 
CELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdfCELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdf
 
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service 🪡
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service  🪡CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service  🪡
CALL ON ➥8923113531 🔝Call Girls Kesar Bagh Lucknow best Night Fun service 🪡
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOST
 

Adam Etkin's Open Peer Review Presentation from CSE 2014

  • 1. { Open Peer ReviewThe Good, the Bad and the Ugly
  • 3.  More openness to provide assurance that you did what you said you would  Openness to share more, but not all, information about the process  Open the box to show everything you did  Open to all to view and participate There’s not just one “right” approach One size does not fit all
  • 5. PROS  Increased level of trust & transparency  Reviewers will think more carefully about the research and provide more attentive, detailed comments  May expose possible conflicts of interest  Reduction of antagonistic comments and unsupported criticisms  Post-publication open review may result in a larger pool of reviewers  Faster speed to publication  Reviewers are acknowledged and get credit for their contributions CONS  Increased difficulty in finding reviewers (Reality check!)  Younger scientists may feel it difficult to be completely candid, knowing that the author they are reviewing may have influence over their future  Well-known authors could receive preferential treatment  There may be legal and copyright issues to consider Pros & Cons of Open Review I’d like your honest opinion on something…..
  • 6.  We support validation of all approaches to peer review  We support sharing additional information around the peer review process while respecting the need for anonymity  We support more open approaches, if desired  We want to help reviewers get credit for the valuable service they perform How Can PRE-score Help? Online Demo
  • 8.
  • 9.
  • 10. Info about peer review process: • COPE member? • Rounds of review • Plagiarism screening? • Roles who participated Additional Info: • Reviewer comments • Reviewer names