Is Peer Review Peerless?          Tony Eklof     James Joyce Library   University College Dublin   LIR Annual Seminar 2009
Peer Review• What it is• The peer review process• Why peer review• Criticisms• Peer review in the sciences• Peer review in...
The Frescoes of Domenico Ghirlandaio:A Study in High Renaissance and Early Mannerist Florence
Journal peer review process     Paper is accepted for publication,        Paper to EditorReturned with suggestions for imp...
Double Blind Review• Both authors & referees anonymous• Survey shows it is preferred• Support highest in humanities and  a...
Open Review• Some researchers now post pre-  publication versions on web to invite  feedback before formal submission• Inc...
Why Peer Review?•   Quality control for scholarly information•   Weeds out fraud•   Lessens workload of Editor•   Promotes...
Social TextDuke University Press
Criticisms• Slows up the research process• Time consuming for reviewers• For some manuscripts or proposals it may be  diff...
Nature’s Peer Review Trial• Open Peer Review• 1 June-30 September 2006• Authors of new papers submitted  invited to have p...
Nature’s Open Review• 71 out of 1,369 authors agreed to  display papers for open comment (5%)• Healthy online traffic, but...
Peer Review in Humanities• Applying bibliometric indicators in Arts  can be problematical• Very broad range of subjects• S...
Conclusion• Peer review is a flawed, much criticised  system of insuring academic rigour in  published journal articles• T...
Is peer review peerless? Author: Tony Eklof
Is peer review peerless? Author: Tony Eklof
Is peer review peerless? Author: Tony Eklof
Is peer review peerless? Author: Tony Eklof
Is peer review peerless? Author: Tony Eklof
Is peer review peerless? Author: Tony Eklof
Is peer review peerless? Author: Tony Eklof
Is peer review peerless? Author: Tony Eklof
Is peer review peerless? Author: Tony Eklof
Is peer review peerless? Author: Tony Eklof
Is peer review peerless? Author: Tony Eklof
Is peer review peerless? Author: Tony Eklof
Upcoming SlideShare
Loading in …5
×

Is peer review peerless? Author: Tony Eklof

396 views

Published on

Presentation delivered LIR Annual seminar, 27th March 2009, Dublin, Ireland. 2009-03-27.

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
396
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Is peer review peerless? Author: Tony Eklof

  1. 1. Is Peer Review Peerless? Tony Eklof James Joyce Library University College Dublin LIR Annual Seminar 2009
  2. 2. Peer Review• What it is• The peer review process• Why peer review• Criticisms• Peer review in the sciences• Peer review in the humanities• Conclusions
  3. 3. The Frescoes of Domenico Ghirlandaio:A Study in High Renaissance and Early Mannerist Florence
  4. 4. Journal peer review process Paper is accepted for publication, Paper to EditorReturned with suggestions for improvements, Editor to Experts in Or rejected. subject area (Peers) (resubmitted elsewhere) Peers consider for validity, Significance and originality.
  5. 5. Double Blind Review• Both authors & referees anonymous• Survey shows it is preferred• Support highest in humanities and amongst female authors (reduces bias)• Causes some problems with reviewers ie comparing with earlier works• At odds with the open sharing of information and transparency?
  6. 6. Open Review• Some researchers now post pre- publication versions on web to invite feedback before formal submission• Increasingly reader’s comments and criticisms, particularly for open access journals, add a positive element to the process
  7. 7. Why Peer Review?• Quality control for scholarly information• Weeds out fraud• Lessens workload of Editor• Promotes originality and academic rigour – Mechanism for improvement of manuscripts• Adds a ‘human judgement’ element to the academic process
  8. 8. Social TextDuke University Press
  9. 9. Criticisms• Slows up the research process• Time consuming for reviewers• For some manuscripts or proposals it may be difficult to find experts qualified to review• Bias of reviewer• Arbitrary, secret and subjective!• Researchers can be frustrated by process, valuable time spent on ‘lateral’ research
  10. 10. Nature’s Peer Review Trial• Open Peer Review• 1 June-30 September 2006• Authors of new papers submitted invited to have papers hosted on internet for public comment• Papers simultaneously subjected to standard peer review
  11. 11. Nature’s Open Review• 71 out of 1,369 authors agreed to display papers for open comment (5%)• Healthy online traffic, but did not convert into significant amount of useful comment• Some authors reluctant for fear of ideas being ‘scooped’• Nature to continue to explore open review but not to implement system
  12. 12. Peer Review in Humanities• Applying bibliometric indicators in Arts can be problematical• Very broad range of subjects• Some esoteric and specialised• Interdisciplinary nature• Performing arts difficult to peer review
  13. 13. Conclusion• Peer review is a flawed, much criticised system of insuring academic rigour in published journal articles• There is no better alternative system on offer• System improved by open and or double blind review, and by training for peer reviewers

×