Open Archives
      Meet
Open Peer Review?
           Simon Buckingham Shum
                   Gary Li
               Know...
Overview

    Just Do It. Then Generify It.
■


    Peer Review Dimensions
■

    ➠ Conversational, Co-Published, Open Pee...
Publishing/Dissemination                     Peer Review
      We have a publication                 We have a QCC
      p...
Peer review dimensions


      anonymous          named


        appointed        open invitation

         author no    ...
Conventional peer review
    All peer review models have +/-
■


    Anonymous, 1-shot peer review
■


    Pros
■

    + a...
A ‘native internet’ peer review model

Private+Public conversational OPR edited
 + co-published with article …
    Reviewe...
Journal of Interactive
 Media in Education
   An Interactive Journal
   for Interactive Media

 www-jime.open.ac.uk

   ji...
JIME’s peer review lifecycle
eJournals: Levels 1-6
Lancaster, F. W. (1985). The Paperless Society Revisited. American Libraries, 16, (8), 553-555



  ...
JIME
    conversational open peer review intrinsic to
■

    journal’s review model: the social contract
    authors encou...
Interactive demonstration of a CD-ROM




Readers can ‘play’
          with the
  construction of a
       painting, as
  ...
Interactive demonstration (Java applet)




     Readers can
     visualize the
   execution of a
   program using
  the J...
Audio-visual slide presentation, walking
 the reader through a system


      The author
  introduces the
      multimedia...
Video data




    The authors
  include video
  clips showing
      their work
       (children
programming a
          r...
JIME
    conversational open peer review intrinsic to
■

    journal’s review model: the social contract
    authors encou...
JIME document user interface
          (generated by D3E from an HTML submission)




Submission
   under
  review
       ...
Author links from text to discussion
linking from
   one review
discussion to
    a relevant
    document
Document-related news updated in
the discussion space
JIME email alert to new review comment
Review process initiated with introductory
email to authors and reviewers
JIME changes…
    …Author’s experience
■


        at least as much feedback as normal
    ■


        typically gain an e...
JIME changes…              (cont/d)
    …Reader’s experience
■

        insight into how to interpret the text (esp.
    ■...
Conversational Open Peer Review?

    Pros
■

        Rigorous, accountable quality control
    ■


        At its best ca...
Overview

    Peer Review Dimensions
■


    Journal of Interactive Media in
■

    Education (JIME)
        Hybrid Open P...
D3E: Digital Document
        Discourse Environment

                     From HTML file ➠ link-rich document-
           ...
D3E Publisher’s Toolkit   (Publisher’s Tab)
D3E Publisher’s Toolkit   (Article Tab)
Server-side: D3E -Phorum architecture
extensive customization of Phorum
www.phorum.org                                Full...
D3E-Phorum from a data-flow point of view.
      The system’s main body separates data storage, manipulation and
         ...
D3E meets an ePrint server


generating a D3E discussion space
    for an archive document…
‘Ubiquitous
       D3E’

   ...discuss
    any web
  document

   e.g. pass it an
  OAI document
   URL + specify
     thr...
Demo: generating a peer review
discussion space for an arXiv document
Adding a comment on an arXiv document
Email confirmation of new review discussion site
Future…

    JIME discourse analyses
■




    D3E-OAi integration?
■


        depth of technical integration?
    ■


  ...
Knowledge Media Institute
PhD on OAI+Peer Review – deadline 31st May
       kmi.open.ac.uk/studentships


  Journal of Int...
26
26
Open Peer Review Meets Open Archives CERN2001
Open Peer Review Meets Open Archives CERN2001
Upcoming SlideShare
Loading in...5
×

Open Peer Review Meets Open Archives CERN2001

1,912

Published on

Open Peer Review Meets Open Archives. Workshop on the Open Archives Initiative (OAi) and Peer Review Journals in Europe , CERN, Centre Européenne pour la Recherche Nucléaire, Geneva, March, 2001

Published in: Technology, Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,912
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
16
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Open Peer Review Meets Open Archives CERN2001

  1. 1. Open Archives Meet Open Peer Review? Simon Buckingham Shum Gary Li Knowledge Media Institute Open University, UK sbs@acm.org, G.Li@open.ac.uk Collaborative work with Tamara Sumner (U. Colorado Boulder, USA) & Mike Wright (Unidata-UCAR,USA) Workshop on The Open Archives Initiative and Peer Review Journals CERN, Geneva, March 2001 <http://documents.cern.ch/OAi/> <http://documents.cern.ch/OAi/>
  2. 2. Overview Just Do It. Then Generify It. ■ Peer Review Dimensions ■ ➠ Conversational, Co-Published, Open Peer Review Journal of Interactive Media in ■ Education (JIME) Digital Document Discourse ■ Environment (D3E) D3Emeets an OAI server… ■ Future... ■
  3. 3. Publishing/Dissemination Peer Review We have a publication We have a QCC problem in HEP. Let’s problem in educ.tech. build a solution. Let’s build a solution. Just Do It Other fields+ arXiv JIME eprint servers… servers… (process + technology) That’s useful! That’s useful! But we don’t know But we don’t know how to do that… how to do that… Then Generify OAMH protocol D3E + It other generic tools for OAI compliant QCC/interpretation/ pub./dissem. tools discourse ? ?
  4. 4. Peer review dimensions anonymous named appointed open invitation author no author right right of reply of reply 1-shot conversation reviewers reviewers on their own interact reviews discarded reviews preserved
  5. 5. Conventional peer review All peer review models have +/- ■ Anonymous, 1-shot peer review ■ Pros ■ + anonymity ➠ honesty + 1-shot job + “stick with what you know…” Cons ■ – anonymity ➠ lack of accountability - – research demonstrates its weaknesses - – typically no author right of reply -
  6. 6. A ‘native internet’ peer review model Private+Public conversational OPR edited + co-published with article … Reviewers assigned and named/ hyperlinked ■ Conversational/argumentation model (web) ■ Private emails to editor if preferred ■ Hybrid 2-step process: private then public ■ ➠ revision, publication + open for further ■ comments Intellectual trace of the article’s history ■
  7. 7. Journal of Interactive Media in Education An Interactive Journal for Interactive Media www-jime.open.ac.uk jime@open.ac.uk
  8. 8. JIME’s peer review lifecycle
  9. 9. eJournals: Levels 1-6 Lancaster, F. W. (1985). The Paperless Society Revisited. American Libraries, 16, (8), 553-555 computers used for print production 1. journal distributed in both print and 2. electronic formats publication design is rooted in print, but 3. articles are developed solely for electronic distribution interaction between authors and readers is 4. possible; publications can evolve as a result of such interactions the inclusion of multimedia content 5. both interactive participation and 6. multimedia capabilities are supported
  10. 10. JIME conversational open peer review intrinsic to ■ journal’s review model: the social contract authors encouraged to back claims about ■ technology with demonstrations/ walkthroughs for readers and reviewers
  11. 11. Interactive demonstration of a CD-ROM Readers can ‘play’ with the construction of a painting, as students were encouraged to do
  12. 12. Interactive demonstration (Java applet) Readers can visualize the execution of a program using the Java applet tested with students
  13. 13. Audio-visual slide presentation, walking the reader through a system The author introduces the multimedia system with a series of slides and commentary (streaming audio)
  14. 14. Video data The authors include video clips showing their work (children programming a robot)
  15. 15. JIME conversational open peer review intrinsic to ■ journal’s review model: the social contract authors encouraged to back claims about ■ technology with demonstrations/ walkthroughs for readers and reviewers articles tightly integrated with reviews in a ■ web document-discussion interface edited review discussions co-published with ■ final article
  16. 16. JIME document user interface (generated by D3E from an HTML submission) Submission under review Peer review PrePrint or comments and Published discussion: tightly integrated + co-published
  17. 17. Author links from text to discussion
  18. 18. linking from one review discussion to a relevant document
  19. 19. Document-related news updated in the discussion space
  20. 20. JIME email alert to new review comment
  21. 21. Review process initiated with introductory email to authors and reviewers
  22. 22. JIME changes… …Author’s experience ■ at least as much feedback as normal ■ typically gain an enormous amount from ■ defending against expert peers sometimes need to be coaxed into ■ responding! …Reviewer’s experience ■ engage in discussions with both authors and ■ reviewers formulate reflective contributions to debates ■ in a timely, professional manner
  23. 23. JIME changes… (cont/d) …Reader’s experience ■ insight into how to interpret the text (esp. ■ students) ‘dissenting voices’ are not silenced ■ …the concept of a ‘Publication’ ■ multimedia ■ hypertext structures possible ■ content can now be distributed across the ■ formal document and the discussion space
  24. 24. Conversational Open Peer Review? Pros ■ Rigorous, accountable quality control ■ At its best can promote interdisciplinary dialogue ■ Reviewers can debate between themselves ■ Works because journal Policies and Practices have ■ evolved with the Technology Cons ■ Both the technology and process are new ■ More resource intensive for authors and reviewers ■ Better for discursive, multidisciplinary fields? ■
  25. 25. Overview Peer Review Dimensions ■ Journal of Interactive Media in ■ Education (JIME) Hybrid Open Peer Review on the web since 1996 ■ Digital Document Discourse ■ Environment (D3E) From an HTML file to interactive discussion ■ document (used to publish JIME) D3E meets OAI ■ Future... ■
  26. 26. D3E: Digital Document Discourse Environment From HTML file ➠ link-rich document- ■ discussion user interface Used in many contexts ■ d3e.open.ac.uk Can be used to set up an eJournal using ■ any peer review model Open source ■ Components: ■ Client-side: Publisher’s Toolkit ■ Java application Server-side: Discussion system ■ - D3E-HyperNews - D3E-Phorum
  27. 27. D3E Publisher’s Toolkit (Publisher’s Tab)
  28. 28. D3E Publisher’s Toolkit (Article Tab)
  29. 29. Server-side: D3E -Phorum architecture extensive customization of Phorum www.phorum.org Full database ■ backend Network Open source ■ Search engine ■ Web server Email in+out Apache/IIS ■ Customizable ■ user interface PHP Module Optional D3E-Phorum ■ moderation Server User profiling ■ Admin. tools ■ MySQL server Email server Other DB server
  30. 30. D3E-Phorum from a data-flow point of view. The system’s main body separates data storage, manipulation and system’ presentation into separate modules. External MySql administration (phpMyAdmin) •Administration •Creation •List User Interface •Read (HTML, SSL) •Post •Search MySql Server External Email External server DBMS DB Data Storage Data manipulation Data presentation
  31. 31. D3E meets an ePrint server generating a D3E discussion space for an archive document…
  32. 32. ‘Ubiquitous D3E’ ...discuss any web document e.g. pass it an OAI document URL + specify thread titles around which to focus comments and discussion
  33. 33. Demo: generating a peer review discussion space for an arXiv document
  34. 34. Adding a comment on an arXiv document
  35. 35. Email confirmation of new review discussion site
  36. 36. Future… JIME discourse analyses ■ D3E-OAi integration? ■ depth of technical integration? ■ organizational models? ■ Scholarly Ontologies project (2001-04) ■ “semantic OAI”… ■ (Quality Metadata; citation semantics; scientometrics)
  37. 37. Knowledge Media Institute PhD on OAI+Peer Review – deadline 31st May kmi.open.ac.uk/studentships Journal of Interactive Media in Education www-jime.open.ac.uk Digital Document Discourse Environment d3e.open.ac.uk (contact me to receive D3E release news) Scholarly Ontologies Project kmi.open.ac.uk/projects/scholonto
  38. 38. 26 26
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×