www.efquel.org
Learning from Peers
An introduction to peer-review
Anthony F. Camilleri 13th June 2013 – VISIR Session – The Joy
of Learning EDEN Conference - OSLO
www.efquel.org
What‘s in a Name?
Audit Expert-Review
Objective Subjective
Precise standards Broad guidelines
Verifies account of client Interprets account of client
Requires detailed knowledge of
administrative procedures
Requires detailed knowledge of the
subject area concerned
standards-based
review
www.efquel.org
Who is a peer?
• an expert in the field
• an expert in what field?
• e-learning!
• what is e-learning?
www.efquel.org
Features of an Expert-Peer
experience in
course design and delivery
familiar with
best-practice
comparative perspective
sense of mission
natural communicator
www.efquel.org
A reviewer is a communicator
University
AgencyReview Team
www.efquel.org
Inter-subjectivity
• different subjective perceptions, taken from
different viewpoints, give an objective
view of reality
• the quality basis of an external review
• requires consensus
consensus is not a diplomatic nicety
but an essential pre-requisite of quality
www.efquel.org
Learning from
self-assessment
www.efquel.org
There is no such thing
as objective quality
www.efquel.org
How to learn from self-
assessment
1. Read the quality standard
2. Understand the quality standard
3. Ask Questions
4. DO NOT fill it in
5. Discuss it – with all stakeholders in the institution
a. How do we meet the standard?
b. What can we do better?
c. Does it apply in all areas?
6. Discuss it some more – do some implementation
7. Have you internalised standard?
8. Now fill in the questionnaire
www.efquel.org
A look at the Quality Cycle
• Do• Check
• Plan• Act
アク
ション
計画
実行
チェッ
ク
CHECK should be read as STUDY
in English Check implies ‚to hold back‘
(Deming, 1980)
www.efquel.org
A Need to Prioritise
• Do• Check
• Plan• Act
アク
ション
計画
実行
チェッ
ク
www.efquel.org
Be Honest
„Most Quality Managers are Magicians―
Look Here
don‘t look here!
www.efquel.org
What will self-assessment
produce
• A time to think, communicate and strategize
• A better understanding of institutional
processes
• An overview of where we are and hopefully
where we need to go
• A report
www.efquel.org
Learning from
peer-review
www.efquel.org
The
Show-Off
The
Politician
The
Grumpy
The
Bored
Don’t be one of these people….
www.efquel.org
How to approach a peer-review
• Understand the purpose of the review
• Understand your role in the review
– Your impressions
– Of your part in the instituion
• Be candid and informative
• Don’t try to hide things (you’ll be caught)
www.efquel.org
Main result of peer-review
an external evaluation of your
institutional quality (procedures)
a report
a certificate
www.efquel.org
Run the cycle again
• Do• Check
• Plan• Act
アク
ション
計画
実行
チェッ
ク
www.efquel.org
Remember
NO process is without
errors
There is ALWAYS room
for improvement
www.efquel.org
What to do with the report
1. Read the report
2. Understand the report
3. Ask Questions
4. Discuss it – with all stakeholders in the institution
a. What did we miss in our Self-Assessment?
b. Have our assumptions been confirmed or refuted?
c. How can we do it better
5. Discuss it some more – do some implementation
6. Have you internalised the recommendations?
7. Now start the cycle again.
www.efquel.org
THANK-YOU
for your attention
Feedback is welcome!
Released under a Creative Commons
Attribution ShareAlike 3.0 Belgium License
You are free:
• to Share — to copy, distribute and transmit
the work
• to Remix — to adapt the work
Under the following conditions:
Attribution — You must attribute the work in the
manner specified by the author or licensor (but
not in any way that suggests that they endorse
you or your use of the work).
Share Alike — If you alter, transform, or build
upon this work, you may distribute the resulting
work only under the same or similar license to
this one.
13th June 2013 – VISIR Session – The Joy of Learning EDEN
Conference - OSLO
www.efquel.org
„Learning from Peers: An introduction to peer review“
Anthony F. Camilleri
anthony@camilleri.com
http://www.slideshare.net/anthonycamilleri/

Learning from peers - an introduction to peer review

  • 1.
    www.efquel.org Learning from Peers Anintroduction to peer-review Anthony F. Camilleri 13th June 2013 – VISIR Session – The Joy of Learning EDEN Conference - OSLO
  • 2.
    www.efquel.org What‘s in aName? Audit Expert-Review Objective Subjective Precise standards Broad guidelines Verifies account of client Interprets account of client Requires detailed knowledge of administrative procedures Requires detailed knowledge of the subject area concerned standards-based review
  • 3.
    www.efquel.org Who is apeer? • an expert in the field • an expert in what field? • e-learning! • what is e-learning?
  • 4.
    www.efquel.org Features of anExpert-Peer experience in course design and delivery familiar with best-practice comparative perspective sense of mission natural communicator
  • 5.
    www.efquel.org A reviewer isa communicator University AgencyReview Team
  • 6.
    www.efquel.org Inter-subjectivity • different subjectiveperceptions, taken from different viewpoints, give an objective view of reality • the quality basis of an external review • requires consensus consensus is not a diplomatic nicety but an essential pre-requisite of quality
  • 7.
  • 8.
    www.efquel.org There is nosuch thing as objective quality
  • 9.
    www.efquel.org How to learnfrom self- assessment 1. Read the quality standard 2. Understand the quality standard 3. Ask Questions 4. DO NOT fill it in 5. Discuss it – with all stakeholders in the institution a. How do we meet the standard? b. What can we do better? c. Does it apply in all areas? 6. Discuss it some more – do some implementation 7. Have you internalised standard? 8. Now fill in the questionnaire
  • 10.
    www.efquel.org A look atthe Quality Cycle • Do• Check • Plan• Act アク ション 計画 実行 チェッ ク CHECK should be read as STUDY in English Check implies ‚to hold back‘ (Deming, 1980)
  • 11.
    www.efquel.org A Need toPrioritise • Do• Check • Plan• Act アク ション 計画 実行 チェッ ク
  • 12.
    www.efquel.org Be Honest „Most QualityManagers are Magicians― Look Here don‘t look here!
  • 13.
    www.efquel.org What will self-assessment produce •A time to think, communicate and strategize • A better understanding of institutional processes • An overview of where we are and hopefully where we need to go • A report
  • 14.
  • 15.
  • 16.
    www.efquel.org How to approacha peer-review • Understand the purpose of the review • Understand your role in the review – Your impressions – Of your part in the instituion • Be candid and informative • Don’t try to hide things (you’ll be caught)
  • 17.
    www.efquel.org Main result ofpeer-review an external evaluation of your institutional quality (procedures) a report a certificate
  • 18.
    www.efquel.org Run the cycleagain • Do• Check • Plan• Act アク ション 計画 実行 チェッ ク
  • 19.
    www.efquel.org Remember NO process iswithout errors There is ALWAYS room for improvement
  • 20.
    www.efquel.org What to dowith the report 1. Read the report 2. Understand the report 3. Ask Questions 4. Discuss it – with all stakeholders in the institution a. What did we miss in our Self-Assessment? b. Have our assumptions been confirmed or refuted? c. How can we do it better 5. Discuss it some more – do some implementation 6. Have you internalised the recommendations? 7. Now start the cycle again.
  • 21.
    www.efquel.org THANK-YOU for your attention Feedbackis welcome! Released under a Creative Commons Attribution ShareAlike 3.0 Belgium License You are free: • to Share — to copy, distribute and transmit the work • to Remix — to adapt the work Under the following conditions: Attribution — You must attribute the work in the manner specified by the author or licensor (but not in any way that suggests that they endorse you or your use of the work). Share Alike — If you alter, transform, or build upon this work, you may distribute the resulting work only under the same or similar license to this one. 13th June 2013 – VISIR Session – The Joy of Learning EDEN Conference - OSLO www.efquel.org „Learning from Peers: An introduction to peer review“ Anthony F. Camilleri anthony@camilleri.com http://www.slideshare.net/anthonycamilleri/