Online Peer-Review  ... of e-learning programmes                         ECB-Check Training  Anthony F. Camilleri         ...
What‘s in a Name?                  Audit                                      Expert-Review                 Objective     ...
Who is a peer?• an expert in the field• an expert in what field?• e-learning!• what is e-learning?www.efquel.org
Features of an Expert-Peer                            familiar with                            best-practice      experien...
Inter-subjectivity      • different subjective perceptions, taken from        different viewpoints, give an objective     ...
Communicating with the institutionCommunication starts         with self-assessment! • This is not a one-way exercise!    ...
Conducting a Review     Familiarise yourself with the standards1. Understand which standard covers which area (sometimes  ...
Inspect the Course     „Most Quality Managers are Magicians―Look Herewww.efquel.org   don‘t look here!
Inspect the Course• Log onto the LMS• Look through every part of the course:     – Lessons     – Help-pages     – Tests   ...
Fill in your Forms• Your forms are a letter to the agency         COMMUNICATE!www.efquel.org
Communicating with the agency   „I dont know anything about     art, but I know what I like―                         Gelet...
Communicating with the agency   „I dont know anything about     the standards, but I know       quality when I see it―    ...
Communicating with the agencyStandards of Proof•   Some credible evidence•   Preponderance of evidence•   Clear and convin...
Communicating with the agencyIn your Report• Be yourselfBad: The institution showed....Good: The review team saw / found /...
Communicating with the agencyIn your Report• Be specificGood: The institution showed....Better: The review team found mult...
Communicating with the agencyIn your Report• Say what you knowBad: The institution lied....Good: The review team foundinco...
Communicating with the agencyIn your Report• Give your opinion (where relevant)Bad: The institution is... / or NOTHINGGood...
Communicating with the agencyIn your Report• Give your reasoningBad: There is no quality.Good: When we consider (X), (Y) a...
Communicating with the agencyIn your Report• Be CLEARBad: The structure of the LMS is in need ofimprovement.Good: The LMS ...
Communicating with the agencyIn your Report• Link Effect with CauseBad: Quality systems are in place, but thereis no evide...
One last thing                       Remember that                 Quality Labels should act as                     Qualit...
Hvala!         Thank-you for your attention                                                                   Questions?  ...
Upcoming SlideShare
Loading in …5
×

Online Peer Review of e-Learning Programmes

957 views

Published on

The presentation considers (a) general principles of peer-review, (b) remote peer-review of e-learning programmes.
The presentation was created for an ITC/ILO training on the ecbcheck (http://ecbcheck.efquel.org) quality label, at its campus in Torino, 28.09.2012

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
957
On SlideShare
0
From Embeds
0
Number of Embeds
131
Actions
Shares
0
Downloads
11
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Online Peer Review of e-Learning Programmes

  1. 1. Online Peer-Review ... of e-learning programmes ECB-Check Training Anthony F. Camilleri ITC/ILO Turin – 28.09.2012www.efquel.org
  2. 2. What‘s in a Name? Audit Expert-Review Objective Subjective Precise standards Broad guidelines Verifies account of client Interprets account of client Requires detailed knowledge of Requires detailed knowledge of the administrative procedures subject area concerned standards-based reviewwww.efquel.org
  3. 3. Who is a peer?• an expert in the field• an expert in what field?• e-learning!• what is e-learning?www.efquel.org
  4. 4. Features of an Expert-Peer familiar with best-practice experience incourse design and delivery natural communicator sense of mission comparative perspectivewww.efquel.org
  5. 5. Inter-subjectivity • different subjective perceptions, taken from different viewpoints, give an objective view of reality • the quality basis of an external review • requires consensus consensus is not a diplomatic nicety but an essential pre-requisite of qualitywww.efquel.org
  6. 6. Communicating with the institutionCommunication starts with self-assessment! • This is not a one-way exercise! – Has the institution given enough information to allow a successful review? – What don‘t you understand, and who can answer your questions? • Be active in schedule-designwww.efquel.org
  7. 7. Conducting a Review Familiarise yourself with the standards1. Understand which standard covers which area (sometimes they can overlap).2. Understand their relation to each other.3. Make sure you have a vision of successful and non- successful completion of each standard – based on comparative experiencewww.efquel.org
  8. 8. Inspect the Course „Most Quality Managers are Magicians―Look Herewww.efquel.org don‘t look here!
  9. 9. Inspect the Course• Log onto the LMS• Look through every part of the course: – Lessons – Help-pages – Tests – Forums / support pages – Interactive material – What else?www.efquel.org
  10. 10. Fill in your Forms• Your forms are a letter to the agency COMMUNICATE!www.efquel.org
  11. 11. Communicating with the agency „I dont know anything about art, but I know what I like― Gelett Burgesswww.efquel.org
  12. 12. Communicating with the agency „I dont know anything about the standards, but I know quality when I see it― Unnamed reviewerwww.efquel.org
  13. 13. Communicating with the agencyStandards of Proof• Some credible evidence• Preponderance of evidence• Clear and convincing evidence• Beyond reasonable doubtwww.efquel.org
  14. 14. Communicating with the agencyIn your Report• Be yourselfBad: The institution showed....Good: The review team saw / found /observed....www.efquel.org
  15. 15. Communicating with the agencyIn your Report• Be specificGood: The institution showed....Better: The review team found multiple andconsistent examples ofwww.efquel.org
  16. 16. Communicating with the agencyIn your Report• Say what you knowBad: The institution lied....Good: The review team foundinconsistencies between evidence (x) andinterview (y)www.efquel.org
  17. 17. Communicating with the agencyIn your Report• Give your opinion (where relevant)Bad: The institution is... / or NOTHINGGood: We suspect, It seems likely that,Given the evidence available, etc...www.efquel.org
  18. 18. Communicating with the agencyIn your Report• Give your reasoningBad: There is no quality.Good: When we consider (X), (Y) and (Z),we find it impossible to say there is qualitywww.efquel.org
  19. 19. Communicating with the agencyIn your Report• Be CLEARBad: The structure of the LMS is in need ofimprovement.Good: The LMS barely functions – it is litteredwith wrong links, the help-function is unusableand most sections still need to be populatedwww.efquel.org
  20. 20. Communicating with the agencyIn your Report• Link Effect with CauseBad: Quality systems are in place, but thereis no evidence of iterative improvement.Good: Quality systems are not effective, dueto lack of iterative improvement procedures.www.efquel.org
  21. 21. One last thing Remember that Quality Labels should act as Quality-Enhancers not only transparency toolsoffer a path towards quality improvementwww.efquel.org
  22. 22. Hvala! Thank-you for your attention Questions? Anthony F. Camilleri (anthony@kic-malta.com) Presentation available from: http://www.slideshare.net/anthonycamilleri/Released under a Creative Commons Under the following conditions:Attribution ShareAlike 3.0 Slovenia License Attribution — You must attribute the work in the manner specified by the author or licensor (butYou are free: not in any way that suggests that they endorse• to Share — to copy, distribute and transmit you or your use of the work). the work Share Alike — If you alter, transform, or build• to Remix — to adapt the work upon this work, you may distribute the resulting work only under the same or similar license to this one. www.efquel.org

×