Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
Assessing e-Portfolios using the  Law of Comparative Judgement Matt Wingfield Managing Director – TAG Developments
Setting the Scene Project eScape <ul><li>Utilised MAPS e-portfolio - enabling teachers to create, deliver, manage and asse...
Setting the Scene Project eScape … .the trace left behind from purposeful activity
Setting the Scene Project eScape <ul><ul><li>Real-time capture of student evidence – progressive storyboard format; </li><...
Assessment vs. Evaluation Comparative Pairs Assessment <ul><li>Teachers and Assessment: </li></ul><ul><ul><li>Teachers are...
Assessment vs. Evaluation Comparative Pairs Assessment <ul><li>What is Comparative Pairs? </li></ul><ul><li>Measuring with...
Assessment vs. Evaluation Comparative Pairs Assessment portfolio A portfolio B TAG has created a web-based comparative pai...
The Comparative Pairs Engine  dynamically  refines the ranking of the student work  through a series of judging rounds. Wh...
<ul><li>UK: </li></ul><ul><ul><li>Continued research by TERU (Apprenticeships, Diplomas, SLTs) </li></ul></ul><ul><ul><li>...
Contact Information & Useful Links Professor Richard Kimbell Director – TERU, Goldsmiths College [email_address] Tel: 0207...
Upcoming SlideShare
Loading in …5
×

Comparative Pairs Assessment and e-Portfolios

2,712 views

Published on

A presentation given by Matt Wingfield from TAG Developments on the use of The Law of Comparative Judgement in the assessment of e-portfolios of student work.

The presentation talks about the use of this approach through the context of Project eScape, a research project lead by Professor Richard Kimbell and Tony Wheeler from TERU at Goldsmiths College, University of London.

Published in: Education, Technology
  • Be the first to comment

  • Be the first to like this

Comparative Pairs Assessment and e-Portfolios

  1. 1. Assessing e-Portfolios using the Law of Comparative Judgement Matt Wingfield Managing Director – TAG Developments
  2. 2. Setting the Scene Project eScape <ul><li>Utilised MAPS e-portfolio - enabling teachers to create, deliver, manage and assess project based controlled assessments of GCSE coursework ; </li></ul><ul><li>Each student is given a portable device (PDA, Fizzbook Spin); </li></ul><ul><li>These devices are connected wirelessly to either a web-based or locally hosted e-portfolio system; </li></ul><ul><li>The students receive instructions on what they should do for each activity directly to their device; </li></ul><ul><li>As each activity is completed, the work, comments and evidence is dynamically captured by the e-portfolio to be viewed by the teacher. </li></ul><ul><li>UK pilot project, Project eScape, run by TERU Goldsmiths College, University of London and funded by the Department for Education; </li></ul>
  3. 3. Setting the Scene Project eScape … .the trace left behind from purposeful activity
  4. 4. Setting the Scene Project eScape <ul><ul><li>Real-time capture of student evidence – progressive storyboard format; </li></ul></ul><ul><ul><li>Ideal for supporting areas that involve project work & Assessment for Learning; </li></ul></ul><ul><ul><li>BUT – how do we assess the work for subjective areas like creativity, team work or problem solving? </li></ul></ul>
  5. 5. Assessment vs. Evaluation Comparative Pairs Assessment <ul><li>Teachers and Assessment: </li></ul><ul><ul><li>Teachers are good at : </li></ul></ul><ul><ul><ul><li>Relative Judgements; </li></ul></ul></ul><ul><ul><ul><li>Ranking work. </li></ul></ul></ul><ul><ul><li>Teachers are not good at : </li></ul></ul><ul><ul><ul><li>Absolute Judgements; </li></ul></ul></ul><ul><ul><ul><li>Scoring. </li></ul></ul></ul><ul><ul><li>This is because it is very difficult not to personalise judgements. </li></ul></ul>
  6. 6. Assessment vs. Evaluation Comparative Pairs Assessment <ul><li>What is Comparative Pairs? </li></ul><ul><li>Measuring without scales; </li></ul><ul><li>Based on Rasch/Thurstone - Law of Comparative Judgement ; </li></ul><ul><li>More recent work from Alastair Pollitt at the University of Cambridge; </li></ul><ul><li>Let’s try Comparative Pairs… </li></ul>
  7. 7. Assessment vs. Evaluation Comparative Pairs Assessment portfolio A portfolio B TAG has created a web-based comparative pairs engine, that facilitates highly accurate paired assessment of e-portfolios for the first time on a national scale!
  8. 8. The Comparative Pairs Engine dynamically refines the ranking of the student work through a series of judging rounds. What emerges is a collective professional consensus of an expert group of judges. Produces a reliability coefficient of 0.95 Assessment vs. Evaluation Comparative Pairs Assessment
  9. 9. <ul><li>UK: </li></ul><ul><ul><li>Continued research by TERU (Apprenticeships, Diplomas, SLTs) </li></ul></ul><ul><ul><li>Bath Spa University & AstraZeneca Science Teaching Trust to support science & technology in Primary schools </li></ul></ul><ul><li>Scotland: </li></ul><ul><ul><li>SQA / LTS for formative assessment to provide continued evidence of capability across transition years (11 – 12 years) </li></ul></ul><ul><li>Ireland: </li></ul><ul><ul><li>Limerick University to support Teacher Training </li></ul></ul><ul><li>Israel: </li></ul><ul><ul><li>ORT - pilot of school-based examinations – esp. practical science </li></ul></ul><ul><li>Western Australia: </li></ul><ul><ul><li>Curriculum Council piloting the school leaving exams in Engineering/LOTE/IT and Physical Education </li></ul></ul>Comparative Pairs Assessment of e-portfolios: where is it being used
  10. 10. Contact Information & Useful Links Professor Richard Kimbell Director – TERU, Goldsmiths College [email_address] Tel: 0207 919 7756 Matt Wingfield Managing Director – TAG Developments [email_address] Tel: 07850 488 502 http://www.gold.ac.uk/teru/ http://www.mapsassessment.com http://www.tagdevelopments.com

×