Caa

509 views

Published on

Published in: Education, Technology
  • Be the first to comment

  • Be the first to like this

Caa

  1. 1. WebPA: The Evolution of a Peer Assessment System Nicola Wilkinson Steve Loddington WebPA Project, Loughborough University
  2. 2. The evolution Paper based system Open source version of WebPA 1998 2008 2007 WebPA made open to all at Loughborough University 2005 WebPA project 2006 2002 PASS System Re-write of PASS became WebPA 2004
  3. 3. 1998 Paper based system Open source version of WebPA 1998 2008 2007 WebPA made open to all at Loughborough University 2005 WebPA project 2006 2002 PASS System Re-write of PASS became WebPA 2004 <ul><li>The originates from the Wolfson School </li></ul><ul><li>of Mechanical and Manufacturing Engineering </li></ul><ul><li>Issues were; </li></ul><ul><li>Cumbersome </li></ul><ul><li>Time consuming </li></ul>
  4. 4. 2002 Paper based system Open source version of WebPA 1998 2008 2007 WebPA made open to all at Loughborough University 2005 WebPA project 2006 2002 PASS System Re-write of PASS became WebPA 2004 The Peer ASsessment System (PASS) undergoes the first series of improvements
  5. 5. 2004 Paper based system Open source version of WebPA 1998 2008 2007 WebPA made open to all at Loughborough University 2005 WebPA project 2006 2002 PASS System Re-write of PASS became WebPA 2004 The EEC re -develop the PASS system
  6. 6. 2005 Paper based system Open source version of WebPA 1998 2008 2007 WebPA made open to all at Loughborough University 2005 WebPA project 2006 2002 PASS System Re-write of PASS became WebPA 2004 Initial usage is slow, but then increases almost exponentially in the next 3 years
  7. 7. 2006 Paper based system Open source version of WebPA 1998 2008 2007 WebPA made open to all at Loughborough University 2005 WebPA project 2006 2002 PASS System Re-write of PASS became WebPA 2004 The WebPA project begins after getting funding through the e-Learning Capital JISC fund Project consortia set-up
  8. 8. 2007 Paper based system Open source version of WebPA 1998 2008 2007 WebPA made open to all at Loughborough University 2005 WebPA project 2006 2002 PASS System Re-write of PASS became WebPA 2004 The first open source version is released, followed by two further releases in 2008. Early adopters of the system become known
  9. 9. Usage <ul><li>In over 56% of departments </li></ul><ul><li>Just under 6,000 students </li></ul><ul><li>From one academic tutor in 2005 to over 50 in 2008 </li></ul>
  10. 10. Embedding <ul><li>Departmental and PD training sessions </li></ul><ul><li>New Lecturers Route </li></ul><ul><li>Academic Practice Award </li></ul><ul><li>Word of mouth </li></ul><ul><li>‘ One on one’ training </li></ul>
  11. 11. Open source <ul><li>Over 250 downloads </li></ul><ul><li>In over four intuitions in the UK and one world wide </li></ul>&quot;WebPA is now embedded in our first year and will be for the next five years. Typically 180-200 students will be subjected to.. [WebPA] ..every year.&quot; Dr Bob Cherry Manchester Metropolitan University
  12. 12. Case Study <ul><li>100 students in the 2 nd year </li></ul><ul><li>Groups are made of 4 students, each with a seeded student </li></ul><ul><li>Set real life problems in engineering, through the “Loughborough Teaching Contract” </li></ul><ul><li>Standard assessment through reports and presentations before the self and peer assessment. </li></ul>
  13. 13. Case Study <ul><li>The criteria used are set by the academic tutor </li></ul><ul><li>Research shows that students are more truthful </li></ul>Design a system, component or process using routine design techniques 1 Played little or no real part in this element/ relied on gut feeling 3 Made an average contribution in this respect 5 Methodical logical, unbiased and thorough when deciding the merits of an idea Ability to apply sound design methodology to concept evaluation Searching information using extended library techniques related to design solution 1 Made no effort beyond a simple internet key word search 3 Made an average contribution in this respect 5 Searched a wide variety of sources tenaciously and with success Rate each persons ability in searching for information ILO’s Score range Criteria
  14. 14. Demo
  15. 15. User views Dr Carol Robinson Mathematics Education Centre Loughborough University “ Students are much more satisfied – complaints have most disappeared.” “ Overall, marking is honest and credible” Dr Keith Pond Business School Loughborough University
  16. 16. User views <ul><li>90% felt it was secure system </li></ul><ul><li>82% felt enough help information in WebPA was provided </li></ul>
  17. 17. User views “ Some of the best modules during my Engineering degree were group based modules. The combination of the team working and the peer assessment was a great introduction to working in a team within industry.” Alan Curtis Research Engineer JCB Power Systems Ltd
  18. 18. Continuing to evolve <ul><li>Received a International Learning Impact Award in May 2008 </li></ul><ul><li>A new release is expected in August 2008 </li></ul><ul><li>A growing user community is developing for the UK </li></ul>
  19. 19. Questions

×