Peerwise - Paul Denny - Edinburgh 2011 (part 1)

1,355 views
1,230 views

Published on

Part 1 of Paul Denny's presentation at the LTKB workshop, Edinburgh 2011. PeerWise is a web-based repository of MCQs built by students. Students are given the responsibility of creating and moderating the resource. By leveraging the creativity and energy of a class, a large, diverse and rich resource can result.

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,355
On SlideShare
0
From Embeds
0
Number of Embeds
8
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Peerwise - Paul Denny - Edinburgh 2011 (part 1)

  1. 1. University of EdinburghPeer Feedback and Assessment for Science and Engineering17th December, 2010 PeerWise familiarity breeds content student-authored questions using PeerWise Paul Denny Department of Computer Science The University of Auckland New Zealand
  2. 2. Goals• What is PeerWise? – Motivations• Demonstration• Examples of use – Auckland – Otago – Edinburgh
  3. 3. What is PeerWise?• Web-based MCQ repository built by students simple, student-driven
  4. 4. Motivations Student familiarity with Web 2.0 The energy and Student generatedcreativity of a large class questions
  5. 5. Large classes• A powerful resource ENGGEN 131, 10am Stream Semester Two, 2009
  6. 6. Student familiarity with Web 2.0• Characteristics – user-generated content – contributions by many users – techniques for content discovery
  7. 7. Student generated questions• Not a unique idea: – Balajthy (1984), Yu et al. (2002), Fellenz (2004), Barak and Rafaeli (2004), Chang et al. (2005), Horgen (2007), ....
  8. 8. What is PeerWise?• Web-based MCQ repository built by students• Students: – develop new questions with associated explanations – answer existing questions and rate them for quality and difficulty – take part in discussions
  9. 9. What is PeerWise?• Reputation score, leader-boards and badges…
  10. 10. What is PeerWise?
  11. 11. PeerWise• Demonstration
  12. 12. Examples of use• The University of Auckland• University of Otago• The University of Edinburgh
  13. 13. Auckland• COMPSCI 101, Semester 1, 2007• n = 460– 2% participation bonus– 1 question, 10 answer requirement
  14. 14. Auckland• Daily usage
  15. 15. Auckland• Daily usage participation deadline
  16. 16. Auckland• Daily usage 57% participation deadline final exam
  17. 17. Otago• Biology courses: – CELS191 (Semester 1) – HUBS191 (Semester 1) – HUBS192 (Semester 2)• Very large classes• Student participation was voluntary
  18. 18. Otago• Half the class was active, few authors, many answerers CELS 191 HUBS 191 HUBS 192
  19. 19. Otago CELS 191 HUBS 191 HUBS 192 TOTALStudents 2146 2021 1738 -enrolledNumber of 114 89 81 -authorsNumber of 1159 974 802 -answerersNumber ofquestionsNumber ofanswersAvg. answers -per student
  20. 20. Otago CELS 191 HUBS 191 HUBS 192 TOTALStudents 2146 2021 1738 -enrolledNumber of 114 89 81 -authorsNumber of 1159 974 802 -answerersNumber of 753 702 895 2350questionsNumber ofanswersAvg. answers -per student
  21. 21. Otago CELS 191 HUBS 191 HUBS 192 TOTALStudents 2146 2021 1738 -enrolledNumber of 114 89 81 -authorsNumber of 1159 974 802 -answerersNumber of 753 702 895 2350questionsNumber of 163761 172289 167594 503644answersAvg. answers -per student
  22. 22. Otago CELS 191 HUBS 191 HUBS 192 TOTALStudents 2146 2021 1738 -enrolledNumber of 114 89 81 -authorsNumber of 1159 974 802 -answerersNumber of 753 702 895 2350questionsNumber of 163761 172289 167594 503644answersAvg. answers 141.3 176.9 209.0 -per student
  23. 23. HUBS 192 Number ofanswers per HUBS 191 day CELS 191
  24. 24. Otago• The top-scorer in CELS 191 was awarded a prize, and sent the following email to teaching staff “PeerWise is a very good learning tool, especially for revision after a lecture. I find that if I can explain the concept, then I have grasped the ideas of the lecture, and if there is something I am struggling to grasp someone will have posted a question which once I have worked my way through, makes the concept clearer. So I am very grateful for the resource.”
  25. 25. Edinburgh
  26. 26. Edinburgh• Physics 1A, Semester 1, 2010• n ~ 200 – 3% participation mark – author 1 question – answer 5 questions – comment on and rate 3 questions
  27. 27. Edinburgh• PeerWise was introduced in workshop sessions in Week 5• Students worked through a structured example task and devised their own questions in groups
  28. 28. Edinburgh
  29. 29. Total:350 questions Workshop Live Due training~3500 answers 30
  30. 30. Uptake towards exam:No additional questions Assessed coursework deadline Exam~170 answers 31
  31. 31. Edinburgh• A few example questions...
  32. 32. Coming up• Your turn...
  33. 33. Thank you• Any questions? – Now – Later Paul Denny paul@cs.auckland.ac.nz Department of Computer Science The University of Auckland PeerWise peerwise.cs.auckland.ac.nz

×