Sloan 2009

1,954 views
1,896 views

Published on

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,954
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Sloan 2009

  1. 1. 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html Using game mechanics and social networking to motivate student contributions to a course Edward F. Gehringer Dept. of Computer Science North Carolina State University Your feedback welcome … http://www4.ncsu.edu/~efg/form.html
  2. 2. Outline <ul><li>The goal: Authentic assessment </li></ul><ul><li>Virtual demo </li></ul><ul><li>Social networking and game mechanics </li></ul><ul><li>Reputation systems </li></ul><ul><li>Summary </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  3. 3. Authentic assessment <ul><li>What is it? </li></ul><ul><li>Why is it hard? </li></ul><ul><li>How can we facilitate it? </li></ul><ul><ul><li>Student-generated content </li></ul></ul><ul><ul><li>Peer review </li></ul></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  4. 4. Student-generated content <ul><li>gets students working together to improve others’ learning experiences, </li></ul><ul><li>helps them learn, by performing tasks that are similar to real-world responsibilities, </li></ul><ul><li>gives them experience in writing their ideas up for an audience of their peers, </li></ul><ul><li>allows each cohort to “stand on the shoulders” of students in earlier classes. </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  5. 5. Outline <ul><li>The goal: Authentic assessment </li></ul><ul><li>Virtual demo </li></ul><ul><li>Social networking and game mechanics </li></ul><ul><li>Reputation systems </li></ul><ul><li>Summary </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  6. 6. “ Virtual” demo <ul><li>Creating an assignment </li></ul><ul><li>Selecting a topic </li></ul><ul><li>Reviewing </li></ul><ul><li>Feedback from author to reviewer </li></ul><ul><li>Teammate review </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  7. 7. Setting up a wiki assignment 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html 10/30/09
  8. 8. Let’s create some teams … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html 10/30/09
  9. 9. Here’s how we import it 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  10. 10. Now there are five teams … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  11. 11. “ Virtual” demo <ul><li>Setting up an assignment </li></ul><ul><li>Selecting a topic </li></ul><ul><li>Reviewing </li></ul><ul><li>Feedback from author to reviewer </li></ul><ul><li>Teammate review </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  12. 12. Selecting a Topic 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  13. 13. “ Virtual” demo <ul><li>Setting up an assignment </li></ul><ul><li>Selecting a topic </li></ul><ul><li>Reviewing </li></ul><ul><li>Feedback from author to reviewer </li></ul><ul><li>Teammate review </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  14. 14. Let’s review a wiki page 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  15. 15. Click on the assignment … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  16. 16. … then on “Others’ work” 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  17. 17. Choose a review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  18. 18. Read the submitted wiki page 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  19. 19. Then fill out the review template 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  20. 20. Save and view the review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  21. 21. “ Virtual” demo <ul><li>Setting up an assignment </li></ul><ul><li>Selecting a topic </li></ul><ul><li>Reviewing </li></ul><ul><li>Feedback from author to reviewer </li></ul><ul><li>Teammate review </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  22. 22. Now the reviewee logs in … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  23. 23. … and views the scores 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  24. 24. Click on “View” to expand review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  25. 25. Notice the link down at the bottom 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  26. 26. Use it to give feedback to the reviewer 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  27. 27. Then the reviewer can view the feedback 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  28. 28. “ Virtual” demo <ul><li>Setting up an assignment </li></ul><ul><li>Selecting a topic </li></ul><ul><li>Reviewing </li></ul><ul><li>Feedback from author to reviewer </li></ul><ul><li>Teammate review </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  29. 29. Review of teammates 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  30. 30. Summary of feedback in Expertiza <ul><li>Reviews </li></ul><ul><li>Feedback to author </li></ul><ul><li>Teammate reviews </li></ul><ul><li>Metareviews ( x reviews y ’s review of z ) </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  31. 31. Instructor report 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  32. 32. Outline <ul><li>The goal: Authentic assessment </li></ul><ul><li>Virtual demo </li></ul><ul><li>Social networking and game mechanics </li></ul><ul><li>Reputation systems </li></ul><ul><li>Summary </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  33. 33. How to motivate students? <ul><li>Runners in a race are motivated by seeing other runners ahead of them. </li></ul><ul><li>Players in online games are motivated to catch the leaders. </li></ul><ul><li>Can we do the same thing in our peer-review system? </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  34. 34. Motivating Students: Achievement System <ul><li>Categories in we can track achievement </li></ul><ul><ul><li>Quality of submitted work </li></ul></ul><ul><ul><li>Quality of reviews </li></ul></ul><ul><ul><li>Helpfulness to authors </li></ul></ul><ul><ul><li>Contribution to team </li></ul></ul><ul><li>These factors make up reputation. </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  35. 35. Recognizing Achievement: Leaderboards <ul><li>Students can list their achievements for all to see. </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  36. 36. Now a new review is entered … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  37. 37. … and the leaders change 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  38. 38. A new metareview is entered … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  39. 39. … and a new leader is recognized 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  40. 40. What we have here is … <ul><li>a social network! </li></ul><ul><ul><li>Connections among many individuals. </li></ul></ul><ul><ul><li>Information contributed from many sources (albeit coerced!) </li></ul></ul><ul><ul><li>Can be used to discover competencies of individuals. </li></ul></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  41. 41. Future work: Message boards for extra credit <ul><li>Student a posts a question </li></ul><ul><li>Student b responds </li></ul><ul><li>Student a rates student b ’s response </li></ul><ul><li>Others can rate response too. </li></ul><ul><ul><li>TAs can also respond </li></ul></ul><ul><li>Prompt reviews/answers are more helpful, so reward for these … </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  42. 42. New Features Coming to Expertiza <ul><li>Levels </li></ul><ul><ul><li>“ Special power”―rearranging messages </li></ul></ul><ul><ul><li>Microtasks/micropayments </li></ul></ul><ul><ul><li>… incentivize useful work </li></ul></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  43. 43. Outline <ul><li>The goal: Authentic assessment </li></ul><ul><li>Virtual demo </li></ul><ul><li>Student-generated content </li></ul><ul><li>Social networking and game mechanics </li></ul><ul><li>Reputation systems </li></ul><ul><li>Summary </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  44. 44. Are the evaluations reliable? <ul><li>Author feedback </li></ul><ul><li>Metareviewing helps. </li></ul><ul><li>Algorithmic strategies </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  45. 45. Algorithmic approaches <ul><li>Strategies use quality and leniency as metrics for assigning grades. </li></ul><ul><li>Quality is dependent on leniency, and vice versa. </li></ul><ul><li>Their approach yields a system of simultaneous equations, which can be solved to yield values for quality. </li></ul><ul><li>Other researchers have devised similar methodologies. </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  46. 46. Other reputation systems <ul><li>What we have seen are “reputation systems” devoted to evaluating required work. </li></ul><ul><li>Other reputation system deal with voluntary work. </li></ul><ul><li>Our hope is to blend the two. </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  47. 47. Outline <ul><li>The goal: Authentic assessment </li></ul><ul><li>Virtual demo </li></ul><ul><li>Student-generated content </li></ul><ul><li>Social networking and game mechanics </li></ul><ul><li>Reputation systems </li></ul><ul><li>Summary </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  48. 48. Summary <ul><li>If students do “real” tasks, authentic assessment is possible. </li></ul><ul><li>Peer assessment provides a scalable approach to authentic assessment. </li></ul><ul><li>Incentives such as leaderboards and micropayments can be used to encourage student contributions. </li></ul><ul><li>A reputation system is needed for quality control. </li></ul>10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html

×