Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Using Game Mechanics & Social Networking

1,253 views

Published on

Property of Dr. Ed Gehringer (c) 2010
All rights reserved.

  • Be the first to comment

Using Game Mechanics & Social Networking

  1. 1. Using game mechanics and social networking to motivate student contributions to a course Edward F. Gehringer Dept. of Computer Science North Carolina State University Your feedback welcome … http://tinyurl.com/expertiza
  2. 2. Outline <ul><li>The goal: Authentic assessment </li></ul><ul><li>Virtual demo </li></ul><ul><li>Social networking and game mechanics </li></ul><ul><li>Reputation systems </li></ul><ul><li>Summary </li></ul>02/09/10
  3. 3. Authentic assessment <ul><li>What is it? </li></ul><ul><li>Why is it hard? </li></ul><ul><li>How can we facilitate it? </li></ul><ul><ul><li>Student-generated content </li></ul></ul><ul><ul><li>Peer review </li></ul></ul>02/09/10
  4. 4. Student-generated content <ul><li>gets students working together to improve others’ learning experiences, </li></ul><ul><li>helps them learn, by performing tasks that are similar to real-world responsibilities, </li></ul><ul><li>gives them experience in writing their ideas up for an audience of their peers, </li></ul><ul><li>allows each cohort to “stand on the shoulders” of students in earlier classes. </li></ul>02/09/10
  5. 5. Outline <ul><li>The goal: Authentic assessment </li></ul><ul><li>Virtual demo </li></ul><ul><li>Social networking and game mechanics </li></ul><ul><li>Reputation systems </li></ul><ul><li>Summary </li></ul>02/09/10
  6. 6. “Virtual” demo <ul><li>Creating an assignment </li></ul><ul><li>Selecting a topic </li></ul><ul><li>Reviewing </li></ul><ul><li>Feedback from author to reviewer </li></ul><ul><li>Teammate review </li></ul>02/09/10
  7. 7. Setting up a wiki assignment 02/09/10 02/09/10
  8. 8. Let’s create some teams … 02/09/10 02/09/10
  9. 9. Here’s how we import it 02/09/10
  10. 10. Now there are five teams … 02/09/10
  11. 11. “Virtual” demo <ul><li>Setting up an assignment </li></ul><ul><li>Selecting a topic </li></ul><ul><li>Reviewing </li></ul><ul><li>Feedback from author to reviewer </li></ul><ul><li>Teammate review </li></ul>02/09/10
  12. 12. Selecting a Topic 02/09/10
  13. 13. “Virtual” demo <ul><li>Setting up an assignment </li></ul><ul><li>Selecting a topic </li></ul><ul><li>Reviewing </li></ul><ul><li>Feedback from author to reviewer </li></ul><ul><li>Teammate review </li></ul>02/09/10
  14. 14. Let’s review a wiki page 02/09/10
  15. 15. Click on the assignment … 02/09/10
  16. 16. … then on “Others’ work” 02/09/10
  17. 17. Choose a review 02/09/10
  18. 18. Read the submitted wiki page 02/09/10
  19. 19. Then fill out the review template 02/09/10
  20. 20. Save and view the review 02/09/10
  21. 21. “Virtual” demo <ul><li>Setting up an assignment </li></ul><ul><li>Selecting a topic </li></ul><ul><li>Reviewing </li></ul><ul><li>Feedback from author to reviewer </li></ul><ul><li>Teammate review </li></ul>02/09/10
  22. 22. Now the reviewee logs in … 02/09/10
  23. 23. … and views the scores 02/09/10
  24. 24. Click on “View” to expand review 02/09/10
  25. 25. Notice the link down at the bottom 02/09/10
  26. 26. Use it to give feedback to the reviewer 02/09/10
  27. 27. Then the reviewer can view the feedback 02/09/10
  28. 28. “Virtual” demo <ul><li>Setting up an assignment </li></ul><ul><li>Selecting a topic </li></ul><ul><li>Reviewing </li></ul><ul><li>Feedback from author to reviewer </li></ul><ul><li>Teammate review </li></ul>02/09/10
  29. 29. Review of teammates 02/09/10
  30. 30. Summary of feedback in Expertiza <ul><li>Reviews </li></ul><ul><li>Feedback to author </li></ul><ul><li>Teammate reviews </li></ul><ul><li>Metareviews ( x reviews y ’s review of z ) </li></ul>02/09/10
  31. 31. Instructor report 02/09/10
  32. 32. Outline <ul><li>The goal: Authentic assessment </li></ul><ul><li>Virtual demo </li></ul><ul><li>Social networking and game mechanics </li></ul><ul><li>Reputation systems </li></ul><ul><li>Summary </li></ul>02/09/10
  33. 33. How to motivate students? <ul><li>Runners in a race are motivated by seeing other runners ahead of them. </li></ul><ul><li>Players in online games are motivated to catch the leaders. </li></ul><ul><li>Can we do the same thing in our peer-review system? </li></ul>02/09/10
  34. 34. Motivating Students: Achievement System <ul><li>Categories in we can track achievement </li></ul><ul><ul><li>Quality of submitted work </li></ul></ul><ul><ul><li>Quality of reviews </li></ul></ul><ul><ul><li>Helpfulness to authors </li></ul></ul><ul><ul><li>Contribution to team </li></ul></ul><ul><li>These factors make up reputation. </li></ul>02/09/10
  35. 35. Recognizing Achievement: Leaderboards <ul><li>Students can list their achievements for all to see. </li></ul>02/09/10 Your feedback welcome: http://tinyurl.com/expertiza
  36. 36. Now a new review is entered … 02/09/10
  37. 37. … and the leaders change 02/09/10
  38. 38. A new metareview is entered … 02/09/10
  39. 39. … and a new leader is recognized 02/09/10
  40. 40. What we have here is … <ul><li>a social network! </li></ul><ul><ul><li>Connections among many individuals. </li></ul></ul><ul><ul><li>Information contributed from many sources (albeit coerced!) </li></ul></ul><ul><ul><li>Can be used to discover competencies of individuals. </li></ul></ul>02/09/10
  41. 41. Future work: Message boards for extra credit <ul><li>Student a posts a question </li></ul><ul><li>Student b responds </li></ul><ul><li>Student a rates student b ’s response </li></ul><ul><li>Others can rate response too. </li></ul><ul><ul><li>TAs can also respond </li></ul></ul><ul><li>Prompt reviews/answers are more helpful, so reward for these … </li></ul>02/09/10
  42. 42. New Features Coming to Expertiza <ul><li>Levels </li></ul><ul><ul><li>“ Special power”―rearranging messages </li></ul></ul><ul><ul><li>Microtasks/micropayments </li></ul></ul><ul><ul><li>… incentivize useful work </li></ul></ul>02/09/10
  43. 43. Outline <ul><li>The goal: Authentic assessment </li></ul><ul><li>Virtual demo </li></ul><ul><li>Student-generated content </li></ul><ul><li>Social networking and game mechanics </li></ul><ul><li>Reputation systems </li></ul><ul><li>Summary </li></ul>02/09/10
  44. 44. Are the evaluations reliable? <ul><li>Author feedback </li></ul><ul><li>Metareviewing helps. </li></ul><ul><li>Algorithmic strategies </li></ul>02/09/10
  45. 45. Algorithmic approaches <ul><li>Strategies use quality and leniency as metrics for assigning grades. </li></ul><ul><li>Quality is dependent on leniency, and vice versa. </li></ul><ul><li>Their approach yields a system of simultaneous equations, which can be solved to yield values for quality. </li></ul><ul><li>Other researchers have devised similar methodologies. </li></ul>02/09/10
  46. 46. Other reputation systems <ul><li>What we have seen are “reputation systems” devoted to evaluating required work. </li></ul><ul><li>Other reputation system deal with voluntary work. </li></ul><ul><li>Our hope is to blend the two. </li></ul>02/09/10
  47. 47. Outline <ul><li>The goal: Authentic assessment </li></ul><ul><li>Virtual demo </li></ul><ul><li>Student-generated content </li></ul><ul><li>Social networking and game mechanics </li></ul><ul><li>Reputation systems </li></ul><ul><li>Summary </li></ul>02/09/10
  48. 48. Summary <ul><li>If students do “real” tasks, authentic assessment is possible. </li></ul><ul><li>Peer assessment provides a scalable approach to authentic assessment. </li></ul><ul><li>Incentives such as leaderboards and micropayments can be used to encourage student contributions. </li></ul><ul><li>A reputation system is needed for quality control. </li></ul>02/09/10

×