Your SlideShare is downloading. ×
Sloan 2009
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Sloan 2009

1,798
views

Published on

Published in: Education, Technology

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,798
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
7
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html Using game mechanics and social networking to motivate student contributions to a course Edward F. Gehringer Dept. of Computer Science North Carolina State University Your feedback welcome … http://www4.ncsu.edu/~efg/form.html
  • 2. Outline
    • The goal: Authentic assessment
    • Virtual demo
    • Social networking and game mechanics
    • Reputation systems
    • Summary
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 3. Authentic assessment
    • What is it?
    • Why is it hard?
    • How can we facilitate it?
      • Student-generated content
      • Peer review
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 4. Student-generated content
    • gets students working together to improve others’ learning experiences,
    • helps them learn, by performing tasks that are similar to real-world responsibilities,
    • gives them experience in writing their ideas up for an audience of their peers,
    • allows each cohort to “stand on the shoulders” of students in earlier classes.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 5. Outline
    • The goal: Authentic assessment
    • Virtual demo
    • Social networking and game mechanics
    • Reputation systems
    • Summary
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 6. “ Virtual” demo
    • Creating an assignment
    • Selecting a topic
    • Reviewing
    • Feedback from author to reviewer
    • Teammate review
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 7. Setting up a wiki assignment 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html 10/30/09
  • 8. Let’s create some teams … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html 10/30/09
  • 9. Here’s how we import it 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 10. Now there are five teams … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 11. “ Virtual” demo
    • Setting up an assignment
    • Selecting a topic
    • Reviewing
    • Feedback from author to reviewer
    • Teammate review
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 12. Selecting a Topic 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 13. “ Virtual” demo
    • Setting up an assignment
    • Selecting a topic
    • Reviewing
    • Feedback from author to reviewer
    • Teammate review
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 14. Let’s review a wiki page 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 15. Click on the assignment … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 16. … then on “Others’ work” 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 17. Choose a review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 18. Read the submitted wiki page 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 19. Then fill out the review template 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 20. Save and view the review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 21. “ Virtual” demo
    • Setting up an assignment
    • Selecting a topic
    • Reviewing
    • Feedback from author to reviewer
    • Teammate review
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 22. Now the reviewee logs in … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 23. … and views the scores 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 24. Click on “View” to expand review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 25. Notice the link down at the bottom 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 26. Use it to give feedback to the reviewer 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 27. Then the reviewer can view the feedback 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 28. “ Virtual” demo
    • Setting up an assignment
    • Selecting a topic
    • Reviewing
    • Feedback from author to reviewer
    • Teammate review
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 29. Review of teammates 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 30. Summary of feedback in Expertiza
    • Reviews
    • Feedback to author
    • Teammate reviews
    • Metareviews ( x reviews y ’s review of z )
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 31. Instructor report 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 32. Outline
    • The goal: Authentic assessment
    • Virtual demo
    • Social networking and game mechanics
    • Reputation systems
    • Summary
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 33. How to motivate students?
    • Runners in a race are motivated by seeing other runners ahead of them.
    • Players in online games are motivated to catch the leaders.
    • Can we do the same thing in our peer-review system?
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 34. Motivating Students: Achievement System
    • Categories in we can track achievement
      • Quality of submitted work
      • Quality of reviews
      • Helpfulness to authors
      • Contribution to team
    • These factors make up reputation.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 35. Recognizing Achievement: Leaderboards
    • Students can list their achievements for all to see.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 36. Now a new review is entered … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 37. … and the leaders change 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 38. A new metareview is entered … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 39. … and a new leader is recognized 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 40. What we have here is …
    • a social network!
      • Connections among many individuals.
      • Information contributed from many sources (albeit coerced!)
      • Can be used to discover competencies of individuals.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 41. Future work: Message boards for extra credit
    • Student a posts a question
    • Student b responds
    • Student a rates student b ’s response
    • Others can rate response too.
      • TAs can also respond
    • Prompt reviews/answers are more helpful, so reward for these …
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 42. New Features Coming to Expertiza
    • Levels
      • “ Special power”―rearranging messages
      • Microtasks/micropayments
      • … incentivize useful work
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 43. Outline
    • The goal: Authentic assessment
    • Virtual demo
    • Student-generated content
    • Social networking and game mechanics
    • Reputation systems
    • Summary
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 44. Are the evaluations reliable?
    • Author feedback
    • Metareviewing helps.
    • Algorithmic strategies
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 45. Algorithmic approaches
    • Strategies use quality and leniency as metrics for assigning grades.
    • Quality is dependent on leniency, and vice versa.
    • Their approach yields a system of simultaneous equations, which can be solved to yield values for quality.
    • Other researchers have devised similar methodologies.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 46. Other reputation systems
    • What we have seen are “reputation systems” devoted to evaluating required work.
    • Other reputation system deal with voluntary work.
    • Our hope is to blend the two.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 47. Outline
    • The goal: Authentic assessment
    • Virtual demo
    • Student-generated content
    • Social networking and game mechanics
    • Reputation systems
    • Summary
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • 48. Summary
    • If students do “real” tasks, authentic assessment is possible.
    • Peer assessment provides a scalable approach to authentic assessment.
    • Incentives such as leaderboards and micropayments can be used to encourage student contributions.
    • A reputation system is needed for quality control.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html