Sloan 2009
Upcoming SlideShare
Loading in...5
×
 

Sloan 2009

on

  • 1,942 views

 

Statistics

Views

Total Views
1,942
Views on SlideShare
1,942
Embed Views
0

Actions

Likes
0
Downloads
6
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Sloan 2009 Sloan 2009 Presentation Transcript

  • 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html Using game mechanics and social networking to motivate student contributions to a course Edward F. Gehringer Dept. of Computer Science North Carolina State University Your feedback welcome … http://www4.ncsu.edu/~efg/form.html
  • Outline
    • The goal: Authentic assessment
    • Virtual demo
    • Social networking and game mechanics
    • Reputation systems
    • Summary
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Authentic assessment
    • What is it?
    • Why is it hard?
    • How can we facilitate it?
      • Student-generated content
      • Peer review
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Student-generated content
    • gets students working together to improve others’ learning experiences,
    • helps them learn, by performing tasks that are similar to real-world responsibilities,
    • gives them experience in writing their ideas up for an audience of their peers,
    • allows each cohort to “stand on the shoulders” of students in earlier classes.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Outline
    • The goal: Authentic assessment
    • Virtual demo
    • Social networking and game mechanics
    • Reputation systems
    • Summary
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • “ Virtual” demo
    • Creating an assignment
    • Selecting a topic
    • Reviewing
    • Feedback from author to reviewer
    • Teammate review
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Setting up a wiki assignment 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html 10/30/09
  • Let’s create some teams … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html 10/30/09
  • Here’s how we import it 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Now there are five teams … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • “ Virtual” demo
    • Setting up an assignment
    • Selecting a topic
    • Reviewing
    • Feedback from author to reviewer
    • Teammate review
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Selecting a Topic 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • “ Virtual” demo
    • Setting up an assignment
    • Selecting a topic
    • Reviewing
    • Feedback from author to reviewer
    • Teammate review
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Let’s review a wiki page 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Click on the assignment … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • … then on “Others’ work” 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Choose a review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Read the submitted wiki page 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Then fill out the review template 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Save and view the review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • “ Virtual” demo
    • Setting up an assignment
    • Selecting a topic
    • Reviewing
    • Feedback from author to reviewer
    • Teammate review
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Now the reviewee logs in … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • … and views the scores 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Click on “View” to expand review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Notice the link down at the bottom 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Use it to give feedback to the reviewer 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Then the reviewer can view the feedback 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • “ Virtual” demo
    • Setting up an assignment
    • Selecting a topic
    • Reviewing
    • Feedback from author to reviewer
    • Teammate review
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Review of teammates 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Summary of feedback in Expertiza
    • Reviews
    • Feedback to author
    • Teammate reviews
    • Metareviews ( x reviews y ’s review of z )
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Instructor report 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Outline
    • The goal: Authentic assessment
    • Virtual demo
    • Social networking and game mechanics
    • Reputation systems
    • Summary
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • How to motivate students?
    • Runners in a race are motivated by seeing other runners ahead of them.
    • Players in online games are motivated to catch the leaders.
    • Can we do the same thing in our peer-review system?
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Motivating Students: Achievement System
    • Categories in we can track achievement
      • Quality of submitted work
      • Quality of reviews
      • Helpfulness to authors
      • Contribution to team
    • These factors make up reputation.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Recognizing Achievement: Leaderboards
    • Students can list their achievements for all to see.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Now a new review is entered … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • … and the leaders change 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • A new metareview is entered … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • … and a new leader is recognized 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • What we have here is …
    • a social network!
      • Connections among many individuals.
      • Information contributed from many sources (albeit coerced!)
      • Can be used to discover competencies of individuals.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Future work: Message boards for extra credit
    • Student a posts a question
    • Student b responds
    • Student a rates student b ’s response
    • Others can rate response too.
      • TAs can also respond
    • Prompt reviews/answers are more helpful, so reward for these …
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • New Features Coming to Expertiza
    • Levels
      • “ Special power”―rearranging messages
      • Microtasks/micropayments
      • … incentivize useful work
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Outline
    • The goal: Authentic assessment
    • Virtual demo
    • Student-generated content
    • Social networking and game mechanics
    • Reputation systems
    • Summary
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Are the evaluations reliable?
    • Author feedback
    • Metareviewing helps.
    • Algorithmic strategies
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Algorithmic approaches
    • Strategies use quality and leniency as metrics for assigning grades.
    • Quality is dependent on leniency, and vice versa.
    • Their approach yields a system of simultaneous equations, which can be solved to yield values for quality.
    • Other researchers have devised similar methodologies.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Other reputation systems
    • What we have seen are “reputation systems” devoted to evaluating required work.
    • Other reputation system deal with voluntary work.
    • Our hope is to blend the two.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Outline
    • The goal: Authentic assessment
    • Virtual demo
    • Student-generated content
    • Social networking and game mechanics
    • Reputation systems
    • Summary
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
  • Summary
    • If students do “real” tasks, authentic assessment is possible.
    • Peer assessment provides a scalable approach to authentic assessment.
    • Incentives such as leaderboards and micropayments can be used to encourage student contributions.
    • A reputation system is needed for quality control.
    10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html