Sloan 2009
Upcoming SlideShare
Loading in...5
×
 

Sloan 2009

on

  • 1,939 views

 

Statistics

Views

Total Views
1,939
Views on SlideShare
1,939
Embed Views
0

Actions

Likes
0
Downloads
6
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Sloan 2009 Sloan 2009 Presentation Transcript

    • 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html Using game mechanics and social networking to motivate student contributions to a course Edward F. Gehringer Dept. of Computer Science North Carolina State University Your feedback welcome … http://www4.ncsu.edu/~efg/form.html
    • Outline
      • The goal: Authentic assessment
      • Virtual demo
      • Social networking and game mechanics
      • Reputation systems
      • Summary
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Authentic assessment
      • What is it?
      • Why is it hard?
      • How can we facilitate it?
        • Student-generated content
        • Peer review
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Student-generated content
      • gets students working together to improve others’ learning experiences,
      • helps them learn, by performing tasks that are similar to real-world responsibilities,
      • gives them experience in writing their ideas up for an audience of their peers,
      • allows each cohort to “stand on the shoulders” of students in earlier classes.
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Outline
      • The goal: Authentic assessment
      • Virtual demo
      • Social networking and game mechanics
      • Reputation systems
      • Summary
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • “ Virtual” demo
      • Creating an assignment
      • Selecting a topic
      • Reviewing
      • Feedback from author to reviewer
      • Teammate review
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Setting up a wiki assignment 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html 10/30/09
    • Let’s create some teams … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html 10/30/09
    • Here’s how we import it 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Now there are five teams … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • “ Virtual” demo
      • Setting up an assignment
      • Selecting a topic
      • Reviewing
      • Feedback from author to reviewer
      • Teammate review
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Selecting a Topic 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • “ Virtual” demo
      • Setting up an assignment
      • Selecting a topic
      • Reviewing
      • Feedback from author to reviewer
      • Teammate review
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Let’s review a wiki page 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Click on the assignment … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • … then on “Others’ work” 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Choose a review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Read the submitted wiki page 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Then fill out the review template 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Save and view the review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • “ Virtual” demo
      • Setting up an assignment
      • Selecting a topic
      • Reviewing
      • Feedback from author to reviewer
      • Teammate review
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Now the reviewee logs in … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • … and views the scores 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Click on “View” to expand review 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Notice the link down at the bottom 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Use it to give feedback to the reviewer 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Then the reviewer can view the feedback 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • “ Virtual” demo
      • Setting up an assignment
      • Selecting a topic
      • Reviewing
      • Feedback from author to reviewer
      • Teammate review
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Review of teammates 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Summary of feedback in Expertiza
      • Reviews
      • Feedback to author
      • Teammate reviews
      • Metareviews ( x reviews y ’s review of z )
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Instructor report 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Outline
      • The goal: Authentic assessment
      • Virtual demo
      • Social networking and game mechanics
      • Reputation systems
      • Summary
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • How to motivate students?
      • Runners in a race are motivated by seeing other runners ahead of them.
      • Players in online games are motivated to catch the leaders.
      • Can we do the same thing in our peer-review system?
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Motivating Students: Achievement System
      • Categories in we can track achievement
        • Quality of submitted work
        • Quality of reviews
        • Helpfulness to authors
        • Contribution to team
      • These factors make up reputation.
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Recognizing Achievement: Leaderboards
      • Students can list their achievements for all to see.
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Now a new review is entered … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • … and the leaders change 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • A new metareview is entered … 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • … and a new leader is recognized 10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • What we have here is …
      • a social network!
        • Connections among many individuals.
        • Information contributed from many sources (albeit coerced!)
        • Can be used to discover competencies of individuals.
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Future work: Message boards for extra credit
      • Student a posts a question
      • Student b responds
      • Student a rates student b ’s response
      • Others can rate response too.
        • TAs can also respond
      • Prompt reviews/answers are more helpful, so reward for these …
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • New Features Coming to Expertiza
      • Levels
        • “ Special power”―rearranging messages
        • Microtasks/micropayments
        • … incentivize useful work
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Outline
      • The goal: Authentic assessment
      • Virtual demo
      • Student-generated content
      • Social networking and game mechanics
      • Reputation systems
      • Summary
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Are the evaluations reliable?
      • Author feedback
      • Metareviewing helps.
      • Algorithmic strategies
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Algorithmic approaches
      • Strategies use quality and leniency as metrics for assigning grades.
      • Quality is dependent on leniency, and vice versa.
      • Their approach yields a system of simultaneous equations, which can be solved to yield values for quality.
      • Other researchers have devised similar methodologies.
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Other reputation systems
      • What we have seen are “reputation systems” devoted to evaluating required work.
      • Other reputation system deal with voluntary work.
      • Our hope is to blend the two.
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Outline
      • The goal: Authentic assessment
      • Virtual demo
      • Student-generated content
      • Social networking and game mechanics
      • Reputation systems
      • Summary
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html
    • Summary
      • If students do “real” tasks, authentic assessment is possible.
      • Peer assessment provides a scalable approach to authentic assessment.
      • Incentives such as leaderboards and micropayments can be used to encourage student contributions.
      • A reputation system is needed for quality control.
      10/30/09 Your feedback welcome: http://www4.ncsu.edu/~efg/form.html