Modeling NOT measuring engagement in games

1,945 views

Published on

Presentation at Games Learning Society 7 (June 2011) during the 2nd Hall of Failure session

Published in: Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,945
On SlideShare
0
From Embeds
0
Number of Embeds
750
Actions
Shares
0
Downloads
8
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • Malone &LepperHeeterLazarroFlow
  • Modeling NOT measuring engagement in games

    1. 1. Modeling but NOT Measuring Engagement in Computer Games<br />Mark Chen<br />with Beth Kolko, Elisabeth Cuddihy, Eliana Medina<br />@mcdanger | markchen@uw.edu<br />markdangerchen.net<br />
    2. 2.
    3. 3. Methods<br />Compare two games:<br />The Curse of Monkey Island<br />89.9% metascore on gamerankings.com<br />The Oregon Trail 5th Edition<br />assumed worse than a successful commercial game <br />
    4. 4.
    5. 5. Methods<br />Lab studies<br />Immersive Tendencies Questionnaire<br />e.g., Do you ever become so involved in doing something that you lose all track of time?<br />Gaming Engagement Questionnaire<br />e.g.,Wereyou involved in the game to the extent that you lost track of time?<br />(based on Witmer & Singer, 1998, Presence Questionnaire)<br />observation<br />during-game flow questions (Csikszentmihalyi, 1990)<br />post-game interviews<br />
    6. 6. Big Heap o’ Fail<br />Adrian Bruce http://adrianbruce.com/teacher-toolbox/the-fail-whale/<br />
    7. 7. Big Heap o’ Fail<br />The Oregon Trail >The Curse of Monkey Island !!<br />Curse’s score didn’t reflect metascore<br />Pilot test participants were frustrated with Curse much more so than with The Oregon Trail<br />
    8. 8. What happened?<br />Wrong assumptions:<br />metascore from game reviews = engagement<br />reviews done after hours of play<br />reviewers have deep knowledge of gaming culture and game genres<br />educational titles must be worse than commercial titles<br />didn’t select The Oregon Trail based on metascore<br />testing methods over emphasize immersion and usability<br />We were noobs.<br />
    9. 9. (de)motivation<br />conference win, paper fail (guilt/shame)<br />presented at DiGRA, but not a full paper<br />never completed study or full paper<br />group parted ways (re: noobness)<br />
    10. 10. It’s still useful!<br />not that bad; our model is still useful and relevant, our questionnaires still useful<br /> (Bianchi-Berthouze, Kim, & Patel, 2007)<br />
    11. 11. What now?<br />Hall of Fail as win-win!<br />need to include ecologically valid methods to studying engagement<br />capture affective aspects of engagement<br />
    12. 12. Modeling but NOT Measuring Engagement in Computer Games<br />Mark Chen<br />with Beth Kolko, Elisabeth Cuddihy, Eliana Medina<br />@mcdanger | markchen@uw.edu<br />markdangerchen.net<br />

    ×