SlideShare a Scribd company logo
Modeling but NOT Measuring Engagement in Computer Games Mark Chen with Beth Kolko, Elisabeth Cuddihy, Eliana Medina @mcdanger | markchen@uw.edu markdangerchen.net
Methods Compare two games: The Curse of Monkey Island 89.9% metascore on gamerankings.com The Oregon Trail 5th Edition assumed worse than a successful commercial game
Methods Lab studies Immersive Tendencies Questionnaire e.g., Do you ever become so involved in doing something that you lose all track of time? Gaming Engagement Questionnaire e.g.,Wereyou involved in the game to the extent that you lost track of time? (based on Witmer & Singer, 1998, Presence Questionnaire) observation during-game flow questions (Csikszentmihalyi, 1990) post-game interviews
Big Heap o’ Fail Adrian Bruce  http://adrianbruce.com/teacher-toolbox/the-fail-whale/
Big Heap o’ Fail The Oregon Trail >The Curse of Monkey Island !! Curse’s score didn’t reflect metascore Pilot test participants were frustrated with Curse much more so than with The Oregon Trail
What happened? Wrong assumptions: metascore from game reviews = engagement reviews done after hours of play reviewers have deep knowledge of gaming culture and game genres educational titles must be worse than commercial titles didn’t select The Oregon Trail based on metascore testing methods over emphasize immersion and usability We were noobs.
(de)motivation conference win, paper fail (guilt/shame) presented at DiGRA, but not a full paper never completed study or full paper group parted ways (re: noobness)
It’s still useful! not that bad; our model is still useful and relevant, our questionnaires still useful 		(Bianchi-Berthouze, Kim, & Patel, 2007)
What now? Hall of Fail as win-win! need to include ecologically valid methods to studying engagement capture affective aspects of engagement
Modeling but NOT Measuring Engagement in Computer Games Mark Chen with Beth Kolko, Elisabeth Cuddihy, Eliana Medina @mcdanger | markchen@uw.edu markdangerchen.net

More Related Content

Viewers also liked

Birthday
BirthdayBirthday
Birthday
zwtl
 
CSCL 2011: Enrollment of a New Actor to WoW Raiding
CSCL 2011: Enrollment of a New Actor to WoW RaidingCSCL 2011: Enrollment of a New Actor to WoW Raiding
CSCL 2011: Enrollment of a New Actor to WoW Raiding
Independent
 
Texas STaR Chart
Texas STaR ChartTexas STaR Chart
Texas STaR Chart
Bonnie Reichert
 
Mapping gaming practice to scientific practice
Mapping gaming practice to scientific practiceMapping gaming practice to scientific practice
Mapping gaming practice to scientific practice
Independent
 
Avameelselt sotsiaalsest meediast: kuidas kogukondi luua ja arendada
Avameelselt sotsiaalsest meediast: kuidas kogukondi luua ja arendadaAvameelselt sotsiaalsest meediast: kuidas kogukondi luua ja arendada
Avameelselt sotsiaalsest meediast: kuidas kogukondi luua ja arendada
Ragnar Sass
 
Expertise and Collaboration in Online Games
Expertise and Collaboration in Online GamesExpertise and Collaboration in Online Games
Expertise and Collaboration in Online Games
Independent
 
Tao of Level Design: Brink
Tao of Level Design: BrinkTao of Level Design: Brink
Tao of Level Design: Brink
thrmoptc
 
20160717 sbu dts colloquium on decision modeling and game theory sheikh
20160717 sbu dts colloquium on decision modeling and game theory sheikh20160717 sbu dts colloquium on decision modeling and game theory sheikh
20160717 sbu dts colloquium on decision modeling and game theory sheikh
State University of New York, Korea
 
Authoring of procedural rocks in The Blacksmith realtime short
Authoring of procedural rocks in The Blacksmith realtime shortAuthoring of procedural rocks in The Blacksmith realtime short
Authoring of procedural rocks in The Blacksmith realtime short
Vesselin Efremov
 
Level Design Workshop - GDC China 2012
Level Design Workshop - GDC China 2012Level Design Workshop - GDC China 2012
Level Design Workshop - GDC China 2012
Joel Burgess
 
Level Design Challenges & Solutions - Mirror's Edge
Level Design Challenges & Solutions - Mirror's EdgeLevel Design Challenges & Solutions - Mirror's Edge
Level Design Challenges & Solutions - Mirror's Edge
Electronic Arts / DICE
 
Modular Level Design for Skyrim
Modular Level Design for SkyrimModular Level Design for Skyrim
Modular Level Design for Skyrim
Joel Burgess
 
Modular Rigging in Battlefield 3
Modular Rigging in Battlefield 3Modular Rigging in Battlefield 3
Modular Rigging in Battlefield 3
Electronic Arts / DICE
 
Terrain in Battlefield 3: A Modern, Complete and Scalable System
Terrain in Battlefield 3: A Modern, Complete and Scalable SystemTerrain in Battlefield 3: A Modern, Complete and Scalable System
Terrain in Battlefield 3: A Modern, Complete and Scalable System
Electronic Arts / DICE
 
GDC 2016: Modular Level Design of Fallout 4
GDC 2016: Modular Level Design of Fallout 4 GDC 2016: Modular Level Design of Fallout 4
GDC 2016: Modular Level Design of Fallout 4
Joel Burgess
 
Level design
Level designLevel design
Level design
missstevenson01
 

Viewers also liked (16)

Birthday
BirthdayBirthday
Birthday
 
CSCL 2011: Enrollment of a New Actor to WoW Raiding
CSCL 2011: Enrollment of a New Actor to WoW RaidingCSCL 2011: Enrollment of a New Actor to WoW Raiding
CSCL 2011: Enrollment of a New Actor to WoW Raiding
 
Texas STaR Chart
Texas STaR ChartTexas STaR Chart
Texas STaR Chart
 
Mapping gaming practice to scientific practice
Mapping gaming practice to scientific practiceMapping gaming practice to scientific practice
Mapping gaming practice to scientific practice
 
Avameelselt sotsiaalsest meediast: kuidas kogukondi luua ja arendada
Avameelselt sotsiaalsest meediast: kuidas kogukondi luua ja arendadaAvameelselt sotsiaalsest meediast: kuidas kogukondi luua ja arendada
Avameelselt sotsiaalsest meediast: kuidas kogukondi luua ja arendada
 
Expertise and Collaboration in Online Games
Expertise and Collaboration in Online GamesExpertise and Collaboration in Online Games
Expertise and Collaboration in Online Games
 
Tao of Level Design: Brink
Tao of Level Design: BrinkTao of Level Design: Brink
Tao of Level Design: Brink
 
20160717 sbu dts colloquium on decision modeling and game theory sheikh
20160717 sbu dts colloquium on decision modeling and game theory sheikh20160717 sbu dts colloquium on decision modeling and game theory sheikh
20160717 sbu dts colloquium on decision modeling and game theory sheikh
 
Authoring of procedural rocks in The Blacksmith realtime short
Authoring of procedural rocks in The Blacksmith realtime shortAuthoring of procedural rocks in The Blacksmith realtime short
Authoring of procedural rocks in The Blacksmith realtime short
 
Level Design Workshop - GDC China 2012
Level Design Workshop - GDC China 2012Level Design Workshop - GDC China 2012
Level Design Workshop - GDC China 2012
 
Level Design Challenges & Solutions - Mirror's Edge
Level Design Challenges & Solutions - Mirror's EdgeLevel Design Challenges & Solutions - Mirror's Edge
Level Design Challenges & Solutions - Mirror's Edge
 
Modular Level Design for Skyrim
Modular Level Design for SkyrimModular Level Design for Skyrim
Modular Level Design for Skyrim
 
Modular Rigging in Battlefield 3
Modular Rigging in Battlefield 3Modular Rigging in Battlefield 3
Modular Rigging in Battlefield 3
 
Terrain in Battlefield 3: A Modern, Complete and Scalable System
Terrain in Battlefield 3: A Modern, Complete and Scalable SystemTerrain in Battlefield 3: A Modern, Complete and Scalable System
Terrain in Battlefield 3: A Modern, Complete and Scalable System
 
GDC 2016: Modular Level Design of Fallout 4
GDC 2016: Modular Level Design of Fallout 4 GDC 2016: Modular Level Design of Fallout 4
GDC 2016: Modular Level Design of Fallout 4
 
Level design
Level designLevel design
Level design
 

More from Independent

What does it mean to be gaming literate?
What does it mean to be gaming literate?What does it mean to be gaming literate?
What does it mean to be gaming literate?
Independent
 
Jam w free digital game making apps!
Jam w free digital game making apps!Jam w free digital game making apps!
Jam w free digital game making apps!
Independent
 
Transportation Games and Intentional Constraints
Transportation Games and Intentional ConstraintsTransportation Games and Intentional Constraints
Transportation Games and Intentional Constraints
Independent
 
Working example new game design curricula for underserved youth in multiple ...
Working example  new game design curricula for underserved youth in multiple ...Working example  new game design curricula for underserved youth in multiple ...
Working example new game design curricula for underserved youth in multiple ...
Independent
 
(Academic) game [design research] labs- what are they and how do you (not) st...
(Academic) game [design research] labs- what are they and how do you (not) st...(Academic) game [design research] labs- what are they and how do you (not) st...
(Academic) game [design research] labs- what are they and how do you (not) st...
Independent
 
Ultimate TWINE
Ultimate TWINEUltimate TWINE
Ultimate TWINE
Independent
 
Games and education.wtf.nobull
Games and education.wtf.nobullGames and education.wtf.nobull
Games and education.wtf.nobull
Independent
 
Games and Education. WTF?
Games and Education. WTF?Games and Education. WTF?
Games and Education. WTF?
Independent
 
Death by chocolate-covered broccoli: A case where gamification killed gaming ...
Death by chocolate-covered broccoli: A case where gamification killed gaming ...Death by chocolate-covered broccoli: A case where gamification killed gaming ...
Death by chocolate-covered broccoli: A case where gamification killed gaming ...
Independent
 
From New Players to Fervent Hobbyists: BoardGameGeeks Unite!
From New Players to Fervent Hobbyists: BoardGameGeeks Unite!From New Players to Fervent Hobbyists: BoardGameGeeks Unite!
From New Players to Fervent Hobbyists: BoardGameGeeks Unite!
Independent
 
Normalized play
Normalized playNormalized play
Normalized play
Independent
 
Mark Chen job talk 2013
Mark Chen job talk 2013Mark Chen job talk 2013
Mark Chen job talk 2013
Independent
 
5 Things about Games and Learning
5 Things about Games and Learning5 Things about Games and Learning
5 Things about Games and Learning
Independent
 
Leet Noobs: The Life and Death of an Expert Player Group in World of Warcraft
Leet Noobs: The Life and Death of an Expert Player Group in World of WarcraftLeet Noobs: The Life and Death of an Expert Player Group in World of Warcraft
Leet Noobs: The Life and Death of an Expert Player Group in World of Warcraft
Independent
 
Chen.aera2011.social dimensions of expertise
Chen.aera2011.social dimensions of expertiseChen.aera2011.social dimensions of expertise
Chen.aera2011.social dimensions of expertise
Independent
 

More from Independent (15)

What does it mean to be gaming literate?
What does it mean to be gaming literate?What does it mean to be gaming literate?
What does it mean to be gaming literate?
 
Jam w free digital game making apps!
Jam w free digital game making apps!Jam w free digital game making apps!
Jam w free digital game making apps!
 
Transportation Games and Intentional Constraints
Transportation Games and Intentional ConstraintsTransportation Games and Intentional Constraints
Transportation Games and Intentional Constraints
 
Working example new game design curricula for underserved youth in multiple ...
Working example  new game design curricula for underserved youth in multiple ...Working example  new game design curricula for underserved youth in multiple ...
Working example new game design curricula for underserved youth in multiple ...
 
(Academic) game [design research] labs- what are they and how do you (not) st...
(Academic) game [design research] labs- what are they and how do you (not) st...(Academic) game [design research] labs- what are they and how do you (not) st...
(Academic) game [design research] labs- what are they and how do you (not) st...
 
Ultimate TWINE
Ultimate TWINEUltimate TWINE
Ultimate TWINE
 
Games and education.wtf.nobull
Games and education.wtf.nobullGames and education.wtf.nobull
Games and education.wtf.nobull
 
Games and Education. WTF?
Games and Education. WTF?Games and Education. WTF?
Games and Education. WTF?
 
Death by chocolate-covered broccoli: A case where gamification killed gaming ...
Death by chocolate-covered broccoli: A case where gamification killed gaming ...Death by chocolate-covered broccoli: A case where gamification killed gaming ...
Death by chocolate-covered broccoli: A case where gamification killed gaming ...
 
From New Players to Fervent Hobbyists: BoardGameGeeks Unite!
From New Players to Fervent Hobbyists: BoardGameGeeks Unite!From New Players to Fervent Hobbyists: BoardGameGeeks Unite!
From New Players to Fervent Hobbyists: BoardGameGeeks Unite!
 
Normalized play
Normalized playNormalized play
Normalized play
 
Mark Chen job talk 2013
Mark Chen job talk 2013Mark Chen job talk 2013
Mark Chen job talk 2013
 
5 Things about Games and Learning
5 Things about Games and Learning5 Things about Games and Learning
5 Things about Games and Learning
 
Leet Noobs: The Life and Death of an Expert Player Group in World of Warcraft
Leet Noobs: The Life and Death of an Expert Player Group in World of WarcraftLeet Noobs: The Life and Death of an Expert Player Group in World of Warcraft
Leet Noobs: The Life and Death of an Expert Player Group in World of Warcraft
 
Chen.aera2011.social dimensions of expertise
Chen.aera2011.social dimensions of expertiseChen.aera2011.social dimensions of expertise
Chen.aera2011.social dimensions of expertise
 

Recently uploaded

Main Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docxMain Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docx
adhitya5119
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
EverAndrsGuerraGuerr
 
S1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptxS1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptx
tarandeep35
 
How to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRMHow to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRM
Celine George
 
Pride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School DistrictPride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School District
David Douglas School District
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
Nicholas Montgomery
 
The basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptxThe basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptx
heathfieldcps1
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
Peter Windle
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
Dr. Shivangi Singh Parihar
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
Levi Shapiro
 
A Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptxA Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptx
thanhdowork
 
How to Build a Module in Odoo 17 Using the Scaffold Method
How to Build a Module in Odoo 17 Using the Scaffold MethodHow to Build a Module in Odoo 17 Using the Scaffold Method
How to Build a Module in Odoo 17 Using the Scaffold Method
Celine George
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
Jean Carlos Nunes Paixão
 
Top five deadliest dog breeds in America
Top five deadliest dog breeds in AmericaTop five deadliest dog breeds in America
Top five deadliest dog breeds in America
Bisnar Chase Personal Injury Attorneys
 
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdfANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
Priyankaranawat4
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
Nicholas Montgomery
 
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
National Information Standards Organization (NISO)
 
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama UniversityNatural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Akanksha trivedi rama nursing college kanpur.
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
Israel Genealogy Research Association
 
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Dr. Vinod Kumar Kanvaria
 

Recently uploaded (20)

Main Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docxMain Java[All of the Base Concepts}.docx
Main Java[All of the Base Concepts}.docx
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
 
S1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptxS1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptx
 
How to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRMHow to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRM
 
Pride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School DistrictPride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School District
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
 
The basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptxThe basics of sentences session 5pptx.pptx
The basics of sentences session 5pptx.pptx
 
A Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in EducationA Strategic Approach: GenAI in Education
A Strategic Approach: GenAI in Education
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
 
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
 
A Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptxA Survey of Techniques for Maximizing LLM Performance.pptx
A Survey of Techniques for Maximizing LLM Performance.pptx
 
How to Build a Module in Odoo 17 Using the Scaffold Method
How to Build a Module in Odoo 17 Using the Scaffold MethodHow to Build a Module in Odoo 17 Using the Scaffold Method
How to Build a Module in Odoo 17 Using the Scaffold Method
 
Lapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdfLapbook sobre os Regimes Totalitários.pdf
Lapbook sobre os Regimes Totalitários.pdf
 
Top five deadliest dog breeds in America
Top five deadliest dog breeds in AmericaTop five deadliest dog breeds in America
Top five deadliest dog breeds in America
 
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdfANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
ANATOMY AND BIOMECHANICS OF HIP JOINT.pdf
 
Film vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movieFilm vocab for eal 3 students: Australia the movie
Film vocab for eal 3 students: Australia the movie
 
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
 
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama UniversityNatural birth techniques - Mrs.Akanksha Trivedi Rama University
Natural birth techniques - Mrs.Akanksha Trivedi Rama University
 
The Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collectionThe Diamonds of 2023-2024 in the IGRA collection
The Diamonds of 2023-2024 in the IGRA collection
 
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
Exploiting Artificial Intelligence for Empowering Researchers and Faculty, In...
 

Modeling NOT measuring engagement in games

  • 1. Modeling but NOT Measuring Engagement in Computer Games Mark Chen with Beth Kolko, Elisabeth Cuddihy, Eliana Medina @mcdanger | markchen@uw.edu markdangerchen.net
  • 2.
  • 3. Methods Compare two games: The Curse of Monkey Island 89.9% metascore on gamerankings.com The Oregon Trail 5th Edition assumed worse than a successful commercial game
  • 4.
  • 5. Methods Lab studies Immersive Tendencies Questionnaire e.g., Do you ever become so involved in doing something that you lose all track of time? Gaming Engagement Questionnaire e.g.,Wereyou involved in the game to the extent that you lost track of time? (based on Witmer & Singer, 1998, Presence Questionnaire) observation during-game flow questions (Csikszentmihalyi, 1990) post-game interviews
  • 6. Big Heap o’ Fail Adrian Bruce http://adrianbruce.com/teacher-toolbox/the-fail-whale/
  • 7. Big Heap o’ Fail The Oregon Trail >The Curse of Monkey Island !! Curse’s score didn’t reflect metascore Pilot test participants were frustrated with Curse much more so than with The Oregon Trail
  • 8. What happened? Wrong assumptions: metascore from game reviews = engagement reviews done after hours of play reviewers have deep knowledge of gaming culture and game genres educational titles must be worse than commercial titles didn’t select The Oregon Trail based on metascore testing methods over emphasize immersion and usability We were noobs.
  • 9. (de)motivation conference win, paper fail (guilt/shame) presented at DiGRA, but not a full paper never completed study or full paper group parted ways (re: noobness)
  • 10. It’s still useful! not that bad; our model is still useful and relevant, our questionnaires still useful (Bianchi-Berthouze, Kim, & Patel, 2007)
  • 11. What now? Hall of Fail as win-win! need to include ecologically valid methods to studying engagement capture affective aspects of engagement
  • 12. Modeling but NOT Measuring Engagement in Computer Games Mark Chen with Beth Kolko, Elisabeth Cuddihy, Eliana Medina @mcdanger | markchen@uw.edu markdangerchen.net

Editor's Notes

  1. Malone &LepperHeeterLazarroFlow