Transcript of "All rise! Multiple perspectives on serious game evaluation - ISAGA 2012"
All rise!Multiple perspectives on serious gameevaluationHeide Lukosch, Harald Warmelink, Rens KortmannInternational Simulation and Gaming Association Conference 2012 10-07-12 Delft University of Technology Challenge the future
10-07-12DelftUniversity ofTechnologyChallenge the future
Why should we evaluate such a game? How can we evaluate such a game? 3 | 17
StructureStarting pointsUnderstanding of Serious GamesThe Evaluation of Serious GamesOur Court Game WorkshopMultiple Perspectives on Serious Game EvaluationThe Contribution of Social Systems TheoryConclusions and Discussion 4 | 17
Starting Points Image: forresterblogs.seriousgamingDisagreements on a properevaluation method within the communityEvaluation is needed to increasethe quality of serious gamesWhich perspectives on serious game evaluation do exist? 5 | 17
Understanding of (Serious) GamesGames as tools to supportprocesses of Organizational change Decision Making Learning Policy makingWhat are preconditions and effects? Images: CharliePapa simulation Game; Craft Game, | 17 6 Kenteq, NL
The Evaluation of (Serious) GamesInfluenced by social sciencesTheory based evaluationDesign perspectiveAnalytical perspectiveFocus on learning effects of a game Images: CharliePapa simulation Game; TU Delft game17 7 | session
The evaluation of (Serious) GamesIncreasing interest in Serious Games DevelopmentA lot of money is spentStill less is known aboutproper evaluation methodsOften pre- and post-assesments are conductedto find proof for effectivenessInput – Proces – Output model Images: CharliePapa simulation Game; TU Delft game17 8 | session
Our Court Game WorkshopRole-play to facilitate a discussionTwo opposite perspectives(plaintiff and defendant)representing our hypothesis:existence of economic andscientific perspectiveGroup discussions Image: DIGRA Court role play 9 | 17 workshop
Our Court Game WorkshopStructured approach, applied to a role-play e Introduction Presentation Facilitated f rol AlternativesIdentification Analysis of of the group positions discussion Summary Presentation le of results o n ro Conclusions ole De-Briefing on r n ro le e o off rol Based on Kolfschoten/De Vreede, 17 10 | 2009
Our Court Game WorkshopDutch Civil LawGame industry association(plaintiff)Game company(defendant)Expert WitnessesAdditional Material Image: DIGRA Court role play workshop 11 | 17
Our Court Game WorkshopItems to discuss: Types of measured variables Number of measuring instruments Number of respondents Use of theory Objectivity of evaluation Image: DIGRA Court role play workshop 12 | 17
Multiple perspectives on EvaluationEvaluation of effects problematicEvaluation of the designpossibleValue of Evaluation itself?A third, „arts“ perspective emerged Image: Dijk Patrouille game 13 | 17
The Contribution of Social SystemsTheory Economics Arts Sciencesobserve Serious Games 14 | 17
ConclusionsThe way we look at evaluationof games and simulations in our research groupTools for changeHow can gamesinfluence changeprocesses? Image: Craft Game, 15 | 17 NL Kenteq,
ConclusionsMultiple perspectives are relatedto distinct parts of modern society: Science Economics ArtsUnderstood as paradigms,could they influence researchon serious games? Image: www.designingasociety.net 16 | 17
Discussion Types of measured variables Number of measuring instruments Number of respondents Use of theory Objectivity of evaluation more items ?Any more perspectives to consider? 17 | 17
A particular slide catching your eye?
Clipping is a handy way to collect important slides you want to go back to later.