All rise! Multiple perspectives on serious game evaluation - ISAGA 2012

  • 356 views
Uploaded on

All rise! Multiple Perspectives on Serious Game Evaluation: Heide Lukosch, Delft University of Technology @ ISAGA 2012, Romania

All rise! Multiple Perspectives on Serious Game Evaluation: Heide Lukosch, Delft University of Technology @ ISAGA 2012, Romania

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
356
On Slideshare
0
From Embeds
0
Number of Embeds
1

Actions

Shares
Downloads
6
Comments
0
Likes
1

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. All rise!Multiple perspectives on serious gameevaluationHeide Lukosch, Harald Warmelink, Rens KortmannInternational Simulation and Gaming Association Conference 2012 10-07-12 Delft University of Technology Challenge the future
  • 2. 10-07-12DelftUniversity ofTechnologyChallenge the future
  • 3. Why should we evaluate such a game? How can we evaluate such a game? 3 | 17
  • 4. StructureStarting pointsUnderstanding of Serious GamesThe Evaluation of Serious GamesOur Court Game WorkshopMultiple Perspectives on Serious Game EvaluationThe Contribution of Social Systems TheoryConclusions and Discussion 4 | 17
  • 5. Starting Points Image: forresterblogs.seriousgamingDisagreements on a properevaluation method within the communityEvaluation is needed to increasethe quality of serious gamesWhich perspectives on serious game evaluation do exist? 5 | 17
  • 6. Understanding of (Serious) GamesGames as tools to supportprocesses of Organizational change Decision Making Learning Policy makingWhat are preconditions and effects? Images: CharliePapa simulation Game; Craft Game, | 17 6 Kenteq, NL
  • 7. The Evaluation of (Serious) GamesInfluenced by social sciencesTheory based evaluationDesign perspectiveAnalytical perspectiveFocus on learning effects of a game Images: CharliePapa simulation Game; TU Delft game17 7 | session
  • 8. The evaluation of (Serious) GamesIncreasing interest in Serious Games DevelopmentA lot of money is spentStill less is known aboutproper evaluation methodsOften pre- and post-assesments are conductedto find proof for effectivenessInput – Proces – Output model Images: CharliePapa simulation Game; TU Delft game17 8 | session
  • 9. Our Court Game WorkshopRole-play to facilitate a discussionTwo opposite perspectives(plaintiff and defendant)representing our hypothesis:existence of economic andscientific perspectiveGroup discussions Image: DIGRA Court role play 9 | 17 workshop
  • 10. Our Court Game WorkshopStructured approach, applied to a role-play e Introduction Presentation Facilitated f rol AlternativesIdentification Analysis of of the group positions discussion Summary Presentation le of results o n ro Conclusions ole De-Briefing on r n ro le e o off rol Based on Kolfschoten/De Vreede, 17 10 | 2009
  • 11. Our Court Game WorkshopDutch Civil LawGame industry association(plaintiff)Game company(defendant)Expert WitnessesAdditional Material Image: DIGRA Court role play workshop 11 | 17
  • 12. Our Court Game WorkshopItems to discuss: Types of measured variables Number of measuring instruments Number of respondents Use of theory Objectivity of evaluation Image: DIGRA Court role play workshop 12 | 17
  • 13. Multiple perspectives on EvaluationEvaluation of effects problematicEvaluation of the designpossibleValue of Evaluation itself?A third, „arts“ perspective emerged Image: Dijk Patrouille game 13 | 17
  • 14. The Contribution of Social SystemsTheory Economics Arts Sciencesobserve Serious Games 14 | 17
  • 15. ConclusionsThe way we look at evaluationof games and simulations in our research groupTools for changeHow can gamesinfluence changeprocesses? Image: Craft Game, 15 | 17 NL Kenteq,
  • 16. ConclusionsMultiple perspectives are relatedto distinct parts of modern society: Science Economics ArtsUnderstood as paradigms,could they influence researchon serious games? Image: www.designingasociety.net 16 | 17
  • 17. Discussion Types of measured variables Number of measuring instruments Number of respondents Use of theory Objectivity of evaluation more items ?Any more perspectives to consider? 17 | 17