The final presentation for a design case in collaboration with Shosho and Koninklijke Kentalis. Our project goal was to design a serious game to teach autistic children to recognize, understand and respond to emotions. Also, we explored different types of multimedia interactions that could act as a ‘game controller’ to input emotions.

1. Serious Games
for Children with Autism
Bart Geelen, Marta Kaczmarczyk, Guilherme Moura, Lennart Overkamp
User System Interaction, 17-12-2015

2. The Autcome Project
Kentalis
www.kentalis.nl
info@kentalis.nl
Shosho
www.shosho.nl
info@shosho.nl

6. 5. Games 6. Controllers
2. Goals
3. (User)
Research
1. Problem 4. Ideation
7. User
Testing
8.
Conclusions

7. 5. Games 6. Controllers
2. Goals
3. (User)
Research
4. Ideation
7. User
Testing
8.
Conclusions
1. Problem

8. 4W Workshop
To define the problem:
who, what, where, why?
Participants:

9. Problem
WHO
Autistic children
(7-13)
WHAT
Difficulties with
recognizing,
understanding
and responding
to emotions.
WHERE
During social
interaction
(home, school,
street).
WHY
Social dependence,
burden for family
and teachers.

10. 5. Games 6. Controllers
3. (User)
Research
1. Problem 4. Ideation
7. User
Testing
8.
Conclusions
2. Goals

11. Goals
#1 : Design digital games that teach autistic children
to recognize, understand and respond to emotions.

12. Goals
#2 : Explore interactions for a game controller
that inputs emotion.

13. 5. Games 6. Controllers
2. Goals1. Problem 4. Ideation
7. User
Testing
8.
Conclusions
3. (User)
Research

14. Research
To create a benchmark and serve as
inspiration for our games and controller.
Topics:
games interactions classroom

15. User Research
To understand the challenges, motivations
and education of autistic children.
Contextual Inquiries:
1 1 1
teacher therapist researcher
Observations:
2 1 1
Shosho therapy classroom
tests session

16. 5. Games 6. Controllers
2. Goals
3. (User)
Research
1. Problem
7. User
Testing
8.
Conclusions
4. Ideation

17. Ideation
To come up with feasible and educational
concepts for games and controllers.
Brainstorming:
4
USIs
Co-creation:
1 1 1
teacher therapist researcher

18. 6. Controllers
2. Goals
3. (User)
Research
1. Problem 4. Ideation
7. User
Testing
8.
Conclusions
5. Games

19. Interactive Story
Teaches:
Understanding emotions.
Consequences of behavior.

21. Emotion Chat
Teaches:
Responding to emotions.
Consequences of showing emotions.

23. 5. Games
2. Goals
3. (User)
Research
1. Problem 4. Ideation
7. User
Testing
8.
Conclusions
6. Controllers

24. Mouse Dragging

25. Sliders

26. Distance Sensors

27. Joystick

28. Emotion Cubes

29. Expression Cubes

30. Social Scenarios

31. 5. Games 6. Controllers
2. Goals
3. (User)
Research
1. Problem 4. Ideation
8.
Conclusions
7. User
Testing

32. Individual Tests
To observe the engagement, preferences,
interaction and game understanding of children.
Participants:
4
children
Prototypes tested:
Interactive Story (3x)
Controllers (2x)

33. Classroom Test
To explore potential of digital games
in classrooms for teaching emotions.
Participants:
8 1
children teacher
Prototype tested:
Emotion Cubes + Social Scenarios

34. 5. Games 6. Controllers
2. Goals
3. (User)
Research
1. Problem 4. Ideation
7. User
Testing
8.
Conclusions

35. Conclusions
#1 : Games’ difficulty should be easily adaptable to
mental age and progression of children.

36. Conclusions
#2 : Combining face features is more useful for a
controller than using abstract emotion models.

37. Conclusions
#3 : Digital games and controllers are a promising tool
for initiating classroom discussions and reflection.

38. Questions?
we are happy to answer

39. Thank you!
see you at the exhibition