This document discusses integrating assessment into 3D virtual worlds using the Open Wonderland platform and the IMS Question and Test Interoperability (QTI) specification. It presents a Wonderland-QTI engine that allows loading QTI-defined questions and managing student responses and scores. Questions are represented using objects in Wonderland. The engine uses NewAPIS to manage tests and questions from QTI files and Wonderland to relate question parts to virtual world objects. Future work includes supporting more question types and an authoring tool.

1. ASSESSMENT IN 3D
VIRTUAL WORLDS:
QTI IN WONDERLAND
Diego Morillo Arroyo, Patricia Santos Rodríguez
David Pérez Calle, Carlos Delgado Kloos
María Blanca Ibáñez Espiga, Davinia Hernández-Leo

2. INDEX
1. Introduction
2. 3D Assessment
3. Including assessment in Open
Wonderland
4. The Wonderland-QTI engine
5. Conclusion and future work
2

3. INDEX
1. Introduction
2. 3D Assessment
3. Including assessment in Open
Wonderland
4. The Wonderland-QTI engine
5. Conclusion and future work
3

4. INTRODUCTION
 3D virtual worlds:
 Simulation of immersive environment
 Users are represented by avatars
 Interaction among users
 Interaction with objects
 Virtual worlds lacks of some learning elements:
 Learning objects
 Instructional design
 Intended learning outcomes
 Management of roles
 Assessment
4

5. INDEX
1. Introduction
2. 3D Assessment
3. Including assessment in Open
Wonderland
4. The Wonderland-QTI engine
5. Conclusion and future work
5

6. 3D ASSESSMENT(I)
 New mechanisms for assessment are necessary
 Virtual worlds allow the assessment of knowledge and
competences
 The user’s attention must be maintained (flow) 
Embedded assessment
6

7. 3D ASSESSMENT (II)
 Different virtual worlds have been used to asses
students:
 River City
 Quest Atlantis
 Second Life  quizHUD
7

8. INDEX
1. Introduction
2. 3D Assessment
3. Including assessment in Open
Wonderland
4. The Wonderland-QTI engine
5. Conclusion and future work
8

9. ACTIONS: PROMPT
 It can be showed in different
ways:
 A text message
 Talk with a NPC (AIML)
 An audio message
 Students can do several actions to get the instructions:
 Approach to a NPC
 Select a NPC
 Select an object
 Access to a zone
9

10. ACTIONS: ANSWER
 Students can do several actions:
 Select an element in the virtual world
 NPC
 Object
 Zone
 Talk with a NPC (AIML language)
 The different options among student
have to choose can :
 Be visible all the time
 Appear when students get the instructions
 Disappear when students give their answer 10

11. ACTIONS: FEEDBACK
 Different types of feedback:
 Question’s feedback
 A text message
 Insert an image
 An object can appear
 An object can disappear
 Play an audio file
 Test’s feedback
 Students receive their feedback and their final score
11

12. HELP SYSTEM
 The time between the answer of a question and the
beginning of the next one must be reduced
 A track can be added to every question  It is used to
guide students toward the next question
 Students use the menu bar to access to the track
12

13. INDEX
1. Introduction
2. 3D Assessment
3. Including assessment in Open
Wonderland
4. The Wonderland-QTI engine
5. Conclusion and future work
13

14. FEATURES
 Questions are loaded from external files
 The files are defined following the IMS QTI
specification
 This engine implements questions of the “multiple-
choice” type
 This engine is formed by:
 NewAPIS
 Open Wonderland 14

15. NEWAPIS
 QTI engine v2.1
 Management of test
 Management of questions
 It loads the QTI XML files
 It manages the students’ answer
 It stores all the assessment data, checks the answer of the
students and calculates their scores
15

16. OPEN WONDERLAND (I)
 Open Source
 It is written entirely in Java
 It is a distributed client-server architecture
 A WebDav-based content repository is hosted in the server
 Its functionality is divided in different modules
16

17. OPEN WONDERLAND (II)
 Main features:
 It supports desktop application sharing
 Integration with external data sources
 It has spatial sound capabilities
 It allows the communication among students
 Chat
 Audio
 Different users can see different objects
17

18. THE EXTENSION OF QTI (I)
 Virtual worlds introduce new interactions that there
are not considered in QTI
 This engine use two files:
 QTI XML file
 It is managed by newAPIS
 WL-QTI XML file
 It is managed by Wonderland
 It relates every part of a question with the corresponding object in
the virtual world
 It includes additional information
18

19. THE EXTENSION OF QTI (II)
19

20. COMMUNICATION
20

21. INDEX
1. Introduction
2. 3D Assessment
3. Including assessment in Open
Wonderland
4. The Wonderland-QTI engine
5. Conclusion and future work
21

22. CONCLUSION
 Virtual worlds allow the assessment of students in a
richer way
 The use of the IMS QTI specification allows:
 Reuse of existing assessment content
 Use an existing QTI engine that can manage the actions
that are not directly related with the virtual world
22

23. FUTURE WORK
 Include new types of questions  It allows the
management of new interactions in the virtual world
 Improve the management of test
 Create an authoring tool to create the WL-QTI files
 Add different capabilities for objects in the virtual
world by processing the WL-QTI file
 Use this assessment engine in a real education
context
23

24. DEMO
You can see it in:
http://www.youtube.com/watch?v=3zVyPT3oh4E
24