ASSESSMENT IN 3D VIRTUAL WORLDS:

QTI IN WONDERLAND

Diego Morillo Arroyo, Patricia Santos Rodríguez

David Pérez Calle, Carlos Delgado Kloos

María Blanca Ibáñez Espiga, Davinia Hernández-Leo

INDEX

1. Introduction

2. 3D Assessment

3. Including assessment in Open Wonderland

4. The Wonderland-QTI engine

5. Conclusion and future work

2

INDEX

1. Introduction

2. 3D Assessment

3. Including assessment in Open Wonderland

4. The Wonderland-QTI engine

5. Conclusion and future work

3

3D virtual worlds:

Simulation of immersive environment Users are represented by avatars Interaction among users Interaction with objects

Virtual worlds lacks of some learning elements:

Learning objects Instructional design Intended learning outcomes Management of roles Assessment

INTRODUCTION

4

INDEX

1. Introduction

2. 3D Assessment

3. Including assessment in Open Wonderland

4. The Wonderland-QTI engine

5. Conclusion and future work

5

3D ASSESSMENT(I)

6

New mechanisms for assessment are necessary

Virtual worlds allow the assessment of knowledge and competences

The user’s attention must be maintained (flow) Embedded assessment

3D ASSESSMENT (II)

7

Different virtual worlds have been used to asses students:

River City Quest Atlantis Second Life quizHUD

INDEX

1. Introduction

2. 3D Assessment

3. Including assessment in Open Wonderland

4. The Wonderland-QTI engine

5. Conclusion and future work

8

ACTIONS: PROMPT

9

It can be showed in different ways:

A text message Talk with a NPC (AIML) An audio message

Students can do several actions to get the instructions: Approach to a NPC Select a NPC Select an object Access to a zone

ACTIONS: ANSWER

10

Students can do several actions:

Select an element in the virtual world NPC Object Zone

Talk with a NPC (AIML language)

The different options among student have to choose can :

Be visible all the time Appear when students get the instructions Disappear when students give their answer

ACTIONS: FEEDBACK

11

Different types of feedback:

Question’s feedback A text message Insert an image An object can appear An object can disappear Play an audio file

Test’s feedback Students receive their feedback and their final score

HELP SYSTEM

12

The time between the answer of a question and the beginning of the next one must be reduced

A track can be added to every question It is used to guide students toward the next question

Students use the menu bar to access to the track

INDEX

1. Introduction

2. 3D Assessment

3. Including assessment in Open Wonderland

4. The Wonderland-QTI engine

5. Conclusion and future work

13

Questions are loaded from external files

The files are defined following the IMS QTI specification

This engine implements questions of the “multiple-choice” type

This engine is formed by:

NewAPIS Open Wonderland

FEATURES

14

QTI engine v2.1

Management of test Management of questions

It loads the QTI XML files

It manages the students’ answer

It stores all the assessment data, checks the answer of the students and calculates their scores

NEWAPIS

15

Open Source

It is written entirely in Java

It is a distributed client-server architecture

A WebDav-based content repository is hosted in the server

Its functionality is divided in different modules

OPEN WONDERLAND (I)

16

OPEN WONDERLAND (II)

17

Main features:

It supports desktop application sharing Integration with external data sources It has spatial sound capabilities It allows the communication among students

Chat Audio

Different users can see different objects

Virtual worlds introduce new interactions that there are not considered in QTI

This engine use two files:

QTI XML file It is managed by newAPIS

WL-QTI XML file It is managed by Wonderland It relates every part of a question with the corresponding

object in the virtual world It includes additional information

18

THE EXTENSION OF QTI (I)

19

THE EXTENSION OF QTI (II)

COMMUNICATION

20

INDEX

1. Introduction

2. 3D Assessment

3. Including assessment in Open Wonderland

4. The Wonderland-QTI engine

5. Conclusion and future work

21

Virtual worlds allow the assessment of students in a richer way

The use of the IMS QTI specification allows:

Reuse of existing assessment content Use an existing QTI engine that can manage the

actions that are not directly related with the virtual world

CONCLUSION

22

Include new types of questions It allows the management of new interactions in the virtual world

Improve the management of test

Create an authoring tool to create the WL-QTI files

Add different capabilities for objects in the virtual world by processing the WL-QTI file

Use this assessment engine in a real education context

FUTURE WORK

23

DEMO

24

You can see it in:

http://www.youtube.com/watch?v=3zVyPT3oh4E