The ARLearn toolkit for mobile serious games and field-trips

20
The ARLearn toolkit for mobile serious games and field-trips dr. Stefaan Ternier Open University of the Netherlands 1 Friday, November 2, 12

Transcript of The ARLearn toolkit for mobile serious games and field-trips

Page 1: The ARLearn toolkit for mobile serious games and field-trips

The ARLearn toolkit for mobile serious games and field-trips

dr. Stefaan Ternier

Open University of the Netherlands

1Friday, November 2, 12

Page 2: The ARLearn toolkit for mobile serious games and field-trips

Augmented Reality=

camera + gps + accelerometer

2Friday, November 2, 12

Page 3: The ARLearn toolkit for mobile serious games and field-trips

Augmented Reality: Locatory

3Friday, November 2, 12

Page 4: The ARLearn toolkit for mobile serious games and field-trips

4Friday, November 2, 12

Page 5: The ARLearn toolkit for mobile serious games and field-trips

Senses

• sight• hearing• taste• smell• touch• balance• ....

5Friday, November 2, 12

Page 6: The ARLearn toolkit for mobile serious games and field-trips

ARLearn: hearing

6Friday, November 2, 12

Page 7: The ARLearn toolkit for mobile serious games and field-trips

7

•Real environment•enriched with virtual objects

•Virtual environment•enriched with virtual objects

Milgram, P. and Kishino, A. F. (1994) Taxonomy of Mixed Reality Visual Displays IEICE Transactions on Information and Systems, E77-D(12), pp. 1321-1329.

Friday, November 2, 12

Page 8: The ARLearn toolkit for mobile serious games and field-trips

ARLearn Architecture– Serious game engine

• Score• Progress• Team play

– Android and streetview clients

– excursions possible– notification framework– Rich media: video, audio,

multiplechoice questions, ...– location based assignments

and triggers Media8

Friday, November 2, 12

Page 9: The ARLearn toolkit for mobile serious games and field-trips

Lifecycle of a media item

9

Invisible

visible

Invisible

dependsOn

disappearOn

Friday, November 2, 12

Page 10: The ARLearn toolkit for mobile serious games and field-trips

ARLearn data model

10Friday, November 2, 12

Page 11: The ARLearn toolkit for mobile serious games and field-trips

ARLearn dependency model

11Friday, November 2, 12

Page 12: The ARLearn toolkit for mobile serious games and field-trips

12

Florence case Amsterdam case Hostage case

Game design

Scavenger game Adventure game Decision game

Delivery Channel

augmented reality augmented virtuality augmented reality

Pedagogic approach

situated learning expository learning learning through decision taking

ARLearn Case studies

Friday, November 2, 12

Page 13: The ARLearn toolkit for mobile serious games and field-trips

Cultural Science Fieldtrip in Florence

13Friday, November 2, 12

Page 14: The ARLearn toolkit for mobile serious games and field-trips

Lessons Learned

• Choose a location for fieldwork with proper GPS reception

• High buildings, narrow streets :(

• Reserve time for users to make themselves acquainted with the smartphone

• Battery life ~ GPS/network operations

• Balance between automatic start and manual start of audiofragments.

14Friday, November 2, 12

Page 15: The ARLearn toolkit for mobile serious games and field-trips

Hostage Simulation: Real World Training for critical situations

15Friday, November 2, 12

Page 16: The ARLearn toolkit for mobile serious games and field-trips

Roles / teams

Head of Office - Security Officer - Staff Welfare

a role is performed by a small group with smartphone.

advance organizer for real drill

take decissions / collaborate

16Friday, November 2, 12

Page 17: The ARLearn toolkit for mobile serious games and field-trips

17Friday, November 2, 12

Page 18: The ARLearn toolkit for mobile serious games and field-trips

18Friday, November 2, 12

Page 19: The ARLearn toolkit for mobile serious games and field-trips

Streetlearn: ARLearn streetview client

• cultural heritage case : Amsterdamse grachtengordel

• Unesco site with 100% google streetview coverage• storyboard based on real historic event:

smuggling marihuana from Libanon in early 1970s• Player takes role of Ada Jobse, a police officer

19Friday, November 2, 12

Page 20: The ARLearn toolkit for mobile serious games and field-trips

Streetlearn: ARLearn streetview client

20Friday, November 2, 12