Virtual Simulations for Soldiers: Concepts and Applications

Dr. François Bernier

Defence Scientist

Defence R&D Canada

September 21-22, 2010

Château Cartier

Gatineau, Que.

Soldier Systems Technology Roadmap Human and Systems Integration Workshop

• Virtual simulation and immersion• Laboratories in DRDC Valcartier• Stressful virtual environment• Medics and IBTS training• Conclusion

OUTLINEOUTLINE

(Immersive) Virtual Simulations

Desktop

CAVELarge screen

• Definition: real people using simulated equipment in a (immersive) simulated world/virtual environment

• The technological landscape is diversified

Static HMDMobile HMD (FITE)

What does Immersive Mean ?

Level 1: inside

Level 2: inside + perspective

Level 0: outside

Level 3: inside + perspective + stereo

Video

• Flexible multi-screen visualization infrastructure for exploitation and integration of virtual reality and simulation technologies;

• Immersive, collaborative, interactive visualization approach in support of complexity-characterized applications;

• Realistic environment for training and experimentation.

Exploration of video games and emerging technologies (D&S)• Gaming genres & mechanics;• Visualization & interaction techniques;• Software development tools;• Emerging display & interaction technologies.

Stressful Virtual Environment (SVE)• SVEs are required in many applications• Stress management training is one example

Reduce negative reactions to stress Improve operational effectiveness Potentially protect against psychological injuries

• Stress coping techniques must be practiced SVE

Electrocardiogram

Electrodermal activity

Physiological ArousalStressors

Coping Strategies

Virtual Environment

Arousal

Valence

high

positive

low

negative

Fear-Panic Exaltation

BoredomMeditation-happiness

How to Create a SVE (1/2) ?

• Use stressors found in theatre

*Raw data from CF Land Personnel Concept and Policies Office

Combat-related stressors experienced in Afghanistan (CF)

How to Create a SVE (2/2) ?Tangible

Intangible

Approach 1: Graphic Quality

Virtual Battlespace 2 (2007)Virtual Battlespace 2 (2007)

Unreal Tournament 2004Unreal Tournament 2004

Far Cry 2 (2009)Far Cry 2 (2009)Far Cry 2 (2009)Far Cry 2 (2009)

Unreal Tournament 3 (2007)Unreal Tournament 3 (2007)

Arma 2 (2009)Arma 2 (2009)

Approach 2: Immersion and VG

22” 3D LCD 73” 3D TV CAVE

Immersion & Price

CAVE73" 3D-Ready TV

Handheld22" 3D Ready LCD

• What level of immersion is sufficient?• Does the type of video game matter?• We exposed 56 soldiers to various virtual environments

(2 video games x 3 immersive technologies)

• Result: All virtual environments are “equally” stressful

Approach 3: Suffering Avatar• Could we elicit stress with a virtual

character of a known person (avatar) experiencing pain ?

• 42 civilians has been exposed (in a 6-side CAVE-Like system) to familiar and unfamiliar avatars

• Suffering Yes• Known Not yet

6-side CAVE-Like (UQO)

Training: Medic in a Combat Context• An immersive virtual simulation (CAVE) could provide a

realistic operational context for combat medic training

Training: IBTS• Benefits of immersion for training IBTS

(in support of a Applied Military Science Project - Kingston)

• Detachment level training : 1 CAVE + 4 Desktops• Mission: IED identification & vehicle checkpoint

Training: IBTS• Fully immersive simulator tends to achieve training objectives

slightly better than the desktop immersive simulator• Minor technological deficiencies identified• Integration of cognitive, physical and affective aspects

(e.g.: crouching when shot)• Familiarization faster than with desktop• Less a game than a real training environment• Tiring but motivating• Able to cause information overload

Conclusion

Summary• Immersive virtual environments can provide a realistic,

interactive and engaging synthetic battlefield to the soldier

• There is not universal/common technology for all applications

• We now better understand how to create SVE

Challenges• Lack of integration with the current CF training environment

• Many benefits of immersive virtual environments remain to be identified

• The cost is still an issue

Questions?

Dr. François Bernier – Defence ScientistDefence R&D Canada - Valcartier

(418) 844-4000 (4346) Francois.bernier@drdc-rddc.gc.ca