Bill KapralosUniversity of Ontario Institute of Technology

Oshawa, Ontario, Canada.Bill.Kapralos@uoit.ca

Before We Start (1):

Would Like to Acknowledge my Grad Students Carrying out the Work I Will Describe

Brent Cowan (PhD)

David Rojas (PhD)

Zain Khan (MSc)

Robert Shewaga (MSc)

Overview of My Work (1):My Research is Centered on Two Themes

Serious gaming

Health professions education

Exergaming → rehabilitation

Spatial sound for virtual environments and games

Sound is an important modality often overlooked!

Large opportunities for sound in NEUROGAME 2!

My research objectives → development of multi-modal virtual environments/serious games that maximize knowledge transfer and retention

This ultimately connects my two research themes

Overview of My Work (1):Serious Game Development → Interdisciplinary

I work closely and collaborate with colleagues across a variety of disciplines across Canada and internationally both at the academic and industry levels

Medical experts → surgeons, anesthesiologists, nurses, doctors, rehab experts, psychiatrists, etc.

Health professions education experts

Computer scientists, engineers, game developers

Some Examples of MyOwn Serious Games

Power Defense (1):Serious Game For Diabetes Numeracy

Aimed at improving numeracy in adolescents with T1D

Developed with endocrinologists (Ereny Bassilious and Farid Mahmud) from the Hospital for Sick Children

Based on the popular tower defense subgenre of real-time strategy games → implicit and explicit learning

Two stage testing“Alpha” testing to examine user interface

Pre- and post-testing to examine effectiveness

Exergaming with Spincore (1):Exergame to Promote Rehabilitation

Developed several Kinect-based exergame prototypes whose game play mechanics focus around the SpincoreHelium 6 rehabilitation device (baton)

Provides increased motivation and engagement for users of the device

Often, exercise and rehabilitation routines are not followed through as users lose motivation quickly

Cultural Competence Serious Game (1):Aimed at Healthcare Providers and Trainees

Variety of realistic culturally sensitive scenarios can be easily simulated within complex narrative context

Examining role of emotion modeling and detection → eye tracking technologies

On going work but a prototype has been developed

Focus is on scenario editor → apply to other (non-medical) applications

The TKA (“Knee”) Serious Game (1):Serious Game for Total Knee Arthroplasty(TKA) Procedure Education

Interactive and multi-player → provides residents knowledge about steps comprising the TKA procedure

Goal is for the trainee is to successfully complete the TKA procedure focusing on the procedure itself

Focus on the ordering in which steps are performed and on the tools required to perform each step as opposed to the technical aspects of the procedure

The SCETF (1):Serious Game Surgical Cognitive Education and Training Framework (Under Development)

Domain-specific surgical modules built on top of existing framework utilizing common simulation elements/assets

Graphical and spatial sound rendering engines

Scenario editor

Research tool

Various simulation parameters easily modified → test effect of altering these parameters on learning

Additional Research (1):Many Open Questions with SGs

How much fidelity do we need → “perfect” fidelity is impossible to achieve, at least with current technology

What effect does stereoscopic 3D have ?

Uncanny valley?

Olfactory sense can’t be currently “replicated” virtually

How does multi-modal cues affect learning ?

Which rendered version is better?

Additional Research (2):Cognitive load

Assessment of mental workload expended by learner

Measured via physiological changes, dual-task performance, or subjective rating

Commonly used for comparative research in instructional design

Patient monitor embedded in a

virtual OR

Additional Research (3):Educational Social Network for Older Adults

Working with doctors specializing in geriatrics from Women’s College Hospital to develop and a social networking site for the adults 80+

Have completed a needs and task analysis and currently have started preliminary development

How I Can Fit Into NEUROGAME 2 (1):Extensive Gaming Experience

Work with many researchers and medical practitioners

Have an extensive code and asset base

Have led many interdisciplinary serious gaming projects

Have designed/developed and taught various serious gaming and virtual sim courses

Interested in examining factors that will lead to effective serious games

Multi-modal environments → its not only about graphics!

What role does sound play in rehabilitation and cognitive development ?