Dr Alasdair G Thin BSc, PhDHeriot-Watt University, Scotland

SFX Physiology: "Everything you always wanted to know about biofeedback* *BUT WERE AFRAID TO ASK"

USC School of Cinematic Arts, May

17th, 2011

When...

& ♀♂

Better Game Play - History

http://gadgets.boingboing.net/2008/05/15/from-atari-joyboard.html

Vicarious Experiences

I Grew Up with Video Games...

Front ViewMap View

NorthControl 1/15

Range 150Level

Fatigue

Heart Rate

Breathing

Effort

Speed

Cadence

OrienteeringSimulator™

Breathless Encounter with Eyetoy...

Made some Energy Expenditure Measurements...

http://www.time.com/time/magazine/article/0,9171,1661688,00.html

And the Rest is history...

Energy Expenditure- (Calorie burn)

http://www.physoc.org/custom2/publications/proceedings/archive/article.asp?ID=Proc%20Life%20SciencesPC438

The Problem with Computers...

“There is not enough Africa in computers”

(Brian Eno, 2004)

Workouts & Leisure Time...

“The problem with workouts is that there is not enough Captin Megajuice in them...”

Which had most impact on Guitar sales?

$50M

Gibson Digital Guitar

$1M

Guitar Hero

Which will have most impact on Sports/Exercise?

$860M

2012 London Olympics

<<<$860M

Exergaming

Game-based Paradigm Shift

Persuasive Message (“Exercise is Good for You!”)

Perceived Future Reward

Persuasive Interactive Experience

Immediate Real Reward

Health Action Model

Behavioral Intention

Normative System

Cognitive Affective

Decision

(Tones, 1987)

Health Agencies Getting Interested?

http://www.nytimes.com/2007/04/30/health/30exer.html

http://news.bbc.co.uk/1/hi/health/7262770.stm

Who is Setting the Agenda??

http://www.touchgenerations.com http://myhealthcoach.uk.ubi.com/

personalized health program

fun incentive

physical challenges

also features trivia games, hints and tips

learn everything you need to know about proper nutrition and working out

Resource Optimisation Game

≤ 24

chotda

Health Games - Treatment

Health Games - Prevention

The Magic Circle of Games

antonioperezrio.es

“...the consequences of the activity are negotiable” (Juul, 2005)

Games as:“Cognitive-Emotional Integration Engines”?

Storytelling a significant feature of human culture

Meaning making is important in Health and Wellbeing (Narrative Medicine)

Games could help in health and wellbeing “Meaning Making” process

Hamlet on the Holodeck

“To rival the narrative richness of other media, then, a system of interactive storytelling must be able to stage both physical actions that change the fictional world and verbal acts that affect the minds of its inhabitants and motivate them to take action.”

(Ryan, 2009)

The Interactive Paradox

(Aylett & Louchart, 2004)

Integration of the unpredictable, bottom-up input of the user into a sequence of events that fulfills the top-down design conditions of narrativity

“On one hand the author seeks control over the direction of a narrative in order to give it a satisfactory structure. On the other hand a participating user demands the autonomy to act and react without explicit autho- rial constraint.”

Meat Machines?

Are you a Thinking person who Feels? ...

or a Feeling person who Thinks?

Physiological Computing - Categories

Biofeedback

Biocybernetic adaptation

Brain–computer interfacing

Biofeedback

the controller of a system can control a given variable if information about that variable is made available to it

notion of humans being able to exert conscious influence over seemingly unconscious physiology

i.e. increasing “body awareness” - interoception

more highly developed in performers, kinaesthetic learners, artists?

Biofeedback examples

Biocybernetic Adaptation

Biocybernetic adaptation refers to the modification of system’s functionality or appearance based on the real-time measurement of psychophysiology.

Not biofeedback

Rather an adaptive system that responds to user’s changing psychophysiological state

e.g. fatigue, frustration

Game Adaptation example

Brain–computer interfacing

Channels for direct command and communication between psychophysiology and an output device (e.g. control of a cursor)

Main focus of BCI research has been to develop systems to help people with disabilities (e.g. spinal cord injuries)

Issues

extended training times

need to sit style - movement artifacts

BCI examples

www.makeahistory.com/index.php/your-details/222-the-worlds-first-commercial-brain-computer-interface-

Potential Physiological Variables

Outer surface of the Brain (electroencephalogram: EEG)

Skeletal Muscles (electromyogram: EMG)

Heart (electrocardiogram: ECG)

Eyes (electro-oculogram: EOG, pupillometry: eye tracking)

Blood pressure

Respiratory patterns

Skin conductance (galvanic skin response: GSR)

Platform + Sensors

“Cheaper” kit

Do No Harm...

Be Safe (Electrical Safety, Tripping Hazards)

Don’t screw up your subjects (players)

Mrs Inman

Make Sure you have Quality Data

Don’t Forget “In Game” Data - i.e. Reaction Times

Caution...Intentions...Control...•“The philosophy of this new approach is principally concerned with machine perception of users’ affective reactions.

•Assumption that users respond to content and events occurring during human–computer interaction, and that the machine detects these responses and adapts its behaviour accordingly.

•This may be making the mistake of assuming the machine is in charge.

•It can be argued that this is not how emotion operates in the real world. In human– human interaction, affect has an intentional communicative function.”

(Ward & Marsden, 2004)

Historical - Kunstphysiologie

Physiological Aesthetics

By the 1870s the new field of ‘physiological aesthetics’ burgeoned in pockets across Europe and North America, aiming, to ‘elucidate physiologically the nature of our Aesthetic Feelings’ and ‘to exhibit the purely physical origin of the sense of beauty, and its relativity to our nervous organization’.

For many physiologists, the new evolutionary accounts of sensory functions suggested fresh possibilities for education of artists and artisans.

(Allen, 1877)

Physiologically Informed Art

Used Aesthetic Protractor - “pleasurable angular distances”

Science Fiction?

21st Century Reality

Techno-Sublime: Post-Aesthetic?

Interactive Media

Observer becomes a Performer

“Engagement can give rise to experiences of immersion in immediate sensation” (Bolt, 2007)

“Critical Distance” (of traditional aesthetics) is lost

Move towards appreciation of the “Immediacy of Sensation”

When...

& ♀♂

Convergence...Exciting!

Interactive Media

Performance Art

Modern Dance

Play

Games

Sports Performance

Inter-Connected Triad

Reality (Model)

Play (Experience)

Meaning (Effect)

Triadic Game Development (Agile Methodology)

triadicgamedesign.com

Changing Approaches to Public Health

Supportive “Virtual” Environments?

Compared to Physical Environments:

Readily developed

Lower cost

Scaleable to population level

Drivers

Consumer Technology Expectations

New Non-traditional forms of gaming

New body movement sensors and controllers

Increasing Mobile Functionality

US Physical Activity Strategy

- “Encourage...health e-games manufacturers...”

Commercial Interest in Wellness

Maximising Opportunities

Experience Creation

Integrated Design Approach

Informed Wellness Behaviour Perspective

Seamless Data Capture

Social Media Linkage

Cross-generational Game Play

Scaleability, Perceived Value, Pricing & Affordability

Potential Persuasive Features of Exergames

Degree of authority

Develops skills

Exercise more accessible

General exercise tips

Helpful suggestions

Monitors usage

Negative feedback

Positive experience

Positive feedback

Praises the player

Progress chart

Reflects the player

Rewards progress

Tailors exercise

Visually attractive

Exergame Design Issues

Overall game difficulty

Game level

Skill of player

Postural balance

Hand-Eye coordination

Limit to arm waving

Exergames are Not All Equal in EE

Muscle Mass

Energy Expenditure

Frequency

2-3 METs

3-6 METs

6+ METs

Exergame Game Design Principles

Maximise Muscle Mass

Rapid Movement

Spatial rather than Temporal Accuracy

Minimise Negative Scoring

Next Steps

Reflect on Personal Wellbeing Issues

Try Out Products/Services & Evaluate Experiences

Think about Ways to Improve

Talk with Health Professionals about Wellbeing

- Issues? ++Interest in Games

Talk with “Techies” about Wellbeing

- Issues? ++Interest in Wellness (befitwithbiray.com -SXSW)

Network

Have Fun!

www.wellnesshealthinnovation.org

Game Over