Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for...

31
© M. Rauterberg, TU/e 2016 1/31 Serious Games for Health - lessons learned - Matthias RAUTERBERG Department of Industrial Design Eindhoven University of Technology The Netherlands Eindhoven University of Technology

Transcript of Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for...

Page 1: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 1/31

Serious Games for Health

- lessons learned -

Matthias RAUTERBERG

Department of Industrial Design

Eindhoven University of Technology

The Netherlands

Eindhoven University of Technology

Page 2: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 2/31 Eindhoven University of Technology

Full Professors of the DI Group

Loe FEIJS, full professor, full time

Bachelor & Master in Electrical Engineering

PhD in Computer Science/Mathematics

Sidarto BAMBANG-OETOMO, full professor, part time

Bachelor & Master in Medicine

PhD in Medicine, specialist in Neonatology

Matthias RAUTERBERG, full professor, full time

Bachelor in Philosophy

Bachelor & Master in Psychology

Bachelor & Master in Computer Science

PhD in Computer Science/Mathematics

Page 3: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 3/31 Eindhoven University of Technology

Rene AHN

Master in Physics

PhD in Computer Science

[until 2014]

Assistant & Associate Professors of the DI Group

Christoph BARTNECK

Master in Technological Design

PhD in Industrial Design

[until 2010]

Emilia BARAKOVA

Master in Electronics and Automation

PhD in Mathematics and Physics

Wei CHEN

Master in Electronics

PhD in Electrical Engineering

[until 2015]

Frank DELBRESSINE

Master in Mechanical Engineering

PhD in Mechanical Engineering

Jun HU

Master in Computer Science

PhD in Computer Science

Erik van der SPEK

Bachelor in Psychology

PhD in Computer Science

Mathias FUNK

Master in Computer Science

PhD in Electrical Engineering

Page 4: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 4/31 Eindhoven University of Technology

Rauterberg M. (2006). HCI as an engineering discipline: to be or not to be!?. African Journal of Information and Communication Technology,

vol. 2, no. 4, pp. 163-184.

Page 5: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 5/31 Eindhoven University of Technology

Hao LIU (PhD)

Chee Fai TAN (PhD)

Page 6: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 6/31 Eindhoven University of Technology

How to get economy class passengers moved?

Westelaken R. van de, Hu J., Liu H., Rauterberg M. (2011). Embedding gesture recognition into airplane seats for in-flight entertainment.

Journal of Ambient Intelligence and Humanized Computing, vol. 2, no. 2, pp. 103-112

Page 7: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 7/31 Eindhoven University of Technology

Heart rate as an indicator of the stress level

Liu H., Hu J., Rauterberg M. (2015). Follow your heart: Heart rate controlled music recommendation for low stress air travel.

Interaction Studies, vol. 16, no. 2, pp. 303-339

Page 8: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 8/31 Eindhoven University of Technology

Adaptive music system for stress free air travel

Page 9: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 9/31 Eindhoven University of Technology

Architecture of our Inflight-Entertainment (IFE) system

Page 10: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 10/31 Eindhoven University of Technology

Test bed for simulating a long haul flight to Shanghai (KLM)

Tan CF., Chen W., Rauterberg M. (2009). Design of aircraft cabin test bed for stress free air travel experiment. In: Proceedings of 5th International

Conference on Planning and Design - ICPD (pp. 157-167), Tainan City, Taiwan.

Page 11: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 11/31 Eindhoven University of Technology

Liu H., Salem B., Rauterberg M. (2009). A survey on user profile modeling for personalized service delivery systems. In: Proceeding of IADIS

International Conference on Interfaces and Human Computer Interaction 2009 (pp.45-51), Lisbon: IADIS Press.

Liu H., Hu J., Rauterberg M. (2010). LsM: A new location and emotion aware web-based interactive music system. In: IEEE International Conference

on Consumer Electronics - ICCE 2010 (Digest of Technical Papers; pp.253-254), Piscataway: IEEE.

Liu H., Hu J., Rauterberg M. (2010). iHeartrate: A heart rate controlled in-flight music recommendation system. In: E. Barakova, B. de Ruyter, and A.

Spink (eds.) Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research - MB 2010. (Article 26 , 4 pages,

online), New York: ACM.

Page 12: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 12/31 Eindhoven University of Technology

Page 13: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 13/31 Eindhoven University of Technology

Page 14: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 14/31 Eindhoven University of Technology

Examples of the bio-signal heart rate reactions

Page 15: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 15/31 Eindhoven University of Technology

Results of the bio-signal heart rate are significant in the

hypothesized direction

Page 16: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 16/31 Eindhoven University of Technology

Expertise Center for Epileptology, Sleep Medicine and Neurocognition

TIMO:

a diagnostic game

for ADHD Pongpanote GONGSOOK (PhD)

Page 17: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 17/31 Eindhoven University of Technology

Sallustro C. (2013). Timo & Friends: A diagnostic tool on the time perception of children with ADHD. USI Final Report No 978-90-444-1220-8,

Department of Industrial Design, Eindhoven University of Technology (32 pages).

Page 18: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 18/31 Eindhoven University of Technology

Gongsook P., Peijnenborgh J., Sallustro C., Van der Spek E., Hu J., Bellotti F., Rauterberg M., Hendriksen J. (2014). A diagnostic tool on time perception of children

with ADHD. In: A. De Gloria (ed.), Games and Learning Alliance (Lecture Notes in Computer Science, vol. 8605, pp. 400–405), Berlin Heidelberg: Springer.

Page 19: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 19/31 Eindhoven University of Technology

Mini game 1:

Dressing up

GOAL: Executive function.

REASON: Executive functions,

which include planning and

organization, are deficient in

children with ADHD.

Mini game 2:

Making sandwiches

GOAL: Remember set of items.

REASON: The working memory

in children with ADHD is

remarkably low.

Page 20: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 20/31 Eindhoven University of Technology

Mini game 3:

Cross a river with a balloon

GOAL: The child has to estimate how

long 10 seconds last.

REASON: Temporal durations are

deficient in children with ADHD.

Mini game 4:

Defeat a naughty monkey

GOAL: Response inhibition.

REASON: Withhold response with

Go/No-Go signals.

Page 21: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 21/31 Eindhoven University of Technology

Mini game 5:

Catch stars in the magic land

GOAL: Motor reaction after warned

signals.

REASON: Slower and more

variable reaction times have been

found for ADHD children.

Mini game 6:

Waiting for the rocket

GOAL: Waiting behavior. The

influence of high rewards valued

for delaying decisions.

REASON: Based on the

hypothesis that attention deficits

are related to an ineffectiveness

of delayed reinforcement.

Page 22: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 22/31 Eindhoven University of Technology

30 minutes

User Interaction Logging

Mini game 1 Transition Mini game 2 Transition Mini game 6

Main Title

Data

Configuration

Main

Ending

Introduction / Demonstration

Game Plays

Ending / Wrapping up

Idle Checker

End-of-time Checker

4 minutes (240 seconds)

Game structure and interaction flow

Page 23: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 23/31 Eindhoven University of Technology

startstart

Game Updates

(fps)

Game started

Write to AllTouches

endendGame ends

User intervention Game relateWrite to

Game Play

Write to Specific Objects

Distractors relate(touched)

Game Events logging

Non-User interventionGame relate

Distractors relate(played)

Data logging structure

Page 24: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 24/31 Eindhoven University of Technology

Page 25: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 25/31 Eindhoven University of Technology

ADHD

Predicted Group Membership

Total

No Yes

Count No 84 2 86

Yes 11 10 21

% No 97.7 2.3 100.0

Yes 52.4 47.6 100.0

87.9% of original grouped cases correctly classified.

97,70%

2,30%

Control

No-ADHD ADHD

52,40%

47,60%

ADHD

No-ADHD ADHD

Results of the behavior based parameters

Page 26: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 26/31 Eindhoven University of Technology

General Hospital

Simulation for Team Training

Van de Ven J., Houterman S., Steinweg R. A., Scherpbier A. J., Wijers W., Mol B. W. J., & Oei S.G. (2010). Reducing errors in health care: cost-

effectiveness of multidisciplinary team training in obstetric emergencies (TOSTI study); a randomised controlled trial. BMC Pregnancy and

Childbirth, 10, 59 (online).

Fransen A., van de Ven J., Merie´n A., de Wit-Zuurendonk L., Houterman S., Mol B., Oei S.G. (2012). Effect of obstetric team training on team

performance and medical technical skills: a randomised controlled trial. BJOG An International Journal of Obstetrics and Gynaecology, vol.119, no.

11, pp. 1387–1393.

Han J., de With P.H.N., Merien A., Oei S.G. (2012). Intelligent trainee behavior assessment system for medical training employing video analysis.

Pattern Recognition Letters, vol. 33, no. 4, pp. 453-461.

Page 27: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 27/31 Eindhoven University of Technology

Hu J., Peters P., Delbressine F. and Feijs L. (2010). Distributed architecture for delivery simulators. In: Proceedings of International Conference

on E-Health Networking, Digital Ecosystems and Technologies (EDT) (Shenzhen, pp. 109-112) IEEE.

Page 28: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 28/31 Eindhoven University of Technology

Page 29: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 29/31 Eindhoven University of Technology

Work in progress

Mark TIELEN (PhD candidat)

Page 30: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 30/31 Eindhoven University of Technology

What are the lessons learned?

1. Mixed design teams with all required expertise are essential.

2. Full circle of design-prototyping-validation works.

3. The domain problem becomes the END, and the technology

a MEAN.

4. Collaboration, cooperation, communication.

5. Public attention helps to secure funding.

6. And finally: success has many fathers/mothers …

Page 31: Serious Games for Health - Eindhoven University of Technology · 2020. 6. 8. · Serious Games for Health Author: Matthias Rauterberg Subject: invited XOOTI lecture 2005 Created Date:

© M. Rauterberg, TU/e 2016 31/31 Eindhoven University of Technology

Thank you for your attention.

TC

14 o

n E

nte

rtain

men

t C

om

pu

tin

g