User interaction concepts in smart caring homes for elderly with chronic condition

Cristian-Dan Bara , Miriam Cabrita, Harm op den Akker and Hermie J.Hermens

1

User interaction concepts in smart caring homes for elderly with chronic conditionIntroduction

Ageing implies cognitive and physical changes:• muscle and bone weakness• balance difficulties• audio and visual problems

Functional decline directly affects independent living

In the Netherlands, it is projected that 50% of the increase in health care costs, in 2040, will be due to the increase in the elderly population.

(van Rooijen, M., Goedvolk, R., Houwert, T.: A vision for the Dutch health care system in 2040: Towards a sustainable, high-quality health care system. World Economic Forum, McKinsey & Company,2013)

2

RRD

Dean BradsahawGolden Years (detail)Nov, 2014

User interaction concepts in smart caring homes for elderly with chronic conditionIntroduction

Smart caring homes - support independent living by offering specialized ICT services for self-management of the user’s health and wellbeing at their home.

Aims:• prolongation of user’s functional

capacity• increased autonomy• prolonged participation to society• delay in institutionalization

3

Patricia MafraEnergyMar, 2015

RRD

User interaction concepts in smart caring homes for elderly with chronic conditionBackground

Two human - computer interaction paradigm implementation trends:

• intrusive mobile ICT assistants (robots)• passive static/fixed controllers (one central hub to control

the smarthome)

4

RRD

intrusive technology• advantages

• always in the user’s proximity (easy to reach)• demands user interaction

• disadvantage• may promote sedentary behaviour (in some cases,

users will have significant effort reduction in performing daily tasks)

• may need constant user adaptation (when it’s functionality is extended/updated)

User interaction concepts in smart caring homes for elderly with chronic conditionBackground

5

ALDEBARANThe NAO robot

RRD

fixed technology• advantages

• minimal user adaptation to the presence of technology• the user is in control

• disadvantage• may not cover the complete sphere of daily life activities

of the user (interaction may be perceived as a part of the user’s activities, optional in some cases)

• may strictly define the space of interaction

User interaction concepts in smart caring homes for elderly with chronic conditionBackground

6

ITTS - Remote exercise class for rehabilitation

https://nest.com/

RRD

User interaction concepts in smart caring homes for elderly with chronic conditionApproach

How can we implement a smart caring home which facilitates easy, reliable, contextualized access to healthcare services, is self-empowering, promotes independent living, is always reachable and can direct its user to follow healthy living guidelines set up by formal caregivers?

We’d like to contextually monitor the user’s health, coach for healthy living and offer health care support.

7

RRD

User interaction concepts in smart caring homes for elderly with chronic conditionApproach

We are using our infrastructure as a service.

8

RRD

User interaction concepts in smart caring homes for elderly with chronic conditionApproach

We divided our interaction space between the home environment ...

9

RRD

User interaction concepts in smart caring homes for elderly with chronic conditionApproach

We divided our interaction space between the home environment and the outdoor environment.

10

RRD

User interaction concepts in smart caring homes for elderly with chronic conditionApproach - “at home” interaction paradigm

The installation should blend with the home environment

11

Feedback devices should have a strong presence (we used a large touch screen)

Using the system should focus the user towards the usage task (dedicated interaction space)

The system should offer meaningful information whether, or not is being used (we explore proxemic interaction paradigms to determine intention of use based on the user-screen distance).

https://www.youtube.com/v/mFB5aZR0OWg

RRD

User interaction concepts in smart caring homes for elderly with chronic conditionApproach - “at home” interaction paradigm

When not in use: the screen shows widgets with weather and physical activity information and advertises for healthy living. The advertisements are tailored to the user’s preferences.

12

When in use: the screen allows for interaction with a large touch enabled surface for browsing through monitoring data, launching video based coaching applications, contacting caregivers, playing cognitive training games, monitoring the state of the connected domotics.

In both cases: a smart notification system will inform the user about an immediate event which requires immediate action, e.g: an alarm will instruct the user to take necessary action for avoiding dangerous situations, a reminder will call for system use, or stimulate a wellbeing action.

User interaction concepts in smart caring homes for elderly with chronic conditionApproach - “outdoors” interaction paradigm

A large part of life situations happen outside of the home environment.

The system offer contextualized feedback in the outdoor situation (counting physical activity, giving fast access to contacting caregivers, offering directions for upcoming appointments)

13

RRD

User interaction concepts in smart caring homes for elderly with chronic conditionMethod

We started with a study of the target users● primary users: elderly with age related impairment,

COPD, mild dementia;● secondary users: friends & family (informal caregivers),

professional care practitioners (formal caregivers).

14

RRD

User interaction concepts in smart caring homes for elderly with chronic conditionMethod

15

Elderly with age related impairments (ARI)

Michael, 67, maleDomestic situation Living at home with

wife (Maria)

Issues Hypertension, Forgetfulness, Social Anxiety, Lack of Motivation, Social Isolation, Experience with modern technology

Simone, 72, femaleDomestic situation Lives alone, son lives

far away

Issues Reduced mobility, Social isolation, Hypertension, High cholesterol, No experience with modern technology

COPD Potential users

Petra, 49, femaleDomestic situation Married with 2

children, lives with husband and one daughter

Issues COPD Stage 2, Overweight, Heavy smoker, Can’t commit to physical rehabilitation programs, Experience with modern technology

Bob, 65, maleDomestic situation Lives alone

Issues

COPD Stage 3, Ex-Smoker, Underweight, Hearing problems, Has trouble sleeping, No experience with modern technology

Elderly with Mild Dementia (MD)

Jane, 74, femaleDomestic situation Lives alone

Issues Cognitive decline, Memory deficits, Sleeping problems, Anxiety, Avoid social contact,No experience with modern technology

Philip, 66, maleDomestic situation Live with his younger

sister (Theresa)

Issues Suffered a stroke, Vision problems, Gaps in working memory, Social isolation, Low physical activity, Experience with modern technology

RRD

User interaction concepts in smart caring homes for elderly with chronic conditionMethod

The system targets 3 main service categories:• monitoring: sensing, reasoning and keeping track of data relevant to the

primary user chronic condition, in the context of their daily life activities

• coaching: for maintaining control over the state of the chronic condition with two main purposes: increasing robustness (through video guided physical exercises, notifications which stimulate outdoor physical activity) and expanding the body’s adaptive capabilities (video guided breathing exercises, cognitive training)

• healthcare support: enables communication with caregivers through various channels.

16

RRD

User interaction concepts in smart caring homes for elderly with chronic conditionConclusion

At home● the system should provide rich interaction which can last for long

periods of time.● feedback can be complex, with a higher degree of immersion.● the environment allows for complex therapy coaching.● the system should be present, visible, but not disruptive.● a space for interaction can be defined● the user and ambient context play an important role in the feedback

information

A large surface/screen for feedback can fulfill the requirements.

17

RRD

User interaction concepts in smart caring homes for elderly with chronic conditionConclusion

Outside:• the user will need fast access to information.• the use of the system should not be as immersive as the

home installation.• the feedback is given according to the user context, as

ambiental context is too complex and variable.

A smartphone can fulfill the feedback requirements

18

RRD

User interaction concepts in smart caring homes for elderly with chronic conditionConclusion

In both environments:● the system records and enables reasoning on data, in

order to provide contextualized feedback. ● the two feedback devices will complement each other by

offering functionalities relevant for the user according to the user context, environmental context, task aim.

Seamless sharing of information between feedback devices, as well as adapted interaction will provide meaningful transition between the home and outside use.

19

RRD

User interaction concepts in smart caring homes for elderly with chronic condition

20

Thank you!

This work has been carried out within the eWALL project.http://ewallproject.eu/

Questions?

RRD