Cognitive Assistance in Smart Homes Sylvain Giroux and Hélène Pigot.
From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.
-
Upload
caitlin-armstrong -
Category
Documents
-
view
217 -
download
1
Transcript of From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.
![Page 1: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/1.jpg)
From
Smart
Home to
Smart
Care :
Pervasive
Assistance for
Cognitively I
mpaired People
Sylvain
Giroux
![Page 2: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/2.jpg)
Plan
Context
Objectives and Approach
Pervasive and mobile computing, Tangible User interface
From homes…
Hardware level: networks, sensors, effectors
… to smart homes …
Middleware level: pervasive infrastructure
… to smart care !
Application level: cognitive assistance & tele-monitoring
Validation
Clinical studies
Conclusion
![Page 3: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/3.jpg)
ContextP
eople suffering of cognitive impairments in Quebec Alzheimer disease : 5.1% of people over 65 years old Head trauma : 3000 new cases each yearSchizophrenia : 1% of the population
In many cases, they would be able to stay at home
if light assistance was provided.
But healthcare resources are scarce. So relatives have to take responsibility for care.
It then turns to an exhausting burden.Hence relatives and caregivers urge for help.
![Page 4: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/4.jpg)
Objectives
Provide adapted and personalized environmental cues to
Foster the autonomy of cognitively impaired people
Reduce risks and hazards
Pervasive computing & Tangible user interfaces
Keep ensuring continuous cognitive assistance outside people’s home
Mobile computing & Location-based services
Help relatives and caregivers to stay in touch at distance with cognitively impaired people
![Page 5: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/5.jpg)
From homes…S
mart homes are augmented environments
Heterogeneous networks
Sensors networks
Embedded processors in devices, clothes, jewels…
Information appliances
Networked communicating objects
![Page 6: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/6.jpg)
DOMUS: an augmented apartment
![Page 7: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/7.jpg)
… smart homes …S
mart homes are augmented environments
Heterogeneous networks
Wireless : WiFi, Bluetooth, RFID, UWB...Wired : Ethernet, Electrical wires, X10, power line…
ServersFull control over sounds and video streams
![Page 8: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/8.jpg)
… smart homes …S
mart homes are augmented environments
Sensors networks
Identification and localization of objects and people
Ubisense tags, UWBSmart tags (RFID)
![Page 9: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/9.jpg)
… smart homes …S
mart homes are augmented environments
Embedded processors in devices and clothesNot yet investigated
![Page 10: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/10.jpg)
… smart homes …S
mart homes are augmented environments
Information appliancesFixed: smart boards, Icebox… Mobile: laptop, wireless screen, PDAs…
![Page 11: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/11.jpg)
… smart homes …S
mart homes are augmented environments
Networked communicating objectsSightHearing
Smell (not yet investigated)Touch (not yet investigated)
Taste (is it possible ?)
![Page 12: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/12.jpg)
From
homes to smart
homes
![Page 13: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/13.jpg)
Towards a pervasive infrastructure
Some issues investigated at DOMUS
Spontaneous networkingHeterogeneous networksAutonomic computingMobile code and agentsLocation and context awareness
Security and privacy
Some prototypes
A pervasive reminder systemMulti-channel delivery of services
![Page 14: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/14.jpg)
A
Pervasive
Reminder
System
for
Smart
Homes
How to localize a user from simple sensors information ?
How to achieve pervasiveness?
Follow-me : transparent user friendly migration of sessions
How to use spontaneous networking and service discovery to build zero-configuration system ?
How to cope with heterogeneity of devices, networks, and OS ?
How to keep the system in a clean state ?
![Page 15: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/15.jpg)
Multi-channel
delivery of services
On-the-fly generation of user interfaces from raw code
Means to control complex interactions with a user
Ready to use service delivery infrastructure
![Page 16: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/16.jpg)
… to smart careS
mart homes can assist cognitively impaired people foster their autonomy.
The whole home becomes a true cognitive prosthesis.
As well, smart homes can
help caregivers to grant better care give a sense of security to residents and their relatives
![Page 17: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/17.jpg)
Cognitive assistance
What is the available information ?
Identification and location of people and objectsObjects involved in an activityPrimitive actions
Who the user is ?
personalization
What is the user doing ?
Activity recognitionHierarchical modelsLattice-theory
How to assist the user?
Highligth objectsTangible user interfaces
![Page 18: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/18.jpg)
Activity recognition
Based on plan recognition
Hierarchical Markov modelsLattice-based models
Based on involved objects
Perkowitz et al., Mining Models of Human Activities from the Web, WWW 2004, May 17-22, 2004, New York, NY USA.
![Page 19: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/19.jpg)
Personalization
Every person is different
Cognitive modelling exploiting episodic memory
To know from life habits, how one usually performs an activity
method usually used to achieve a taskestimations on time (averge time of completion…)most likely location
![Page 20: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/20.jpg)
Cognitive deficits
Deficits addressed
Initiation
Memory
Planning
Attention
![Page 21: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/21.jpg)
Initiation deficitsInitiation deficits leads to inactive periods whereas the person is supposed to perform actions
Wandering for a long time could be attributed to an initiation deficit
>> Prompt the resident
![Page 22: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/22.jpg)
Memory deficits
Difficulties to remember
the activity to perform the steps of the activity the locations of the tools and materials involved in that activity.
>> Show-me objects + « Follow-me » applied to objects
The lamp turns off when the object is too far away.
The lamp turns on to highlight the searched red book
![Page 23: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/23.jpg)
Planning deficitsD
ifficulties to perform an appropriate sequence of actions in the rightorder to achieve a goal.
>> Prepare_coffee = {take_milk, take_cup…}
>> Show to the user where to perform the next action
![Page 24: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/24.jpg)
Attention deficitsS
hifts of attention from the activity under progress to a
stimulus causing interference
The current activity may be forgotten and never completed
>> Remind the activity under progress to the resident
![Page 25: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/25.jpg)
Validation
Clinical studies using prototypes are in preparation and will soon be on-going at
Fernand-Séguin research center, L-H Lafontaine Hospital, Montreal
Dr Emmanuel Stip, psychiatristSchizophrenia
Centre de Réadaptation Estrie, SherbrookeHead trauma
![Page 26: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/26.jpg)
Conclusion
Pervasive computing and tangible user interfaces can help to transform home into smart homes adapted to cognitively impaired people
Going beyond the usual view of computing as “PC-based”
Pervasive computing enables a seamless integration of assistance in residents’ everyday life
Going beyond traditional human computer interfaces
TUI helps to turn the whole house into a cognitive prosthesis
Such smart homes can
Foster people’s autonomy
Lead to smarter care
![Page 27: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/27.jpg)
Our team
Researchers from the Faculties of science, engineering, and administration
Sylvain Giroux, Ph. D. in Computer scienceHélène Pigot, Ph. D. in Computer science and B. in occupational therapy André Mayers, Ph. D. in Computer science and M. inpsychologyPhilippe Mabilleau, Ph.D. in engineeringClaude Caron (geo-business)
Analyst
Francis Bouchard
Students
6 Ph. D. students12 M. Sc. students6 B.Sc. students, 2 international trainees (M. Sc. level)
Some collaborations
CRE, Centre de réadaptation Estrie Centre de recherches Fernand Séguin, Computer scienceUniversité Joseph Fourier, Grenoble
France TelecomAriane Controls, Canada
![Page 28: From Smart Home to Smart Care : Pervasive Assistance for Cognitively Impaired People Sylvain Giroux.](https://reader036.fdocuments.net/reader036/viewer/2022081519/56649e9f5503460f94ba0fae/html5/thumbnails/28.jpg)
Thank you for your attention
http://domus.usherbrooke.ca/