Social Robotics(for Assisted Living)

Rod WalshProject Manager, Social Robotics

Tampere University of Applied SciencesThe First DMU workshop on Assisted Living Technologies

(ALT2012)21.November.2012

2012

TAMKhttp://www.tamk.fi/en

http://www.tamk.fi/tamktoday

http://tamk-en.blogspot.com/

http://www.facebook.com/TampereUAS

TAMK R&D & Innovation (RDI) programmes

Technology• development of energy efficiency in buildings and facilities,

and reduction of environmental impacts • efficiency of mobile machinery • assessment of human activity in genuine operational

environments • development of new business opportunities

Wellbeing• development of services for seniors, including promotion of

wellbeing entrepreneurship and development of wellbeing technology

• promotion of wellbeing at work• promotion of children’s and adolescents’ health

Culture• integration of various fields to create internationally

competitive cultural products with a strong regional flavour • promotion of networking opportunities for companies• helping the development of culture products for the export

market

R&Dat TAMK

Social RoboticsA social robot is an autonomous robot that interacts and communicates with humans or other autonomous physical agents by following social behaviors and rules attached to its role. http://en.wikipedia.org/wiki/Social_robot

Motivations: Aging World

• Demographics changes• Workplace changes• Health care changes

Motivations: Demographic Gap

• Decreased health budget per person• Insufficient (over-stretched) professionals

Motivations: Longer Working Lives

• Assisted self-care• Augmented healthcare• Assisted working

Social Robotics Vision• Semi-autonomous robots and avatars• Interacting with people in their own space• Augmenting healthcare givers• Providing rehabilitation and lifestyle support• Reliable and inexpensive (step-by-step)

A Few Examples

Physical EmotionEmotion, mood & sentiment affect…• Wellbeing• Behaviour• Interaction

Detailed models exist (e.g. Plutchik)

Plutchik, R. "The Nature of Emotions". American Scientist.Ekman, Paul (1992). "An Argument for Basic Emotions". Cognition and Emotion

Darw

in, C

harl

es

(18

72

), T

he e

xp

ress

ion

of

the e

moti

on

s in

man

an

d a

nim

als

, Lo

nd

on

: Jo

hn

Mu

rray.

Physical EmotionEmotion, mood & sentiment affect…• Wellbeing• Behaviour• Interaction

Detailed models exist (e.g. Plutchik)

Most research uses Ekman’s (original) six emotions

Machine emotion is potentially useful

Plutchik, R. "The Nature of Emotions". American Scientist.Ekman, Paul (1992). "An Argument for Basic Emotions". Cognition and Emotion

Darw

in, C

harl

es

(18

72

), T

he e

xp

ress

ion

of

the e

moti

on

s in

man

an

d a

nim

als

, Lo

nd

on

: Jo

hn

Mu

rray.

Real-time Emotion Recognition

Smart cabs:Machines That know their Drivers

Database:state of mind logsensor logs

non-contact sensing:video, image, audio

7/10capability

~7/10capability

state of mind estimation

Match with task

8/10minimum

Pattern recognition

Simulate simple changes• Music, lighting,

airflow, …

real-time

loggedofflinelogged

virtual robot body in unity

vir

tual

robot

face

in

un

ity

actual robot body in the real world

Output-specific compute:“Render” spatial model (behavior)

Model-specific compute:Translate behavior into spatial

model

Full

body fa

ce

User selected behaviors that affect emotional state for 1to1 dialogue and performance cases.

Things like, “be happy”, “welcome”, “reject”, “complain”, “cry”, “superman”, …

Affective Robotics:Physical expression from social robots

Physical Emotion

angerdisgustfearhappinesssadnesssurpriseneutral

Ekman’s sixneutral

Physical Emotion

anger

Physical Emotion

disgust

Physical Emotion

fear

Physical Emotion

happiness

Physical Emotion

sadness

Physical Emotion

surprise

Come and play!http://socialrobotics.tamk.fi/apps/

(work-in-progress) Train One, Train All

Mindreader (Emotion Hero)

Our 2013 FocusTeleportation

(webconf)Physio’ buddy Emotion play

Rich info, video & ambiance in a simple UI

Instant media spaces (smart active cam/mic)

Affordable locomotion (raised tablet on wheels)

Kinetic robot “programming”

Flexible humanoid

Physical/Mobile/PC Avatar “mobility”

Emotion & activity detection & recognition

Playful engagement

Remote nursing

Companionship

Behavioural agent

Augmented care

Probing

Stimulation

Intervention

Our 2013 FocusTeleportation

(webconf)Physio’ buddy Emotion play

Rich info, video & ambiance in a simple UI

Instant media spaces (smart active cam/mic)

Affordable locomotion (raised tablet on wheels)

Kinetic robot “programming”

Flexible humanoid

Physical/Mobile/PC Avatar “mobility”

Emotion & activity detection & recognition

Playful engagement

Remote nursing

Companionship

Behavioural agent

Augmented care

Probing

Stimulation

Intervention

Our 2013 FocusTeleportation

(webconf)Physio’ buddy Emotion play

Rich info, video & ambiance in a simple UI

Instant media spaces (smart active cam/mic)

Affordable locomotion (raised tablet on wheels)

Kinetic robot “programming”

Flexible humanoid

Physical/Mobile/PC Avatar “mobility”

Emotion & activity detection & recognition

Playful engagement

Remote nursing

Companionship

Behavioural agent

Augmented care

Probing

Stimulation

Intervention

Our 2013 FocusTeleportation

(webconf)Physio’ buddy Emotion play

Rich info, video & ambiance in a simple UI

Instant media spaces (smart active cam/mic)

Affordable locomotion (raised tablet on wheels)

Kinetic robot “programming”

Flexible humanoid

Physical/Mobile/PC Avatar “mobility”

Emotion & activity detection & recognition

Playful engagement

Remote nursing

Companionship

Behavioural agent

Augmented care

Probing

Stimulation

Intervention

Teleportation (webconf)

Physio’ buddy Emotion play

Rich info, video & ambiance in a simple UI

Instant media spaces (smart active cam/mic)

Affordable locomotion (raised tablet on wheels)

Kinetic robot “programming”

Flexible humanoid

Physical/Mobile/PC Avatar “mobility”

Emotion & activity detection & recognition

Playful engagement

Remote nursing

Companionship

Behavioural agent

Augmented care

Probing

Stimulation

Intervention

Other ideas?

New Beginnings in 2013

Thank you!

Questions, discussion…