Intelligent Robot for Cognitive Training of the elderly people

Bionics Center/KISTDr.-Ing. Mun-Sang Kim

www.irobotics.re.kr

5 Rep. Robots at KIST

• for home errands

• world-class speed

• brings items from

refrigerator

• sets & clears meals

• pours water into a cup

• carries items to and

from

• for show host (MC)

• world-class HRI tech.

• facial expression, lip-

sync

• announcement(TTS)

• sing & dance

• omnidirectional walk

CIROS 3.0

KIBO 3.0

Robotics

Education

Elder Care/ Cog.

Training

Special Education

• Safe/ Speedy/

Silent

• Humanlike

Behaviors &

Expressions

(100 sorts above)

• Connection to

external

Sensors &

Smart devices

SILBOT3

MERO-S MERO3

MERO-SERIES Customer Guidance

Edu & Entertainment, Game,

Dance

Support in optimal environment for robot SW dev.

Provides w/ hands-on training materials for College robotics

education.

3D Graphic Simulator / iRSP (Motion Planner)

Provides w/ more than 30 types of SW components like Recog.

Navi, Manipulation , Expression, etc.

SDK | SW DEV. KIT

• Gravity Compensation, 4 DoF face

• Humanlike Expressions of Happy, Sad, Angry,

Pleasant & Real-time Lip-sync

• Easy Creation of facial expressions based on

Motion Capture tech.

• An aging rate in major advanced countries is expected to reach by

more than 25% in their total population.

• Of the total elderly at over 65, 5~10% have dementia.

• Research results show that cognitive training improves cognitive

functions and brain functions.

• Helsinki city in Finland, inputs 60% of its total budget to welfare projects

(0.2 billion euro supported in 2009)

Key Issue is healthy aging !

6

Why Robots for Cognitive Training ?

• Lack of specially trained teachers

• Very interesting !

• Upgrade is very simple

• The quality of education is same everywhere.

• Cheap !

Challenge : whether intelligent robots can be accepted by the elderly people

Relationships between Cognition training program & Cognitive domains

PICK THE PAIRImprove Memory functionSING SING SING Improve Memory functionSTORY MEMORYImprove Memory functionGUESS WHAT?Improve Language function

Frontal LobeMotor Control/ Attention/ Verbal Fluency(left)/ Movement Control/ Planning/ Emotion Control

RHYTHM TOUCHEnhance the Attention abilityBINGOStregnthen the brain functions related to inference & determinationLUCKY CATCHEnhance the Attention ability

Parietal LobeIntegrating sensory info/ Parietal system/ Calculation/ Manipulation of objects (right)/ Spatial sense (left)

FOLLOW MEImprove the visuospatial processingHIT THE NUMBERImprove the Prominent role in mathKING OF CALCULATIONImprove the Prominent role in mathPICTURE PUZZLEImprove the visuospatial processingPICTURE PUZZLEImprove the visuospatial processing

MOVE LIKE MEImprove Memory functionKNOWING YOU, KNOWING MEImprove Memory functionCLEAN UPImprove Language function ROBOTCONStrengthen the visual memory

Temporal LobeAuditory perception/ Verbal comprehension (left)/ Memory

MERO GAME.

KNOWING YOU

KNOWING ME

SILBOT GAME.

ROBOTCON

MERO GAME.

KING OF CALCUATION

Curriculum

• Nov. 7, 2011 ~ Feb. 10, 2012 / 12 weeks• SILBOT & MERO used.• total 16 cognition training games• Total 48 people (aged 66~)/ 6 groups, 8 people a class

Details

• Provide with the Elder Care Robots to centers for elder in Aarhus Denmark

• Service of Dementia Prevention program with cognition training games for the elderly

Venue • Vika Garden, 2 Classrooms

Consortium

• City of Aarhus: Support of project operation in Vika Garden, Aarhus, Denmark

• GAHA Company: General Project Management• Center for Intelligent Robotics of KIST: Provide the Robotic

system for project • Roboware Co., Ltd: Production of the Robots • Samsung Medical Center Co., Ltd: Planning the Robotic

Cognition Training Games

History

• Nov. 2010: Demark Care Ware Net visited to KIST• Feb. 2011: MOU between KIST & City of Aarhus• Nov. 07, 2011: Opening of the Robot Project• Nov. 11, 2011: Press Conf. & Signing Ceremony [Letter of

Intent]* KIST & GAHA & City of Aarhus

• Feb. 10, 2012: Terminate the project & plan to establish Joint Venture Com with KIST & City of Aarhus

TV2/ oj [21/11/11]TV2 [21/11/11]

9

TV2 [22/11/11] TV2 [22/11/11]

MOU: KIST & City of Aarhus [11/02/11]

Signing Ceremony & Press Conf. [21/11/11]

DENMARK (Aarhus), ELDER CARE ROBOT PROJECT

10

[EXAMINEE] TOTAL 85 PEOPLE, aged over 60 without diagnosed dementia

[HUMAN CLASS]24 people

8 ppl. * 3 class

[ROBOT CLASS] 24 people

8 ppl. * 3 class

[CONTROL GROUP] 37 people,

not in the program

• MRI (T1, DTI, resting fMRI)• Neural Mental Exam• (SNSG/ ADAS-Cog/ CANTAB)• SURVEY• (Brain/ Physical/ Social/

Memory Satisfaction/ Depression, etc.)

• MRI (T1, DTI, resting fMRI)• Neural Mental Exam• (SNSG/ ADAS-Cog/ CANTAB)• SURVEY• (Brain/ Physical/ Social/ Memory

Satisfaction/ Depression, etc.)

BASELINE FOLLOW-UP

12weeks later

Evaluation Process

Evaluation

Compared to the control group, subjects who underwent 3 months of cognitive training showed less cortical thinning (both with conventional cognitive training and robot-assisted cognitive training)

Robot assisted cognitive training delays cortical thinning

Brain MRI Results

Brain Fitness Robot

12

13

Silbot3

Ideal intelligent robot platform optimized to robotic research and real applications

VIDEO

14

Mero

SDK

Software Development Kit map

Korea: 75,000 under special education / 5.5 students per class

Finland: As of 2008, 8% of full time students are in special education / There has been a

continual increase of part time students in special education.

• Educational robot for nursery children and elementary school children with autism and ADHD

• Tele type: Interaction with children through remote operation of robot by teacher

• Auto type: Programming with special subject curriculum to be used as psychology treatment for children

PART

FULL TIME

Diagnostic evaluation Hazard management Assisting education

SPECIAL EDU ROBOTEducational robot for children with autism and ADHD

• Repeat evaluation question

via robot (examiner)

• Collect reaction of children

(examinee) and analyze

result

• Analyze abnormal

behavior record

• Arbitrate crisis by robot

• Improve concentration

• Execute program

[Source] Statistics Office in

Finland

- During the basic education period, a

number of students transferred from

ordinary class to special education

class, and a number of students take

part time special education.

20

1. International research collaboration is being planned with

Denmark and New Zealand.

2. The KIST invested Robot Venture “RoboCare” is to found a

Joint-Venture company in Denmark by the end of 2014.

3. Robots will be used for the education purpose in India and

Russia in 2014.

4. New Application for the children needing special care has

just started.