The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in...

25
ד" ר מרינה פרידין מרכז אוניברסיטאי אריאלThe Therapeutic and Educational Social Robotics Lab ( TESRL).

Transcript of The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in...

Page 1: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

ר מרינה פרידין"ד

מרכז אוניברסיטאי אריאל

The Therapeutic and Educational Social Robotics Lab ( TESRL).

Page 2: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

?מה זה רובוט

:מכני-מכשיר אלקטרו

ניתן לתכנות•

רב שימוש•

רגיש לסביבה•

Page 3: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

היסטוריה של רובוטיקה

הומרוס

בית הקברות היהודי העתיק בפרג

Leonardo da Vinci1495 ) )בן אדם מכני

1950- 1960 רובוטים תעשייתיים

Page 4: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

1970 2010

התפתחות של רובוטיקה

שנים

שימוש ברובוטים

Page 5: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

סוגי רובוטים

רובוטים תעשייתיים רובוטים ניידים

דמוי אדם דמוי חיות ללא דימוי רובוטים ביתיים רובוטים רפואיים רובוטים לימודיים רובוטים צבאים רובוטים חברתיים

Page 6: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

דיון על אתיקה ופילוסופיה ברובוטיקה

מודעות

הטעיה\רגשות

בטיחות

סמכות

...........

Page 7: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

Isaac Asimov (1920 -1992) Born in Petrovichi, Russia

Grew up in Brooklyn, New York, from age 8

Earned B.S., M.S., and Ph.D. from Columbia University

Worked for many years as instructor in biochemistry at Boston

University, School of Medicine

Prolific writer of science fiction

1st 19 years: 100 books

Next 10 years: 100 more books

Next 5 years: 100 more books

Lifetime: Over 500 books

Page 8: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

חוקי הרובוטיקה

חוק הראשון(Human safety:) ולא יאפשר על ידי מחדל , לא יפגע הרובוט בכל אדם שהוא

.שייגרם נזק לאדם, מצידו

חוק השני(Robots are slaves:) לבד , ידי בני אדם-ימלא רובוט אחר כל הוראה שתינתן לו על

מאותם המקרים שמילוי הוראה כזאת יעמוד בסתירה לחוק .הראשון

חוק השלישי(Robot survival:) על עוד שמירה עצמית זאת אינה , חייב רובוט לשמור על קיומו

.עומדת בסתירה לחוק הראשון או לחוק השני

Page 9: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

מבנה הרובוט

לחוש

לתכנן

לבצע

Page 10: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

קטגוריות

Control

Computer Science Electrical Engineering

Mechanical Engineering Neuroscience

Psychology Mechanics

Sensors

Motion Planning

Perception

Page 11: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

מרכיבים

Page 12: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

The Uncanny Valley Masahiro Mori (1970)

Page 13: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

רובוטים חברתיים: מוטיבציה

Page 14: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

רובוטים חברתיים Social learning and imitation

Gesture and natural language communication

Emotion

Recognition of interaction

partners

Benign social behavior

Page 15: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

פלטפורמות רובוטיות

Page 16: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

פלטפורמות רובוטיות

Page 17: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

הקונספט

Kindergarten Assistive Robotics

The Therapeutic and Educational Social Robotics Lab ( TESRL).

ניסויים 30 -כ ילדים 100 -כ פרסומים מדעים 15 -כ

Page 18: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,
Page 21: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

Equip

ment

Pers

onas

מבנה המערכת

Teacher Children

Children’s Parents

KAR

Movements Measurement

Equipment

Private cloud Workload and Data Distributions

Teacher Terminal

Page 22: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

Equip

ment

Pers

onas

In

tera

ctio

ns

מבנה המערכת

Teacher Children

Children’s Parents

KAR

Movements Measurement

Equipment

Private cloud Workload and Data Distributions

Teacher Terminal

Child/Children - KAR

Interaction

Movement Data

Teacher–

Computer

Interaction

Staff - KAR Interaction

Page 23: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,
Page 24: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

מודולים של מערכת

Low-level Perception • Kinect: Motion processing • Robot’s Video: High color saturation filters Skin-color filters Edge detection Disparity computation • Robot’s Sensors: Data filtering

Motor module • Visual-motor skills • Manipulation skills (reaching/ grasping) • Expressive skills (bodily/facial/vocalizations)

Attention module • Attention on a child with fastest/slowest reactions • Attention on a child defined by physiotherapist

Motivation module • Positive-negative reinforcement • Qualitive and quantative feedback • Empathy and mirroring effect

Behavior module • Behavior selection • Decomposition to the set of operations: body movements, operational vocabulary, sounds, emotional expressions

High-level Perception • Visual: Scene analysis and segmentation Face and eye detection Whole body labeling Subjects identification Gaze direction Emotional Recognition • Kinect: Extremities movement analysis • Sensory Data fusion

Adaptation module • Adjustment to the stage of motor learning • Mood and current success level • Personality matching: hyperactive/passive

Information analysis module • Subject’s motor behavior analysis • Subject’s cognitive behavior analysis • Monitoring of the level of interaction strength • Recognition of subjects attention state

Input • Robot: Sensors data, including Scene video • Kinect: Movement tracking • Physiotherapist: Settings

Personal and Anthropometric data Functional (pathological) restrictions Tasks difficulty Session scenario components

Safety module • Avoid children in robot’s working space

Database

Self-awareness module • Error detection/Success measuring

Locomotion, Falling, Manipulation • Robot localization

Personal Information Pathology characteristics: GMFCS, Altered side, Assistive device Motor functions : Time of sit-stand initiation, Symmetry of holding arms Child-Robot Interaction Measurements: Emotional status, Responsiveness Environment: Place, # participants

Page 25: The Therapeutic and Educational Social Robotics Lab ( TESRL). · Isaac Asimov (1920 -1992) Born in Petrovichi, Russia Grew up in Brooklyn, New York, from age 8 Earned B.S., M.S.,

שלב הבאה

Kindergarten Assistive Robotics

The Therapeutic and Educational Social Robotics Lab ( TESRL).

התאמה אישית• פיענוח רגשות\הבעה• הבחון תנועה• אמפתיה• יישום הישגים עדכניים במדעי חינוך והתנהגות•