1 IUT de Montreuil Université Paris 8 Emotion in Interaction: Embodied Conversational Agents...

14
1 IUT de Montreuil IUT de Montreuil Université Paris 8 Université Paris 8 Emotion in Interaction: Emotion in Interaction: Embodied Conversational Embodied Conversational Agents Agents Catherine Pelachaud Catherine Pelachaud
  • date post

    22-Dec-2015
  • Category

    Documents

  • view

    224
  • download

    0

Transcript of 1 IUT de Montreuil Université Paris 8 Emotion in Interaction: Embodied Conversational Agents...

11

IUT de Montreuil IUT de Montreuil

Université Paris 8Université Paris 8

Emotion in Interaction: Emotion in Interaction: Embodied Conversational AgentsEmbodied Conversational Agents

Catherine PelachaudCatherine Pelachaud

22

Emotion in Interaction: Humaine

Three domains of study– Perception domainPerception domain: how certain aspects related to : how certain aspects related to

perception may influence agent’s actionsperception may influence agent’s actions– Interaction domainInteraction domain: how to create relations between : how to create relations between

users and agents; how the agent can provide feedbackusers and agents; how the agent can provide feedback– Generation domainGeneration domain: how to show expressive : how to show expressive

behaviours consistently and naturally across modalitiesbehaviours consistently and naturally across modalities

33

Perception and AttentionPerception and Attention

Non obtrusive agent: based on the Non obtrusive agent: based on the interest shown by the addressee interest shown by the addressee decides decides – when to start a communicationwhen to start a communication– how long to maintain ithow long to maintain it– when to finish itwhen to finish it

Perception of attentive and emotional Perception of attentive and emotional behaviorsbehaviors– where to look atwhere to look at– how to interpret other’s behaviorshow to interpret other’s behaviors

44

Perception and AttentionPerception and Attention

Endow an ECA with the capabilities Endow an ECA with the capabilities to:to:– have a visual attention and perception have a visual attention and perception

modelmodel– show attention and interestshow attention and interest– attract the attention of othersattract the attention of others

55

InteractionInteraction

Interaction: two or more parties Interaction: two or more parties exchange messages. exchange messages.

Interaction is by no means a one way Interaction is by no means a one way communication channel between communication channel between parties. parties.

Within an interaction, parties take Within an interaction, parties take turns in playing the roles of the turns in playing the roles of the speaker and of the addresseespeaker and of the addressee..

66

InteractionInteraction

Speaker and addressee adapt their Speaker and addressee adapt their behaviors to each otherbehaviors to each other

– Speaker monitors addressee’s attention Speaker monitors addressee’s attention and interest in what he has to sayand interest in what he has to say

– Addressee selects feedback behaviors to Addressee selects feedback behaviors to show the speaker that he is paying show the speaker that he is paying attentionattention

77

InteractionInteraction Agent as adressee ought to have the capabilities:Agent as adressee ought to have the capabilities: attentionattention: pay attention to the signals produced by : pay attention to the signals produced by

speaker to perceive, process and memorize themspeaker to perceive, process and memorize them perceptionperception: of signals: of signals comprehensioncomprehension: understand meaning attached to : understand meaning attached to

signalssignals internal reactioninternal reaction: the comprehension of the meaning : the comprehension of the meaning

may create cognitive and emotional reactionmay create cognitive and emotional reaction decisiondecision: decision to communication the internal : decision to communication the internal

reactionreaction generationgeneration: display behaviors: display behaviors

88

InteractionInteraction

Providing feedback is a fundamental aspect of Providing feedback is a fundamental aspect of engagementengagement

Backchannel: signals ofBackchannel: signals of– 1-1-          perceptionperception– 2-2-          attention -- interestattention -- interest– 3-3-          understandingunderstanding– 4-4-          attitude: belief (T/F); like (T/F);attitude: belief (T/F); like (T/F);– 5- acceptance5- acceptance

positive/negativepositive/negative any combination of the aboveany combination of the above

– pay attention but not understand; understand but not pay attention but not understand; understand but not believebelieve

99

Expressive BehaviorsExpressive Behaviors

Behaviors encode: Behaviors encode: – content information (the ‘What is content information (the ‘What is

communicating’)communicating’)– expressive information (the ‘How it is expressive information (the ‘How it is

communicating’)communicating’) highly synchronizedhighly synchronized multimodalmultimodal

1010

Expressive BehaviorsExpressive Behaviors

Basic emotionsBasic emotions– Anger, fear, sadness, happiness, Anger, fear, sadness, happiness,

disgust, surprisedisgust, surprise– Universally recognized (Ekman)Universally recognized (Ekman)– Basic emotion = family of related states Basic emotion = family of related states

(Ekman 75)(Ekman 75)

Real life emotions are often Real life emotions are often complex and involve several complex and involve several emotionsemotions

1111

Expressive BehaviorsExpressive Behaviors

Blends may occur either as Blends may occur either as – superposition of emotionssuperposition of emotions– masking of one emotion by another masking of one emotion by another

emotionemotion– quick succession of different emotions quick succession of different emotions – suppression / overacting of an emotion suppression / overacting of an emotion

Superposition of 2 emotions: Superposition of 2 emotions: evaluation of an event can happen evaluation of an event can happen under different anglesunder different angles

Mask an emotion by another one : Mask an emotion by another one : consideration of social contextconsideration of social context

1212

ExamplesExamples

Disappointment Masked by Joy Disappointment Masked by Joy

Superposition of Sadness and JoySuperposition of Sadness and Joy

Disappointment joy Disappointment masked by joy

JoySadness Sadness and Joy

1313

CallasCallas

Creation of a virtual agent able to Creation of a virtual agent able to – perceive and be attentiveperceive and be attentive– be aware of and adapt to the be aware of and adapt to the

surroundings (physical and social surroundings (physical and social context)context)

– interact with users/other agentsinteract with users/other agents– communicate and listencommunicate and listen– show ‘real’ emotionsshow ‘real’ emotions– use expressive gesturesuse expressive gestures

1414

CallasCallas

Extension and refinement of the Extension and refinement of the results obtained in Humaine results obtained in Humaine

Real-Time integrated systemReal-Time integrated system Integration of virtual and real Integration of virtual and real

perception modelsperception models Real situationsReal situations