1 IUT de Montreuil Université Paris 8 Emotion in Interaction: Embodied Conversational Agents...
-
date post
22-Dec-2015 -
Category
Documents
-
view
224 -
download
0
Transcript of 1 IUT de Montreuil Université Paris 8 Emotion in Interaction: Embodied Conversational Agents...
11
IUT de Montreuil IUT de Montreuil
Université Paris 8Université Paris 8
Emotion in Interaction: Emotion in Interaction: Embodied Conversational AgentsEmbodied Conversational Agents
Catherine PelachaudCatherine Pelachaud
22
Emotion in Interaction: Humaine
Three domains of study– Perception domainPerception domain: how certain aspects related to : how certain aspects related to
perception may influence agent’s actionsperception may influence agent’s actions– Interaction domainInteraction domain: how to create relations between : how to create relations between
users and agents; how the agent can provide feedbackusers and agents; how the agent can provide feedback– Generation domainGeneration domain: how to show expressive : how to show expressive
behaviours consistently and naturally across modalitiesbehaviours consistently and naturally across modalities
33
Perception and AttentionPerception and Attention
Non obtrusive agent: based on the Non obtrusive agent: based on the interest shown by the addressee interest shown by the addressee decides decides – when to start a communicationwhen to start a communication– how long to maintain ithow long to maintain it– when to finish itwhen to finish it
Perception of attentive and emotional Perception of attentive and emotional behaviorsbehaviors– where to look atwhere to look at– how to interpret other’s behaviorshow to interpret other’s behaviors
44
Perception and AttentionPerception and Attention
Endow an ECA with the capabilities Endow an ECA with the capabilities to:to:– have a visual attention and perception have a visual attention and perception
modelmodel– show attention and interestshow attention and interest– attract the attention of othersattract the attention of others
55
InteractionInteraction
Interaction: two or more parties Interaction: two or more parties exchange messages. exchange messages.
Interaction is by no means a one way Interaction is by no means a one way communication channel between communication channel between parties. parties.
Within an interaction, parties take Within an interaction, parties take turns in playing the roles of the turns in playing the roles of the speaker and of the addresseespeaker and of the addressee..
66
InteractionInteraction
Speaker and addressee adapt their Speaker and addressee adapt their behaviors to each otherbehaviors to each other
– Speaker monitors addressee’s attention Speaker monitors addressee’s attention and interest in what he has to sayand interest in what he has to say
– Addressee selects feedback behaviors to Addressee selects feedback behaviors to show the speaker that he is paying show the speaker that he is paying attentionattention
77
InteractionInteraction Agent as adressee ought to have the capabilities:Agent as adressee ought to have the capabilities: attentionattention: pay attention to the signals produced by : pay attention to the signals produced by
speaker to perceive, process and memorize themspeaker to perceive, process and memorize them perceptionperception: of signals: of signals comprehensioncomprehension: understand meaning attached to : understand meaning attached to
signalssignals internal reactioninternal reaction: the comprehension of the meaning : the comprehension of the meaning
may create cognitive and emotional reactionmay create cognitive and emotional reaction decisiondecision: decision to communication the internal : decision to communication the internal
reactionreaction generationgeneration: display behaviors: display behaviors
88
InteractionInteraction
Providing feedback is a fundamental aspect of Providing feedback is a fundamental aspect of engagementengagement
Backchannel: signals ofBackchannel: signals of– 1-1- perceptionperception– 2-2- attention -- interestattention -- interest– 3-3- understandingunderstanding– 4-4- attitude: belief (T/F); like (T/F);attitude: belief (T/F); like (T/F);– 5- acceptance5- acceptance
positive/negativepositive/negative any combination of the aboveany combination of the above
– pay attention but not understand; understand but not pay attention but not understand; understand but not believebelieve
99
Expressive BehaviorsExpressive Behaviors
Behaviors encode: Behaviors encode: – content information (the ‘What is content information (the ‘What is
communicating’)communicating’)– expressive information (the ‘How it is expressive information (the ‘How it is
communicating’)communicating’) highly synchronizedhighly synchronized multimodalmultimodal
1010
Expressive BehaviorsExpressive Behaviors
Basic emotionsBasic emotions– Anger, fear, sadness, happiness, Anger, fear, sadness, happiness,
disgust, surprisedisgust, surprise– Universally recognized (Ekman)Universally recognized (Ekman)– Basic emotion = family of related states Basic emotion = family of related states
(Ekman 75)(Ekman 75)
Real life emotions are often Real life emotions are often complex and involve several complex and involve several emotionsemotions
1111
Expressive BehaviorsExpressive Behaviors
Blends may occur either as Blends may occur either as – superposition of emotionssuperposition of emotions– masking of one emotion by another masking of one emotion by another
emotionemotion– quick succession of different emotions quick succession of different emotions – suppression / overacting of an emotion suppression / overacting of an emotion
Superposition of 2 emotions: Superposition of 2 emotions: evaluation of an event can happen evaluation of an event can happen under different anglesunder different angles
Mask an emotion by another one : Mask an emotion by another one : consideration of social contextconsideration of social context
1212
ExamplesExamples
Disappointment Masked by Joy Disappointment Masked by Joy
Superposition of Sadness and JoySuperposition of Sadness and Joy
Disappointment joy Disappointment masked by joy
JoySadness Sadness and Joy
1313
CallasCallas
Creation of a virtual agent able to Creation of a virtual agent able to – perceive and be attentiveperceive and be attentive– be aware of and adapt to the be aware of and adapt to the
surroundings (physical and social surroundings (physical and social context)context)
– interact with users/other agentsinteract with users/other agents– communicate and listencommunicate and listen– show ‘real’ emotionsshow ‘real’ emotions– use expressive gesturesuse expressive gestures
1414
CallasCallas
Extension and refinement of the Extension and refinement of the results obtained in Humaine results obtained in Humaine
Real-Time integrated systemReal-Time integrated system Integration of virtual and real Integration of virtual and real
perception modelsperception models Real situationsReal situations