Affective Computing(2)

download Affective Computing(2)

of 14

Embed Size (px)


Affective Computing(2)

Transcript of Affective Computing(2)

  • 1. Student: Chuan-Ken LinData: Nov.12, 2008

2. Introduction

  • Affective Computingis computing that relates to, arises from, or deliberately influences emotion or other affective phenomena.

Emotioncommunication decision-making 3. Introduction

  • Our research develops
    • new technologies
    • theories
  • Our research addresses
    • machine recognition
    • modeling of human emotional expression
    • machine learning of human preferences

4. Contribution

  • Designing new ways for people to communicateaffective-
  • cognitive statesthrough sensors
  • Creating new techniques toassess frustration, stress
  • through natural interaction and conversation
  • Showing howcomputerscan bemore emotionally
  • intelligent
  • Inventing personal technologies forimproving self-awareness of affective stateand its selective communication toothers
  • Increasing understanding ofhow affect influences personalhealth

5. Overview 6. Affective-Cognitive Framework for Machine Learning and Decision Making

  • human affect and emotional experience play a significant and useful role =>human learning and decision-making
  • based on old, purely cognitive models not enough
  • We aim to redress many of these classic problems bydeveloping new models that integrate affect with cognition
  • Result: allow machines to make smarter and more human-like decisions for better human-machine interaction.

7. Affective-Cognitive Product Evaluation and Prediction of Customer Decisions

  • We are developing new technology-assisted methods to try to improve
    • the customer-evaluation process
    • betterpredict customer decisions
  • The new methods involve
    • facial expression
    • skin conductance

8. Emotion Communication in Autism

  • People who have difficulty communicating verbally (such as many people with autism) sometimes send nonverbal messages that do not match what is happening inside them.
  • We are creating new technologies to address this fundamental communication problem about the data analysis of emotion-related physiological signals.

9. Emotional-Social Intelligence Toolkit

  • Social-emotional communication difficulties lie at the core of autism spectrum disorders
  • We are also developing technologies thatbuild on the nonverbal communicationthat individuals on the autism spectrum are already using to express themselves, to help families, educators, and other persons who deal with autism spectrum disorders to better understand these alternative means of nonverbal communication

10. Evaluation Tool for Recognition of Social-Emotional Expressions from Facial-Head Movements

  • To help people improve their reading of faces during natural conversations, we developed a video tool to evaluate this skill.

11. EyeJacking: See What I See

  • While modern communication technologies mean that we can connect to more people, these connections lack the affective subtleties inherent in situated interactions.
  • EyeJacking is an application forthe sharing of experiences in which one or more person
  • We explore the application of EyeJacking as a tool for situated learning for individuals on the autism spectrum

12. FaceReader: Affective-Cognitive State Inference from Facial Video

  • People express and communicate their mental states, including emotions, thoughts, and desires through facial expressions, vocal nuances, gestures, and other nonverbal channels.
  • We have developed a computationalmodel that enables the real-time analysis , tagging, and inference of cognitive-affective mental states from facial video.

13. Machine Learning and Pattern Recognition with Multiple Modalities

  • This project develops new theory and algorithms to enable computers to make rapid and accurate inferences
  • such as determining a person's affective state from multiple sensorsvideo, mouse behavior, chair pressure patterns, typed selections, physiology, and more.

14. Prediction Game and Experience Sharing Market for Forecasting Marketplace Success

  • We have developed a novel market game, "Prediction Game and Experience Sharing harnesses people's collective prediction and experience sharing to forecast the success or failure of new items
  • Companies can register their new items on this market (as a testbed) to ask people's collective opinion