Student: Chuan-Ken Lin Data: Nov.12, 2008

IntroductionAffective Computing is computing that

relates to, arises from, or deliberately influences emotion or other affective phenomena.

Emotion

communication

decision-making

IntroductionOur research develops

new technologies theories

Our research addresses machine recognition modeling of human emotional expressionmachine learning of human preferences

Contribution Designing new ways for people to communicate

affective- cognitive states through sensors Creating new techniques to assess frustration,

stress through natural interaction and conversation Showing how computers can be more emotionally intelligent Inventing personal technologies for improving self-

awareness of affective state and its selective communication to others

Increasing understanding of how affect influences personal health

Overview

Affective-Cognitive Framework for Machine Learning and Decision Making

human affect and emotional experience play a significant and useful role =>human learning and decision-making

based on old, purely cognitive models not enough

We aim to redress many of these classic problems by developing new models that integrate affect with cognition

Result: allow machines to make smarter and more human-like decisions for better human-machine interaction.

Affective-Cognitive Product Evaluation and Prediction of Customer Decisions

We are developing new technology-assisted methods to try to improve the customer-evaluation processbetter predict customer decisions

The new methods involve facial expression skin conductance

Emotion Communication in Autism People who have difficulty communicating

verbally (such as many people with autism) sometimes send nonverbal messages that do not match what is happening inside them.

We are creating new technologies to address this fundamental communication problem about the data analysis of emotion-related physiological signals.

Emotional-Social Intelligence Toolkit Social-emotional communication difficulties

lie at the core of autism spectrum disorders We are also developing technologies that

build on the nonverbal communication that individuals on the autism spectrum are already using to express themselves, to help families, educators, and other persons who deal with autism spectrum disorders to better understand these alternative means of nonverbal communication

Evaluation Tool for Recognition of Social-Emotional Expressions from Facial-Head Movements

To help people improve their reading of faces during natural conversations, we developed a video tool to evaluate this skill.

EyeJacking: See What I See

While modern communication technologies mean that we can connect to more people, these connections lack the affective subtleties inherent in situated interactions.

EyeJacking is an application for the sharing of experiences in which one or more person

We explore the application of EyeJacking as a tool for situated learning for individuals on the autism spectrum

FaceReader: Affective-Cognitive State Inference from Facial Video

People express and communicate their mental states, including emotions, thoughts, and desires through facial expressions, vocal nuances, gestures, and other nonverbal channels.

We have developed a computational model that enables the real-time analysis, tagging, and inference of cognitive-affective mental states from facial video.

Machine Learning and Pattern Recognition with Multiple ModalitiesThis project develops new theory and

algorithms to enable computers to make rapid and accurate inferences

such as determining a person's affective state from multiple sensors—video, mouse behavior, chair pressure patterns, typed selections, physiology, and more.

Prediction Game and Experience Sharing Market for Forecasting Marketplace SuccessWe have developed a novel market game,

"Prediction Game and Experience Sharing”harnesses people's collective prediction and experience sharing to forecast the success or failure of new items

Companies can register their new items on this market (as a testbed) to ask people's collective opinion