Sims for soft skills

CPI 494, April 23, 2009Kurt VanLehn

Your questions (no answers yet)

• Cultural relativity? • 3 different types of negotiation seems too simple. Are

there other factors? Mood?• XAI how smart is it? What are its capabilities.• Can it really teach me something about being human

when its not human?• How flexible in response to student’s negotiation? Can

it respond to novel negotiations? • Why choose the doctor scenario? • Rewind the sim and play forward

Who is being trained?

• Military – Captain• Straigtforward• Not very emotional; not empathetic• Not so got at gestures?

What is the task?

• Negotiation.• Laying my cards on the table; getting other’s

stiaution; finding a compromise.• How to cajole into doing something.

How does the Doctor’s affect work?

• Three meta-states; stances– Avoidance– Distributed – attacking and trying to win– Integrative – compromising & collaborating

• State– Topic resource must be available – Danger here vs. elsewhere– Patients survive the move

What causes stance transitions• Avoidance (trying to get out of negaoting)– Believes can can avoid the negotiation– Doesn’t agree with Captain’s goals

• Attacking & wining– Believes can’t get out of negotiation– Still doesn’t agree with Captain’s goals, logic,

• Actually negotiating– Believes that there is a chance to benefit– Trust– Shared goals

What does trust dependent on?

• Credibility – not lying; ability to do what you promise

• Familarity e.g., polite• Solidarity – shared goals

What is a training session comprised of?

• Negotiation – NL dialogue; speech generator.– Not clear what the input modality is – menus?– Speech now. – Intonation?

• After action review (AAR)

What tutoring occurs during the task?

• No rewind• NO help • No nothing

What tutoring occurs after the task?

• Rewind• Feedback on their log file– Some positive (and lots negative)

• Types of events that need comment– Good things– Ommissions– Commisions

Does this really change the user’s beliefs/behaviors?

• Interrogation of the Doctor is slow way to “discover” a thoery of emotion/negotiation.

• May not cause a change in the student’s actions.

• Doesn’t transfer to real world.• Apprise student of how delicate situations

really are. Sensitization.• Could have more gestures instead. Or just a

symbol… pop out of the Doctor’s head

What are the 3 subtasks of AAR?

• Assess the student’s performance– Walking the logs & looking for ommision &

commissions.– Hand authored rules; looking at decreases in

Doctor’s trust or stance…– Annotate the log

• Select annotations, order them them, plan the session

• Executes the plan

Looking for deeper diagnosis?

• Is there a underlying trait or belief that is causing multiple “errors” in the negotiation?

• E.g., “half the patients might be insurgents” could cause multipel mistakes

How is annotating the logs done?

How is planning the AAR done?

• Priorities?• Pre-req relations between tutoring task?• Students have not control over what gets

taught• Not as fancy planning knowledge as Proust &

other others.

How is running the AAR done?

• Branchin g offf to the XAI interrogataion session

• No formal didactic teaching

Why do the authors contrast this to discovery learning?

• When they ask questions of the doctor during AAR, they are trying to discover a theory of emotion and negotiation.

• Text mentions some tutoring on what questions to ask… but not much said.

• Not clear what benefits of discovery are here

What is the role of XAI? Why needed?

• Noticed that negotiatiors are see their internal state.

• Seems like a good applciation of Xai• Might be that its too siple

How does XAI work?

• Processed the logs in RDB.• SQL queries on it• Reasoingn about cause effecti; which is driven

by stuff recored in the RDB. • Authored queries in LF (logical form)– Translation into SQL– Translation into English

Are there other ways to make the doctor’s thinking visible?

Is this whole, cool thing overkill?Would something simpler work well?• Replace fancy XAI with canned text

epxlanations.• Students just want to find out what t

How are real negotiations prepared for and done?

How much domain vs. meta knowledge is needed for negotiation?