Bring Non-Verbal Feedback From Learners to E-Learning

Randhir VieiraVP – Product and Marketing

Randhir IntroBA Economics

MA Human Resources Management

MBA Marketing

• Train in small and large groups• Work with over 1,000 customers delivering over 1 million

courses a year

http://www.mindflash.com/

Main topics

• Importance of non-verbal feedback• Trainee non-verbal feedback in e-learning• Best practices

70% of communication is non-verbal

• Expressions• Body movement• Voice tone

70%

2 examples ofnon-verbal communication

Experiment with 10 seconds of data

Predicting Teacher Evaluations

• Subjects watched 10 seconds of silent video of a only a teacher teaching a class

• Rated the teacher on a 15-item checklist of personality traits

• Ratings were the same when they were shown just 5 second clips and even 2 second clips

• Students who attended a full semester rated the teachers and their ratings were very similar to the volunteer ratings

Interview Test

• Trained interviewers met with candidates for 15-20 minutes

• Filled out a 6 page evaluation• Volunteers watched the initial 15 silent

seconds of the candidate knocking on the door, shaking hands and sitting down

• Volunteers ratings and trained interviewers ratings were very similar

Evolution of Training

Live Classroom

Live Virtual

Self Paced

Pros and Cons - ClassroomPros Cons

Ideal for smaller groups

Expensive in time and travel

Role play Expensive to scale

Lots of non-verbal communication

Not convenient

Pros and Cons – Live InternetPros Cons

Easier to scale Not great for interactions

Cost effective More distractions

Great for 1 to many communication

Need to have people on at the same time

Trainer can add non-verbal cues

Pros and Cons – Self Paced

Pros Cons

Self paced No trainee-side non verbal communication

Flexible – any time, anywhere Not ideal for role play type learning

Multi-media can be make it very immersiveTrainer can add non-verbal cues

Trainer add non-verbal

• Video• Audio – voice inflection

Trainee feedback

• Quiz answers• Surveys• Questions to trainer

• Where is the non-verbal?

Explicit feedback – Pros and Cons

• Quantifiable • Easy for trainee

• Low participation 10-25%• Often not actionable

Non-verbal feedback – Pros and Cons

• 100% coverage• Authentic• Actionable

• Cross-cultural?• Individual variations• Interpretation• Large amounts of data• Privacy concerns

Examples Today

• Samsung phones – Smart Pause• Usability testing – YouEye.com• Advertising Panels – Affectiva• FocusAssist and Engagement Score –

Mindflash - www.mindflash.com

Best Practices

• Don’t record video• Present only aggregate data

What’s Next?

• Adaptive learning paths based on learner’s non-verbal feedback – confused?

Appendix• Photo credits:

– Sleeping student– Confused girl

• Half a Minute: Predicting Teacher Evaluations• Interview Test