Using Self and Peer Using Self and Peer Assessment in TBLAssessment in TBL

Stacey A. Jackson, M.S.Stacey A. Jackson, M.S.

William C. Hamlett, Ph.D.William C. Hamlett, Ph.D.

Rudolph M. Navari, M.D., Ph.D.Rudolph M. Navari, M.D., Ph.D.

Indiana University School of Medicine – South Bend

OverviewOverview

Institutional backgroundInstitutional background

Purpose of self and peer assessmentPurpose of self and peer assessment

Implementation at IUSM-SBImplementation at IUSM-SB

Lessons learnedLessons learned

Institutional BackgroundInstitutional Background One of eight regional campuses within the IUSM

medical education statewide system.

Responsible for first and second year medical education (move to Indianapolis for clinical years)

Class sizes for years one and two are approximately 16 students per class out of the 280 matriculates in the entire system.

IUSM-SB has a collaborative education and research relationship with the University of Notre Dame.

Purpose of Self/Peer Purpose of Self/Peer AssessmentAssessment

To give effective and constructive To give effective and constructive feedback to colleagues to simulate feedback to colleagues to simulate healthcare team situationhealthcare team situation

To introduce students to self-To introduce students to self-awareness/reflection and how their awareness/reflection and how their behavior affects future patient carebehavior affects future patient care

Implementation at IUSM-SBImplementation at IUSM-SB Selection of teamsSelection of teams

– Important to establish trust initiallyImportant to establish trust initially– Used criteria to establish initial teamsUsed criteria to establish initial teams– Made adjustments to group as necessary during year Made adjustments to group as necessary during year

(re-establish group dynamics)(re-establish group dynamics) TBL training session (TBL on TBL)TBL training session (TBL on TBL)

– Students were mailed TBL materials to study prior to Students were mailed TBL materials to study prior to beginning of classesbeginning of classes

– Training session took place on second day of classesTraining session took place on second day of classes– Explained member selection process for teamsExplained member selection process for teams– Completed IRAT/GRAT and application exercises Completed IRAT/GRAT and application exercises

(30/20/50)(30/20/50)– Students voted on weight of each component for gradeStudents voted on weight of each component for grade

Implementation cont…Implementation cont… Determination of course gradeDetermination of course grade

– TBL counted for 15% of entire course gradeTBL counted for 15% of entire course grade– Self/Peer assessment used only as grade Self/Peer assessment used only as grade

modifiermodifier ANGEL technology to capture dataANGEL technology to capture data

– Students completed assessments at end of Students completed assessments at end of course via course management softwarecourse via course management software

Feedback to studentsFeedback to students– Data aggregated and displayed over time/courseData aggregated and displayed over time/course– Reviewed comments for any inappropriate Reviewed comments for any inappropriate

languagelanguage– Example of improvementExample of improvement

Evaluation ProcessEvaluation Process

Before taking evaluations discussed Before taking evaluations discussed Ende’s article on Feedback in Clinical Ende’s article on Feedback in Clinical Medical EducationMedical Education

Students completed self assessment one Students completed self assessment one time at end of first block (Histology)time at end of first block (Histology)

Completed peer assessments at end of Completed peer assessments at end of each course offering TBLeach course offering TBL

Domains included:Domains included:– Cooperative learning skillsCooperative learning skills– Self-directed learningSelf-directed learning– Interpersonal skillsInterpersonal skills

Technology and Sample Technology and Sample EvaluationEvaluation

Sample Feedback to Sample Feedback to StudentsStudents

Lessons LearnedLessons Learned

IUSM-SBIUSM-SB– Configuration of groups essentialConfiguration of groups essential– Training session before first TBLTraining session before first TBL

Thoughts from other schools?Thoughts from other schools?