LACE Spring Briefing - WatchMe project overview
25
www.project-watchme.eu @Project_WatchMe Workplace-based e-Assessment Technology for Competency-based Higher Multi-professional Education . Marieke van der Schaaf, PC, Utrecht University, The Neth Denise Janssen, Mateum, The Neth.
-
Upload
lace-project -
Category
Data & Analytics
-
view
175 -
download
0
Transcript of LACE Spring Briefing - WatchMe project overview
www.project-watchme.eu
@Project_WatchMe
Workplace-based e-Assessment Technology for Competency-based Higher Multi-professional Education
.
Marieke van der Schaaf, PC, Utrecht University, The Neth Denise Janssen, Mateum, The Neth.
1.Utrecht University, NL 2.University Medical Centre Utrecht, NL3.Szent Istvan University, Hungary4.University of Tartu, Estonia5.Universitätsmedizin Charité Berlin, Germany6.University of California San Francisco, USA 7.Maastricht University, NL8.Mateum, NL9.University of Reading, UK10.Jayway, Denmark 11.NetRom, Rumania/NL
WATCHME’S AIM
Solve efficiency and quality problems of workplace-based feedback and assessment by means of a mobile electronic portfolio system that is enhanced with a feedback module and a visualization module.
- Develop complex competences- Integrated in context- Demands long learning trajectories in workplace- Deliberate practice: feedback and reflection
Medical expert
Communicator
Collaborator
Manager
Health advocateScholar
Professional
CRITICS COMPETENCY-BASED ASSESSMENT
MOST CRITICS COME DOWN TO THE ANALYTIC APPROACH (E.G. CANMEDS)
Source: Ten Cate
Medical expert
Communicator
Collaborator
Manager
Health advocateScholar
Professional
THE ANALYTIC APPROACH
With nursing staffWith family
With patients
With colleagues
With trainees
…
Source: Ten Cate
Medical expert
Communicator
Collaborator
Manager
Health advocateScholar
Professional
THE ANALYTIC APPROACH
With nursing staffWith family
With patients
With colleagues
With trainees
…
Consultation
Breaking bad newsExplain medicationWith children
With elderly
…Source: Ten Cate
Medical expert
Communicator
Collaborator
Manager
Health advocateScholar
Professional
THE SYNTHETIC FRAMEWORK APPROACH
EPA1
EPA2
EPA3
EPA4
EPA5
Source: Ten Cate
ENTRUSTABLE PROFESSIONAL ACTIVITY
Task based instead of construct based approach
Crucial question: would I entrust this candidate unsupervised with this task? (with my sick mother, animal or teach my daughter/son…)
An EPA is a task that an individual can be trusted to perform unsupervised, in a given professional context, once sufficient competence has been demonstrated. International Competency-Based Medical Education Collaborators, March 18, 2014
Source: Ten Cate
COMBINE EPA APPROACH WITH LEARNING ANALYTICS
Application of probabilistic student models that enable tailored visualised feedback based on multi sorted assessments
Bayesian models provide detailed model of trainees’ entrustability
E A R L I S I G 1 M A D R I D A U G 2 0 1 4
ELECTRONIC PORTFOLIO
E A R L I S I G 1 M A D R I D A U G 2 0 1 4
E A R L I S I G 1 M A D R I D A U G 2 0 1 4
E A R L I S I G 1 M A D R I D A U G 2 0 1 4
E A R L I S I G 1 M A D R I D A U G 2 0 1 4
E A R L I S I G 1 M A D R I D A U G 2 0 1 4
E A R L I S I G 1 M A D R I D A U G 2 0 1 4
E A R L I S I G 1 M A D R I D A U G 2 0 1 4
E A R L I S I G 1 M A D R I D A U G 2 0 1 4
E A R L I S I G 1 M A D R I D A U G 2 0 1 4
EXAMPLE JUST-IN-TIME FEEDBACK
Before workplace-based assessment is performed
EPASS displays just-in-time feedback concerning learner.
E.g.: “remind your communication skills towards patient. Explain treatment in simple words”.
EXAMPLE JUST-IN-TIME FEEDBACK
QUESTIONS OR WOULD YOU LIKE TO HAVE A LOOK AT EPASS?
CONTACT ME DURING LUNCH BREAK!
THANK YOU FOR YOUR ATTENTION!
Architecture
database
Mobile device
Student Model Database
Learning Analytics Engine
-Online Learning
Just in time Feedback
Aggregated Visualisation
Portfolio system(ePASS)
WPB AssessmentGAME
EPA Matrix
ARCHITECTURE
COMBINING THE COMPETENCY-FRAMEWORK WITH ENTRUSTABLE PROFESSIONAL ACTIVITIES
Medical expert
Communicator
Collaborator
Manager
Health advocateScholar
Professional
+
+
+
+
+
++
++
+
+
+
+
++
++
+
++
++
+
++
+
++
EPA1 EPA2 EPA3 EPA4 EPA5
AssessmentSource: Ten Cate
