A Guide to Continuous Improvement Transformation: Concepts, Processes, Implementation
Continuous student assesment : implementation and results
20
Continuous student assesment : implementation and results P Truffert, D Lacroix, D Gosset M Lance, A Deroo, JC Alexandre
description
Continuous student assesment : implementation and results. P Truffert, D Lacroix, D Gosset M Lance, A Deroo, JC Alexandre. French medical studies. 6 years. DCEM4. DCEM4 ( ≈ 450 students). CSCTU faculty exam. ECN : national ranking exam About 8000 students in France. - PowerPoint PPT Presentation
Transcript of Continuous student assesment : implementation and results
Continuous student assesment : implementation and results
P Truffert, D Lacroix, D Gosset
M Lance, A Deroo, JC Alexandre
French medical studies
6 years
DCEM4
CSCTU faculty exam
ECN : national ranking examAbout 8000 students in France
DCEM4 (≈ 450 students)
Lille II rank at ECN : disappointing results
28
34
28 27
0
5
10
15
20
25
30
35
40
Rank
One of the national universities quality criteria
Csctu before 2011
Written final exam 4 medical cases scenarios to resolve
Problem solving, clinical reasoning, knowledge and therapeutic
80% of the total exam score
Oral test Bedside evaluation
Specific therapeutic oriented program
Csctu 2011 : continuous assesment
Same written/oral testing
No specific program The hole ECN program is covered by
assesment 20 assesments, 2 case scenarios each
Csctu : continuous evaluation
The « fridays »
2 cases« ecn type»Hématologia
2 cases« ecn »
Psychiatry
CourseAnd correctionHématologia
1 Corrected record
csctu
Friday1h30 evaluation 2h
Monday20 senior1 spécialist
Friday1h30 evaluationMonday
Monday Correction
Software
20 senior residents Sensibilisation
case elaboration Case correction (which keywords, what relative importance)
Présence of 1 spécialist Can modify some keywords (synonyms etc…) Sees the principal difficulties encountered by the students Can adapt the learning messages for next friday
Correction du lundi
QUESTION N° 2
Comment se définit une hypertension portale?Quelles en sont les principales manifestations cliniques absentes de l'observation?Quel est le score de Child du patient?
L'hypertension portale est définiepar une augmentation de la pression portale au-delà de 15 mm Hg 3ou par une élévation du gradient de pression porte-cave supérieur à 5 mm Hg 3
Principales manifestations cliniques absente de l'observation
Circulation collatérale cutanée abdominale 2Splénomégalie 2Oedèmes des membres inférieurs 2Hydrotorax 2
Score de ChildAscite 2; EH 1; TP 2; Bilirubine 2; Albumine 1 = Child B8 5
Sous-total pour la question 19
22%2%
47%
- 7
Continuous assesment
Weekly individualized results
Other learning facilities
Saturday morning seminars In the two last months before ECN
5 courses (3h) « best of » concerning themes chosen by the students
Evening conferences 2 per week 4 case scenarios and 3h correction
Did results change? (and how…)
Analysis strategy
Individual student ranking variation 2009-2011 Description by quartiles
Correlation between csctu ranking and ECN ranking 2011
Analysis strategy
ECN ranking estimation linear Regression Predicted values – Observed values
Under estimation : student winned + 1000 ranks at ECN
Over estimation : student lost -1000 ranks ECN Correct estimation : difference < 1000 places
Results
Ranking distribution by quartiles 2009-2011
Q Q Q Q
Results
Corrélation csctu ranking vs ECN
Correlation r : 0.8 (p<10-4)
Détermination r2 : 0.64 36% of the ECN was not explained by the csctu ranking
Results
Predictive quality of the csctu ranking
38% overestimated : falsy reassured ?
under
Over
National ranking of Lille 2 : 2007-2011
28
34
28 27
14
0
5
10
15
20
25
30
35
40
Rang
Back to the future…
Promotion effect?Waiting for 2012 confirmation…
National ranking of Lille 2 : 2007-2011
Understanding which learning and teaching issues are involved?
Thank you for your attention
