Medical Training Application Process (MTAS) – 2008-09 revised for 2012EPM additions for Dec11 added

Academic Scoring (‘Ranking’)Special Circumstances

‘Strugglers’Referees

Author - Prof David James, former Director of Medical EducationRevisions – Curriculum Policy Group October 2010

Additional detail on deciles and Parallel Recruitment Exercise November 2011

Academic Scoring – Principles

Principles 16-06-06: Initial meeting (ISC representation)

discussion of the ‘rules’ for the ranking process Wider discussion amongst the student body to

reach the final agreed approach Summary of agreed ranking process:

performance in Clinical Phases 1 and 2 final overall mark being derived from the

following by evaluating a credit weighted mean across the 8 modules

Untaken (1st sit) assessments excluded and total credits reduced in weighted sum

Academic Scoring – Overall score

Clinical Practice *– Total CP % (based from combined Knowledge/Skills mark in a 50/50 ratio) x 50

CFU – CFU % x 15

Therapeutics –Therapeutics % x 15

Child Health – Total % (based on combined Knowledge/Skills mark in a 50/50 ratio) x 50

Obstetrics and Gynaecology - Total % (based on combined Knowledge/Skills mark in a 50/50 ratio) x 50

Health Care of the Elderly – HCE % (based on combined Knowledge/Skills mark in a 33/67 ratio) x 20

Psychiatry – Total % (based on combined Knowledge/Skills mark in a 50/50 ratio) x 30

Specials - Specials % (based on combined Knowledge/Skills mark in a 50/50 ratio) x 30

* CP Ratio is 50:50 for those beginning CP in Feb 2011 and for those graduating in 2013; until then 70:30 is used

Credit weighted mean across the 8 modules (total out of 26000)

Academic Scoring – ExampleSubject Know

or Only%

Skill%

Overall ratio

Overall%

Adjust-ment factor

Maxmark

Actual Mark

Percent

Clinical Practice

62 71 50:50 67 50 5000 3350

CFU

Theraptix

Child HealthO & G

HCE

Psyche

Specials

TOTAL

Academic Scoring – ExampleSubject Know

or Only%

Skill%

Overall ratio

Overall%

Adjust-ment factor

Maxmark

Actual Mark

Percent

Clinical Practice

62 71 50:50 67 50 5000 3350

CFU 61 - - 61 15 1500 915

Theraptix

Child HealthO & G

HCE

Psyche

Specials

TOTAL

Academic Scoring – ExampleSubject Know

or Only%

Skill%

Overall ratio

Overall%

Adjust-ment factor

Maxmark

Actual Mark

Percent

Clinical Practice

62 71 50:50 67 50 5000 3350

CFU 61 - - 61 15 1500 915

Theraptix 73 - - 73 15 1500 1095

Child HealthO & G

HCE

Psyche

Specials

TOTAL

Academic Scoring – ExampleSubject Know

or Only%

Skill%

Overall ratio

Overall%

Adjust-ment factor

Maxmark

Actual Mark

Percent

Clinical Practice

62 71 50:50 67 50 5000 3350

CFU 61 - - 61 15 1500 915

Theraptix 73 - - 73 15 1500 1095

Child Health

69 54 50:50 62 50 5000 3100

O & G

HCE

Psyche

Specials

TOTAL

Academic Scoring – ExampleSubject Know

or Only%

Skill%

Overall ratio

Overall%

Adjust-ment factor

Maxmark

Actual Mark

Percent

Clinical Practice

62 71 50:50 67 50 5000 3350

CFU 61 - - 61 15 1500 915

Theraptix 73 - - 73 15 1500 1095

Child Health

69 54 50:50 62 50 5000 3100

O & G 74 70 50:50 72 50 5000 3600

HCE

Psyche

Specials

TOTAL

Academic Scoring – ExampleSubject Know

or Only%

Skill%

Overall ratio

Overall%

Adjust-ment factor

Maxmark

Actual Mark

Percent

Clinical Practice

62 71 50:50 67 50 5000 3350

CFU 61 - - 61 15 1500 915

Theraptix 73 - - 73 15 1500 1095

Child Health

69 54 50:50 62 50 5000 3100

O & G 74 70 50:50 72 50 5000 3600

HCE 44 56 33:67 52 20 2000 1040

Psyche

Specials

TOTAL

Academic Scoring – ExampleSubject Know

or Only%

Skill%

Overall ratio

Overall%

Adjust-ment factor

Maxmark

Actual Mark

Percent

Clinical Practice

62 71 50:50 67 50 5000 3350

CFU 61 - - 61 15 1500 915

Theraptix 73 - - 73 15 1500 1095

Child Health

69 54 50:50 62 50 5000 3100

O & G 74 70 50:50 72 50 5000 3600

HCE 44 56 33:67 52 20 2000 1040

Psyche 65 57 50:50 61 30 3000 1830

Specials

TOTAL

Academic Scoring – ExampleSubject Know

or Only%

Skill%

Overall ratio

Overall%

Adjust-ment factor

Maxmark

Actual Mark

Percent

Clinical Practice

62 71 50:50 67 50 5000 3350

CFU 61 - - 61 15 1500 915

Theraptix 73 - - 73 15 1500 1095

Child Health

69 54 50:50 62 50 5000 3100

O & G 74 70 50:50 72 50 5000 3600

HCE 44 56 33:67 52 20 2000 1040

Psyche 65 57 50:50 61 30 3000 1830

Specials 68 62 50:50 65 30 3000 1950

TOTAL

Academic Scoring – ExampleSubject Know

or Only%

Skill%

Overall ratio

Overall%

Adjust-ment factor

Maxmark

Actual Mark

Percent

Clinical Practice

62 71 50:50 67 50 5000 3350

CFU 61 - - 61 15 1500 915

Theraptix 73 - - 73 15 1500 1095

Child Health

69 54 50:50 62 50 5000 3100

O & G 74 70 50:50 72 50 5000 3600

HCE 44 56 33:67 52 20 2000 1040

Psyche 65 57 50:50 61 30 3000 1830

Specials 68 62 50:50 65 30 3000 1950

TOTAL 26000 16880 64.9%

Academic Scoring – Ranking score Whole final year are then ranked according to the

overall percent score Academic Ranking Component of MTAS Application

comprises 40% of the final score (with the other 60% coming from the non-academic component)

Each medical school divides final year into quartiles according to their academic score ranking

% mark out of 40 to use in the Application will be 40 for those on 75th centile and above 38 for those on 50th centile up to 75th centile 36 for those on 25th centile up to 50th centile 34 for those below the 25th centile

Any resit student is automatically in the 4th quartile

Total percent vs Rank order (328 students) 2007 data

Total percent vs Rank order (325 students) 2010 data

0 50 100 150 200 250 300 35040

45

50

55

60

65

70

75

80

Rank Order

Perc

ent

Ranking cut off points (2007 data)

68.4%64.6%

61.3%

Ranking cut off points 2007onQuartile 2007 2008 2009 August

2010August2011

2012 2013

1st 67.56 68.4 69.10 68.39 69.43

2nd 63.20 64.6 65.80 64.24 65.51

3rd 58.47 61.3 61.50 60.15 61.71

4th (lowest %)

37.52 Not known 49.52 51.45 46.46

Most subject results are correlated

R = 0.51; p<0.0001

R = 0.37; p<0.0001

Except with CFU

R = 0.10; p = N/S

‘Strugglers’

Identified during UG Course Academic problems Medical problems Domestic and other problems

Clinical subdean involvement

Liaison with Deanery with permission September (‘shortlist’) June (‘final shortlist’)

Advice to make on-scheme applications and placements before applications open

Special Circumstances - application to Foundation Programmes

Significant family responsibilities - most commonly a student who has responsibility as the primary carer for a young, school-age child or for a seriously ill partner or first degree relative.

Chronic illness (physical or psychological) or disability for which local follow up is an absolute requirement as confirmed by an Occupational Health report.

Terminally ill first-degree relative living locally as confirmed by a doctor's note.

Referees

Two senior doctors They should know you (from any other

student)! They should have been impressed by you

(rapport)! Eg Consultant of firm especially if you are

interested in a specific career pathway Ask them if they would be prepared to be

a referee Confirm with an email and a copy of your

CV (layout like on-line reference form) Let them know your choice

EPM – Deciles for December 2011 Process for calculating aggregate score

exactly as before – same basket of assessments and weightings

Whole final year are then ranked according to the overall percent score

Deciles will score: 43, 42, 41, 40, 39,38, 37 36, 35, 34

Final Year Resit students will NOT be automatically placed in former lowest score (34 in quartiles) but student retains original ranking from earlier round and decile used

ISFP feeds back your decile in March 2012

Any Questions?

Nottingham EPM/SJT TeamSJT Lead - Judith.Franklin@nottingham.ac.ukSJT Lead - Giorgio.Vitale@nottingham.ac.uk EPM Lead - John.Whittle@nottingham.ac.uk

?