MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors...

23
MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT , 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney

Transcript of MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors...

Page 1: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT

,

2010 Data Collectors Workshop

Friday 6th August 2010Grace Hotel, Sydney

Page 2: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

Welcome

• MSOD Project Team members

• Reimbursements

• Facilities

Page 3: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

What’s On Today

Page 4: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

MSOD Project: The Big Picture

• To design and initiate a national process to collect reliable demographic and educational data on medical students across all medical schools

• To establish a national database that will provide the basis for short and long-term monitoring and reporting on outcomes of medical education programs and medical workforce planning

Handout

Page 5: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

Some research questions

• What factors influence medical students to take up rural practice?

• What are the long-term outcomes of Australian Government medical education initiatives?

• Where and how long is students’ training actually occurring (eg. rural vs. urban) as they progress through their degrees?

• What are the career plans of medical students and junior doctors, and how do these change as they move through the education/continuum?

Page 6: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

MSOD Project and MDANZ Student Statistics

Terminology MSOD ProjectMSOD Project Team

Student StatisticsMedical Deans Secretariat

Content DemographicsCareer IntentionsPlacement & ElectivesInternshipMedical Education

Selected Demographics

Who StudentMedical School (You)

Medical School (You)

Timing CMSQ (Jan-Mar)MSD (mid June)EQ (Aug-Dec)PGY1Q (Aug-Jan)

Templates (end May)

Relevance Not 100%. By consent.Detailed information about individuals.

100%Consolidated data on cohorts.

Purpose MTRP ReportsRUSC ReportEvaluation of medical education programsMedical workforce planningMedical Education Research

MTRP ReportsBenchmarking for Deans

Page 7: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

2009 Data Collectors Workshop Outcomes

• Reasons for Under-reporting to MSOD

• Sourcing Data

• Privacy Matters

• Record Management of Special Cases

• Feedback on Templates

• Complexity & Increasing Volume of Data

Page 8: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

MSOD Data Collection - What, How & When

• Commencing Students Questionnaire (CMSQ)- demographic, rurality, career intentions (location & specialty), previous tertiary education, income, scholarships

• Annual Medical Schools Data (MSD)- enrolment status, rural club membership, placements (discipline/ specialty, location, duration, type, infrastructure resourcing), electives (location, duration, type)

• Exit Questionnaire (EQ)- internship location, career intentions (location & specialty), further tertiary education, contact details, updated demographics

• Postgraduate Year 1 Questionnaire (PGY1Q)- status of current work, internship rotations, career intentions (location & specialty), contact details, updated demographics

Page 9: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

Questionnaires

Page 10: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

Medical Schools Data (MSD)

Page 11: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

Medical Schools Data (MSD)

Page 12: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

Medical Schools Data (MSD)

Page 13: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

How It’s Currently Done….

Page 14: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

CMSQ

First year of medical program

During medical program (Annually)

Final year of medical program

Medical Schools

Data

Scanned

Raw ‘Unprocessed’ Data Files

Data Cleaning

ID/ DOB/Gender

Checks

Scanning Errors

Blanks & Other Anomalies

Raw ‘Cleaned’ Data Files

Data Report

s

• Individual Medical School Data Report

• National Data Report

Exit Q

Excel Templates

Raw ‘Unprocessed’ Templates

Data Cleaning

Raw ‘Cleaned’ Templates

Scanned

Raw ‘Unprocessed’ Data Files

Data Cleaning

Raw ‘Cleaned’ Data Files

PGY1Q

At end of internship

Page 15: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

CMSQ

MSOD PROJECT DATA PROCESSING FLOW CHART

Data Cleaning

Scanned

Raw data Raw data Raw data Raw dataRaw data

Raw ‘Unprocessed’ Data Files

Blanks

Anomalies

Scanning Errors

(MSOD Project Staff)

I.D./ D.O.B./ Gender

Checks

(Medical Schools)

Page 16: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

Identity Checks - Excel Template

Medical Schools Check for Incorrect & Missing Data & Validate

Templates returned to MSOD Project

University of Medicine22415678

University of Medicine21341379……Medical SchoolUpdated I.D.

Medical School Data – Excel Templates Produced

MSOD PROJECT DATA PROCESSING FLOW CHART

GenderD.O.BI.D

male15/3/9022415678

female4/2/8521341379

Page 17: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

From 2011 onwards….

Page 18: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.
Page 19: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

Software Demonstration

Page 20: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

Discussion Topic 1: Data Inputs by Medical Schools

a)Offline Facility: Spreadsheets for Identity Checks & Medical School Data

b)Online Facility: Usability of Forms & Screens

Page 21: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

Discussion Topic 2: Data Outputs from Database

a)Data from database to spreadsheets any point

b)Online form view of your school’s data

c) Selected records and reports from the system- do we need any- standardised reports- ethics restrictions

Page 22: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

Discussion Topic 3: Other Matters

Page 23: MEDICAL SCHOOLS OUTCOMES DATABASE (MSOD) & LONGITUDINAL TRACKING PROJECT, 2010 Data Collectors Workshop Friday 6 th August 2010 Grace Hotel, Sydney.

What Happens NextWHAT WHEN

Timelines Timetable November 2010

User Accounts & Passwords Forms to be completed by schools

Forms will be provided by email to Faculty Managers in August 2010.

User Guide Version-controlled PDF document on Medical Deans website

November 2010 (version to match live usage)

Medical Schools Go Live with the New System

User Accounts & Passwords provided.

November 2010

Assistance Onsite Training

Online Help Functions on Software

Helpdesk

To Be Advised

Your Feedback Feedback Form 20th August 2010

What Else?