Learning from others: Why we need not reinvent the wheel...

23
Learning from others: Why we need not reinvent the wheel implementing CBME in Canada Drs. Colm McCarthy & Matthew Nicholson April 30, 2017

Transcript of Learning from others: Why we need not reinvent the wheel...

Page 1: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Learning from others: Why we need not reinvent the wheel

implementing CBME in Canada Drs. Colm McCarthy & Matthew Nicholson

April 30, 2017

Page 2: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Disclosure

u We do not have any relevant financial relationships with commercial interests that pertain to the content of this presentation.

Page 3: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Why look outside of medicine?

u Are medical competency strategies particularly unique?

u High Risk

u Broad competencies

u What are their shared traits?

u Competency based

u Shared means of assessment and teaching

Page 4: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

How to search the Grey literature

u Grey literature consists of articles that are typically not found within peer-reviewed articles and journals.

u Typically this search is labor intensive and requires strict vetting of articles.

u Search engines typically must be broad engines, such as Google.

u Google Scholar and Pubmed are typically too narrow.

Page 5: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

How to find the signal in the noise

u Focused search engine with relevant use of keywords.

u Librarians are an excellent resource.

u Abstract review

u Full text review

Page 6: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

What fields have CBD type training?

u Agriculture

u Nursing

u Food Inspection

u Education

u Aviation

Page 7: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Resource 1: “Competency-Based Learning or Personalize Learning”u US Department of Education

u Extensive list of examples of CBD implementation in American learning institutions on the state and district levels.u Hyperlinked

u Summaries

u Example New Hampshire HSu Specific Course Level

Competencies

u Clarification of competencies with grading rules

u Example New Hampshire HS

u Follow the Child Campaign

u Individualized learning tracks

u Students as active learners

u Time Flexible

u Specific Course Level Competencies

u Clarification of competencies with grading rules

Page 8: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Resource 2: “Safe Food Canada: The Learning Partnership” u Government of Canada Website

u Highly complicated curriculum

u Very convoluted means of progression

u Archived article

u Chance of failure

Page 9: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Resource 3: “Design and Implementation of a Competency-Based Transfusion Medicine Training Program in Canada” u Transitioned from a

Competency/Time model to a pure CB curriculum.

u Review describes this process and the its application.

u Trainees are generally self sufficient, educated, and motivated.

u Assessment based on Miller’s Pyramid.

Page 10: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Resource 4: “Challenges in Developing Competency Based Training Curriculum for Food Safety Regulators in India” u Goals were to Identify

competencies, develop a CB training curriculum, and develop training materials to train the workforce.

u Five training modules were developed.

u Major challenge is implementation and resources for implementation.

u Curriculum Design:

u In-depth review of syllabus and assessment.

u Review of international materials with a dedicated research team.

u Multiple workshops and group meetings to assemble the final curriculum.

Page 11: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Resource 4 (cont.)

Page 12: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Resource 5: “Veterans Affairs Interprofessional Nurse Practitioner Residency in Primary Care: A Competency-Based Program”u Development of an assessment tool

for NP’s to show effectiveness and competence in essential interprofessional team based care:u Ability to assess

u Diagnosis

u Treatment

u Management of common acute and chronic conditions

u Patient centered care

u Leadership

u Performance Improvement

u Population Health

u Tool:

u EPA based

u Entrustment Likert

u Observer->Supervisor

u Qualitative Open Ended Questions

u Curriculum:

u Workplace/Experiential

u Didactic sessions

u Self Evaluation and Mentor Evaluations

Page 13: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

How do these fields relate to medicine?

u Transfer - near/far

u Assessment Models

u Continuing Education Models

u Curriculum planning

Page 14: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

So What?

u Why do we care?

u Why is this relevant?

u What can we learn?

Page 15: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Workshop and Panel Discussion

Page 16: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Workshop and Panel Discussion

u What do you think are two examples of “best practice” of competency-based education in your experience?

Page 17: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Workshop and Panel Discussion

u What are two examples of “Worst Practice” of competency-based education in your experience?

u Judgment Free Zone please!

Page 18: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Workshop and Panel Discussion

u Moving forward, what fields outside of medicine do you feel are particularly rich for application towards CBME?

u What are the untapped resources?

Page 19: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Workshop and Panel Discussion

u Is CBD better for more advanced learners?

u What does this mean?

Page 20: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Workshop and Panel Discussion

u What can we learn from the grey literature about curriculum design when planning for CBME?

Page 21: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

Workshop and Panel Discussion

u What can we learn about assessment from outside fields when considering CBME?

Page 22: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date:

References

u Larson, G. (1982). The far side. Andrews and McMeel.

u Thippaiah, A., Allagh, K. P., & Murthy, G. V. (2014). Challenges in developing competency-based training curriculum for food safety regulators in India. Indian journal of community medicine: official publication of Indian Association of Preventive & Social Medicine, 39(3), 147.

u US Department of Education “Competency-Based Learning or Personalized Learning,” https://www.ed.gov/oii-news/competency-based-learning-or-personalized-learning

u Government of Canada “Safe Food Canada: The Learning Partnership,” Government of Canada website, June 17-18, 2014 http://www.inspection.gc.ca/about-the-cfia/transforming-the-cfia/action-plan/food-regulatory-forum/presentations/safe-food-canada/eng/1401631385284/1401631386315

u Zeller, M. P., Sherbino, J., Whitman, L., Skeate, R., & Arnold, D. M. (2016). Design and Implementation of a Competency-Based Transfusion Medicine Training Program in Canada. Transfusion medicine reviews, 30(1), 30-36.

u Rugen, K. W., Speroff, E., Zapatka, S. A., & Brienza, R. (2016). Veterans Affairs Interprofessional Nurse Practitioner Residency in Primary Care: A Competency-based Program. The Journal for Nurse Practitioners, 12(6), e267-e273.

u Lobo, L. G., & Pérez, M. I. L. (2014). Certification of agricultural popular knowledge by using a competency-based training curriculum for universities. Economía, 39(37), 35-56.

u Lawson, R. A., Blocher, E. J., Brewer, P. C., Cokins, G., Sorensen, J. E., Stout, D. E., ... & Wouters, M. J. (2013). Focusing accounting curricula on students' long-run careers: Recommendations for an integrated competency-based framework for accounting education. Issues in Accounting Education, 29(2), 295-317.

u Ott, M., Baca, E., Cisneros, J., & Bates, E. (2015). A competency-based approach to the master's degree preparation of higher education professionals. Journal of Case Studies in Accreditation and Assessment, 4, 1.

Page 23: Learning from others: Why we need not reinvent the wheel ...residentdoctors.ca/.../2017/05/Grey-lit-Presentation-for-CCME-R2.pdf · Grey lit Presentation for CCME-R2 Created Date: