NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

39
Follow us @nccmt Suivez-nous @ccnmo Funded by the Public Health Agency of Canada | Affiliated with McMaster University The views expressed here do not necessarily reflect the views of the Public Health Agency of Canada. EPHPP: Quality Assessment Tool for Quantitative Studies Presenters: Maureen Dobbins, RN, PhD Megan Racey, MSc October 18, 2016 1:00 2:30 PM ET

Transcript of NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Page 1: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Funded by the Public Health Agency of Canada | Affiliated with McMaster UniversityThe views expressed here do not necessarily reflect the views of the Public Health Agency of Canada.

EPHPP: Quality Assessment Tool for

Quantitative Studies

Presenters:

Maureen Dobbins, RN, PhD

Megan Racey, MSc

October 18, 2016

1:00 – 2:30 PM ET

Page 2: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 2

Housekeeping

Use Q&A to post comments / questions

during the webinar

• ‘Send’ questions to All (not

privately to ‘Host’)

Connection issues

• Recommend using a wired

Internet connection (vs. wireless),

• WebEx 24/7 help line

• 1-866-229-3239

Participant Side

Panel in WebEx

Q&A

Page 3: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 3

After Today

The PowerPoint presentation (in English and French)

and English audio recording will be made available.

These resources are available at:

PowerPoint: http://www.slideshare.net/NCCMT/

Audio Recording:

https://www.youtube.com/user/nccmt/videos

Page 4: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 4

Poll Question #1

How many people are watching today’s session with you?

A. Just meB. 1-3C. 4-5D. 6-10E. >10

Page 5: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Your profession? Put a √ on your answer (or RSVP via email)

/

Epidemiologist Management (director,

supervisor, etc.)

Allied health

professionals (nurse,

dietician, dental

hygenist, etc.)

Librarian Physician / Dentist Other

5

Page 6: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Quality Assessment Tool for

Quantitative Studies

http://www.nccmt.ca/resources/search/14

Episode 28

6

Page 7: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

NCC

Infectious

DiseasesWinnipeg, MB NCC

Methods

and ToolsHamilton, ON

NCC Healthy

Public PolicyMontreal, QC

NCC

Determinants

of HealthAntigonish, NS

NCC

Aboriginal

HealthPrince George, BC

NCC

Environmental

HealthVancouver, BC

7

Page 8: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Registry of Methods and Tools

Online Learning Opportunities

WorkshopsMultimedia

Public Health+

Networking and Outreach

NCCMT Products and Services

8

Page 9: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 9

Poll Question #2

How familiar are you with the method or tool we are discussing today?

A. I am not familiar with the method or toolB. I have heard of the method or toolC. I have used the method or tool

Page 10: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 10

Presenter

Maureen Dobbins, RN, PhD

Scientific Director, Health Evidence and the National Collaborating Centre for Methods and Tools

McMaster University

Page 11: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Presenter

Megan Racey, MSc

PhD Candidate, Department of Human Health and Nutritional Sciences

University of Guelph

11

Page 12: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 12

Page 13: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Effective Public Health Practice Project

• Conducted 35 systematic reviews since 1999

• Creates knowledge dissemination materials

• Expedited reviews, methods and tools for quality

assessment, critical appraisal, and knowledge

synthesis

• Establishment of McMaster Evidence Review

and Synthesis Centre (MERSC)

13

Page 14: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Quality Assessment Tool for Quantitative Studies

• Developed for use in public health

• Can be applied to articles in any public health area

• Suitable for public health researchers,

practitioners and policymakers

• Two independent reviewers

14

Page 15: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Tool Development

15

Page 16: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Components

• Tool for overall methodological rating

• 8 component ratings synthesized to one global

rating

• Guide to generating interrater agreement

• Dictionary of terms

• Definitions relevant to each component

• Ensures standardized results

16

Page 17: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 17

Page 18: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 18

Page 19: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 19

Page 20: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 20

Page 21: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 21

Page 22: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 22

Page 23: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 23

Page 24: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 24

Page 25: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Global Rating

25

• Strong, Moderate or Weak

• Based on individual component ratings A-F

• Dictionary provides guide to completing this

section based on individual component ratings

• Example dictionary section:

Page 26: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 26

Page 27: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Interrater Agreement

27

Page 28: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Presenter

Megan Racey, MSc

PhD Candidate, Department of Human Health and Nutritional Sciences

University of Guelph

28

Page 29: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Overview of my research

• Improving the success of nutrition education intervention relies on careful

planning of their design and feasibility of their evaluation

• There is little to guide researchers on how to best develop interventions

• We’ve conducted systematic reviews to identify characteristics of effective

interventions related to our target audience, food group focus and study

setting

• From this, we’ve developed a school-based intervention, Why Dairy and

Alternatives

29

Page 30: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

My use of EPHPP

• Used for quality assessment of dairy-specific

interventions in adolescents for systematic

review

30

Page 31: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Excerpt of

table with

quality rating

31

Marquez et al. ICAN 2015.

Page 32: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Why I choose EPHPP

• Experience/familiarity

• Ease of use

• Clarity

• Accessibility

• Applicability

• Practicality

32

Page 33: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

My experience

• Was easy to use

• Tool dictionary was a well-utilized resource

• Reliant on information provided by the

researcher/author of the study

• Required research judgement

33

Page 34: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 34

Your Comments/Questions

• Use Q&A to post comments

and/or questions

• ‘Send’ questions to All (not

privately to ‘Host’)

Participant Side

Panel in WebEx

Q&A

Page 35: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 35

Poll Question #3

Could this method or tool be useful

in practice?

A. Very usefulB. Somewhat useful C. Not at all usefulD. Don’t know

Page 36: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 36

Your Feedback is Important

Please take a few minutes to share your thoughts

on today’s webinar.

Your comments and suggestions help to improve

the resources we offer and plan future webinars.

The short survey is available at:

https://nccmt.co1.qualtrics.com/SE/?SID=SV_7ZJ

HPbeSunMTH7L

Page 37: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 37

Poll Question #4

What are your next steps? (Check all

that apply)

A. Access the method/tool referenced in the presentation

B. Read the NCCMT summary about the method/tool described today

C. Consider using the method/tool in practiceD. Tell a colleague about the method/tool

Page 38: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo 38

Join us for our next webinarNCCMT Spotlight on Methods & Tools: NCCMT

Resources Mapped to the Core Competencies for

Public Health

DATE: Wednesday, November 23, 2016

TIME: 1:00-2:30pm EST

We have created a new tool on our website to help busy

practitioners find the many resources available from the NCCMT

that can support PHAC’s Core Competencies for Public Health in

Canada. This tool helps individuals and organizations find NCCMT

resources related to each competency so you can plan professional

development activities tailored to your own needs or those of your

team. Join us to learn more!

Register at: https://health-evidence.webex.com/health-

evidence/onstage/g.php?MTID=e3b12586dc598976035989f2f4e6152d3

Page 39: NCCMT Spotlight Webinar: EPHPP: Quality Assessment Tool for Quantitative Studies

Follow us @nccmt Suivez-nous @ccnmo

Funded by the Public Health Agency of Canada | Affiliated with McMaster UniversityThe views expressed here do not necessarily reflect the views of the Public Health Agency of Canada.

For more information about the

National Collaborating Centre

for Methods and Tools:

NCCMT website www.nccmt.ca

Contact: [email protected]