Phase II Stakeholder Engagement Research -...

17
Supported by the Patient - Centered Outcomes Research Institute (PCORI) Contract CDRN - 1306 - 04819 1 Phase II Stakeholder Engagement Research Katherine Kim, University of California Davis Bethany Kwan, University of Colorado Denver October 13, 2016

Transcript of Phase II Stakeholder Engagement Research -...

Page 1: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 1

Phase II Stakeholder Engagement Research

Katherine Kim, University of California DavisBethany Kwan, University of Colorado

Denver

October 13, 2016

Page 2: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 2

§ Progression in Stakeholder Engagement Research

§ Progress to date in Phase II§ Stakeholder Engagement Research

Conceptual Model

Page 3: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 3

SCANNER(2010-2013)

pSCANNER phaseI(2014-2016)

pSCANNER phaseII(2016-2019)

Progression

Page 4: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 4

• Developstakeholder-informedgovernanceframework• Understandperspectivesondatasharing• Policyexpertcouncil(10)• Patientfocusgroups(6)• Healthsysteminterviews(15)• Consumersurvey(n=800,n=1200)

SCANNER(2010-2013)

Progression

Page 5: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 5

SCANNER(2010-2013)

• Demonstratescalablestakeholderdecision-makingapproaches

• Developprioritiesforpatient-centeredoutcomesresearch(PCOR)topics• Stakeholderadvisoryboards(46stakeholders)• OnlineDelphistudy(349stakeholders:patients,caregivers,clinicians,researchers)resultinginapprovedPCORprioritiesforKD,HF,WMO

• Patientresearchwillingnesssurvey(n=2444)

pSCANNER phaseI(2014-2016)

Progression

Page 6: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 6

SCANNER(2010-2013)

pSCANNER phaseI(2014-2016)

• Formalizestakeholderengagementinandgovernanceofresearchprocess

• Evaluatestakeholderengagementinresearchdesign• Stakeholdersingovernancecommitteesandadvisoryboard(24)

• Researchco-designteamstodesignPCORprioritystudiesforKD,HF,WMO

• Visualizationsofresearchdata• EngagementFramework

pSCANNER phaseII(2016-2019)

Progression

Page 7: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 7

Patient Research Willingness Survey§ HF/WMO (n=2,444)› 10.2% response rate› 70% overweight or obese› 38% diagnosed with diabetes› 33% previously participated in research

§ KD (n=65)› 37% previously participated in research

Phase II Progress to Date

Page 8: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 8

Phase II Progress to Date

HF/WMO

Top four

Bottom four

# InterestinResearchActivitya M SD

1 Completingaone-timesurveyorlistofquestions 2.42 0.6

2 Givingabloodsampleonetime 2.32 0.68

4Testingatreatmentgivenbyphoneorovertheinternet(likegettingadviceaboutyourhealth)

2.28 0.71

3 Completingasurveytwoormoretimes 2.27 0.68

14GivingabloodsamplethatisusedtostudyyourDNA.

2.27 0.72

10Takingpartinaprojectinwhichyouwouldstayinthehospitalfor1ormoredays

1.79 0.76

11Takingpartinaprojectwhichinvolvesaproceduresuchasaspecialx-rayornewtypeofsurgery

1.79 0.73

9Takingpartinaprojectthatinvolvesyouandotherpeopleinyourfamily

1.78 0.76

19Astudyaboutweightcontrolthatrequiredsurgery

1.43 0.7

aEachactivityrated1=notinterestedto3=veryinterested

WillingnesstoParticipateinResearch(n=2,440)

Page 9: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 9

Phase II Progress to Date

HF/WMO

InterestinResearchContactbyModea(N=2,381) n %4 Personalphonecallfromresearchstafformydoctor 1,221 51.281 E-mail 858 36.043 Letterorpostcardinthemail 712 29.92 Cellphonetextmessaging 379 15.92

7Talkingface-to-facewithresearchstafformydoctorwhenIamvisitingtheclinic

361 15.16

8 Other 150 6.36 Acomputercreatedphonemessage 102 4.285 Socialmedia(suchasFacebook,Twitter,orPinterest) 18 0.76

ModeofContact

aPercentagesdonotaddupto100%asmultipleresponseswereallowed.

Page 10: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 10

§ KD Research Co-design Team› Convened: 1 KD patient and 1 KD parent (co-

investigators), 2 KD SAB members, pSCANNER(Burns, Tremoulet, Kim, Haynes, Marie)

› PCORI application submitted: A stakeholder-driven comparative effectiveness study of treatments to prevent coronary artery damage in patients with resistant Kawasaki disease.» Includes exploratory aim to evaluate patient reported

outcomes (PROs) and use of a parent observation tool to record discomfort, psychosocial concerns, and other experiences of treatment during the child’s in-hospital stay.

Phase II Progress to Date

Page 11: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 11

Phase II Progress to Date

Conceptual Framework for Characterizing Methods of Stakeholder Engagement in Research Design

§ Objective: To develop a conceptual framework to guide systematic evaluation of stakeholder engagement methods

Page 12: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 12

Research Question(s)

§ What are effective and efficient strategies for conducting multi-stakeholder engaged research?

§ Under what circumstances are different strategies most appropriate?

Concannon,T.W.,Fuster,M.,Saunders,T.,Patel,K.,Wong,J.B.,Leslie,L.K.,&Lau,J.(2014).Asystematicreviewofstakeholderengagementincomparativeeffectivenessandpatient-centeredoutcomesresearch. Journalofgeneralinternalmedicine, 29(12),1692-1701.

Page 13: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 13

§ Reciprocal relationships—clear roles and decision making

§ Co-learning—understanding by researchers and stakeholders of research process and patient-centeredness

§ Trust, transparency, and honesty—inclusive and honest communication

§ Partnership—valued time and contributions

PCORI Principles of Stakeholder Engagement

Page 14: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 14

Stakeholder Engagement Framework Elements

Definition

Who?Thetypesofstakeholders(perspectives,expertiseandexperiencewiththeresearchtopic/healthconcern)participating,andthesizeofthegroup(howmanyofeachtype);characteristicsofthosewhochoosetoparticipate

What?Thestatedobjective(s)oftheengagementeffort(whatwillbeproduced);towhataspectsofstudydesigndostakeholderscontribute

Why?Thestatedmotivationsforengagement(thereasonsforbringingtogethertheparticularstakeholdergroupandwhyeachwantstoparticipate;whatproblemtheywanttosolve)

When? Howoften,forhowlong,andoverwhatperiodoftimedostakeholdersworktogether?

Where? Inwhatsettingsdostakeholdersconvene?Istheworksynchronousorasynchronous?

How?Theprocessofengagement,includingmethodsforgatheringinput(co-learning),identifyingpathsofaction,anddecisionmaking;howstakeholderrepresentativeselicitfromthebroadercommunitytheirownperspectivesandneeds

Page 15: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 15

For each element…

§ Terminology (how do we label and describe the characteristics of the method used)› What are the variables?› Rely upon relevant existing theories, models and

frameworks » E.g., what is the ideal group size for stakeholder

engagement? à Psychology literature on group behavior and “group composition effects”

§ Goal (how do we know if it was effective?)

Page 16: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 16

§ PLAN› Have we considered all important elements?› Does the engagement approach optimally reflect

engagement principles?

§ DESCRIBE› Have we provided enough details on the

engagement approach so others may replicate?

§ EVALUATE› Which approaches work best under which

circumstances?

Application of the Engagement Framework

Page 17: Phase II Stakeholder Engagement Research - …pscanner.ucsd.edu/sites/pscanner.ucsd.edu/files/uploads/1010 - Kim... · Phase II Stakeholder Engagement Research Katherine Kim, University

SupportedbythePatient-CenteredOutcomesResearchInstitute(PCORI)ContractCDRN-1306-04819 17

§ University of California Davis› Katherine Kim, Kate Marie› Patient Co-investigator Hugo Campos

§ University of California San Diego› Howard Taras, Elizabeth Bell

§ University of Colorado Denver› Bethany Kwan, Kristen Curcija

§ University of Washington› Kari Stephens, Brenda Mollis, Gina Keppel

Stakeholder Engage. Team