QUALITY IMPROVEMENT - McMaster University
Transcript of QUALITY IMPROVEMENT - McMaster University
![Page 1: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/1.jpg)
QUALITYIMPROVEMENTCriticalappraisalofQIliterature
Dr.JenniferTwissMSc,MDFRCPC
![Page 2: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/2.jpg)
Disclosure
• Ideclarenopersonalorfinancialconflictofinterestinthispresentation
• Therewillbenodiscussionofunlicenseddrugsortherapiesduringthispresentation
![Page 3: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/3.jpg)
Objectives
• ThevalueofQIresearchinthepracticeofevidencedbasedmedicine
• AppreciatethecommondifficultiesofQIresearch
• UseofcurrentframeworkstoassessthequalityofpublishedQIresearch
• ReviewstudydesignsthatleadtohighqualityQIresearch
![Page 4: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/4.jpg)
PollEV• PleasesignintoPOLLEVwithyourcellphones
• TextJENNIFERTWIS625to37607oncetojoin
![Page 5: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/5.jpg)
WhatisQualityImprovement?• QUALITYIMPROVEMENTINHEALTHCARE• Together,makingcarebetter:supportingandpromotingsubstantialandsustainablepositiveimprovementsincare– It’slookingforopportunitiesforimprovement,implementingevidencebasedmedicinepractices,tryingnewapproaches,andadoptingthemiftheywork.
• Systematic,data-guidedactivitiesdesignedtobringaboutimmediateimprovementsinhealthdeliveryinparticularsettings
• Improvingthequalityofcareofpatientsisafundamentalobligationofhealthcareproviders– TheQIprocessinvolvesevaluatingandlearningfromexperience
![Page 6: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/6.jpg)
ModelforImprovement
LangleyGL,MoenR,NolanKM,NolanTW,NormanCL,ProvostLP.TheImprovementGuide:APracticalApproachtoEnhancingOrganizationalPerformance(2ndedition).SanFrancisco:Jossey-BassPublishers;2009
![Page 7: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/7.jpg)
HumanSubjectsResearch QualityImprovement
Purpose developorcontributetogeneralizableknowledge implementknowledge,assessaprocessorprogramasjudgedbyacceptedstandards
StartingPoint independentofroutinecareandintendedtoansweraquestionortestahypothesis
integraltoongoingmanagementsystemfordeliveringhealthcare
Design followsarigidprotocolthatremainsunchangedthroughouttheresearch
adaptive,iterativedesign
Benefitsmightormightnotbenefitcurrentsubjects;intendedtobenefitfuturepatients
directlybenefitsaprocess,systemorprogram;mightormightnotbenefitpatients
Risks mayputsubjectsatrisk doesnotincreaserisktopatients
ParticipantObligation
noobligationofindividualstoparticipate responsibilitytoparticipateascomponentofcare
Endpoint Answeraresearchquestion improveaprogram,processorsystem
Analysis Statisticallyproveordisprovehypothesis compareprogram,processorsystemtostandards
AdoptionofResults
littleurgencytodisseminateresultsquickly resultsrapidlyadoptedintolocalcaredelivery
Publication/Presentation
investigatorobligedtoshareresults QIpractitionersencouragedtosharesystematicreportingofinsights
Tableadaptedfrom:https://irb.research.chop.edu/quality-improvement-vs-research
![Page 8: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/8.jpg)
QualityImprovementisDifferent
• Focusonstudying– Howtoimplementbestpracticesindifferentcontexts
– Applicationoftherapiesknowntoworkindifferentpopulations
– Howproventherapiesfunctioninanuncontrolledenvironment
![Page 9: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/9.jpg)
QualityImprovementisDifferent• Iterativedesign
– Theimplementationstrategychangesovertimebasedontheoutcomeofsmalltestsofchange
– Multiplechangesoccurtolookateffectononeultimateoutcome
BillimoriaZetal.J.Perinat.Med.2013;41(4):455-460
![Page 10: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/10.jpg)
QualityImprovementisDifferent• Innovation
– Adaptationtoachangingcomplexenvironment– Changeandadaptationconductedusingdataandstructure
SkiboMetal.JournalofPerinatology(2017)37,1341-1345
![Page 11: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/11.jpg)
BataldenPB,DavidoffF.QualSafHealthCare2007;16:2-3
![Page 12: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/12.jpg)
![Page 13: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/13.jpg)
QualityImprovementResearch
• Studyofthenetbenefitofexistingtherapiesindifferentenvironmentsandpopulations– Changebehavior– Implementationofacceptedclinicalpractices– Changesinthedeliveryofhealthcare– Practicalproblemsolving– Innovationandadaptation
![Page 14: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/14.jpg)
FeaturesofQualityImprovementResearch
• Descriptionofthemotivationforchange• Rationale
“Overrecentdecadestherehasbeenasignificantreductioninthecongenitalheartdiseasemortalityrate.Asaresult,increasingemphasishasbeenplacedonreducingmorbidityandidentifyingmarkersofcaredeliverysuchashospitalLOSandincidenceofhospitalreadmission.Thepaediatriccardiacpopulationisatparticularriskforin-hospitaldeteriorationandsubsequentreadmissiontothecardiacintensivecareunit(CICU).”
StoreyJetal.BMJQualSaf2018;27:66-72
![Page 15: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/15.jpg)
FeaturesofQualityImprovementResearch
• Descriptionofthemotivationforchange– HospitalreadmissiontopediatricCICUassociatedwithmortality
• Assumptions– Preventionofreadmissions
• Nodatalookingatpreventingreadmission– Higherrateofreadmissions
• Internaldatademonstratetherearereadmissions,nothighnobenchmarkdata
– Standardizedtransferofcare• Notexisting
– Standardizedmonitoringbasedonrisk• Notexisting
StoreyJetal.BMJQualSaf2018;27:66-72
![Page 16: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/16.jpg)
FeaturesofQualityImprovementResearch
• Descriptionofthemotivationforchange• Hypothesis1
– Subtleclinicalchangesoccurandgounrecognizedduetolackofpatientspecificmonitoringleadingtomoreurgentandcomplexinterventions
• Hypothesis2– ComplicancewithstandardizedcareprocessbasedonriskorconditionwouldreduceinhospitalreadmissionsbacktotheCICUwithin48hoursoftransfer
StoreyJetal.BMJQualSaf2018;27:66-72
![Page 17: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/17.jpg)
FeaturesofQualityImprovementResearch
• Descriptionofthecontext• Physical
“HutzelWomen’sHospitalisanurban,academicwomen’shospitalwitha55-bedlevel3inbornNICUandspecialcarenurseryalongwithahigh-riskmaternal-fetalmedicineservice.Thereareabout5500deliverieseachyear.ThedeliveryareasareconnectedtotheNICUbyanenclosedbridge,whichtakes1–3mintotraverse.Deliveryofapre-matureneonate(<32weeks’gestationalage)isattendedbyaneonatalfellow,anursepractitioner,arespiratorytherapist,andtworesidents.Aneonatologyattendingphysicianattendsdeliveriesofinfantsat<32weeks’gestationduringthedayshifts,andaneonatalnurseattendssomedeliveriesanticipatedtoneedextensiveresuscitation.”
BillimoriaZetal.J.Perinat.Med.2013;41(4):455-460
![Page 18: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/18.jpg)
FeaturesofQualityImprovementResearch
• Descriptionofthecontext• Cultural
“OurorganisationhasamaturequalityimprovementinfrastructurewithinourCenterforHealthSystemsExcellence.Hospitalfacultyandstaffaretrainedinimprovementscienceviamultiplecourseofferings.”
StoreyJetal.BMJQualSaf2018;27:66-72
![Page 19: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/19.jpg)
FeaturesofQualityImprovementResearch
• Descriptionofthecontext• Resources
“Qualityimprovementconsultantsanddataanalystsprovideassistanceformanyimprovementprojects.”
StoreyJetal.BMJQualSaf2018;27:66-72
![Page 20: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/20.jpg)
FeaturesofQualityImprovementResearch
• Datacollectiontodrivetheimprovementefforts• Systematic
– Onepretestandtwoposttestmeasurements(3and12months)
– 3ICUsreceivedtrainingandcomparedwithamatchedcontrolunit
– Educationdeliveredtoallgroupsofstaff– Usinganevaluationframework– Mixedmethoddesignusingquestionnaires,observationsandpatientoutcomedata
KemperPFetal.BMJQualSaf2016;25:577-587
![Page 21: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/21.jpg)
QIPitfalls
• Generalizability– Contextdependent– Lessabletoproduceconsistentresults
![Page 22: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/22.jpg)
![Page 23: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/23.jpg)
QIResearchPitfalls
• Complex– Multipleinterventions– Multipletimeperiods– Mayrequirefinancialbackingandpersonnel
![Page 24: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/24.jpg)
DifficultiesinQIResearch
• Highriskofbias– Factorssuchasenvironment,resourceinfluenceresults
– Difficulttoidentifyallfactorsthatmayhavecontributedtopublishedeffect
![Page 25: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/25.jpg)
DifficultiesinQIResearch
• Heterogeneousapproach– Qualitativeandquantitativedata– Mixedmethodstudies– Designmethodsnotalwaysrigorouslyfollowed
![Page 26: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/26.jpg)
EVALUATINGQILITERATURE
TOOLS
![Page 27: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/27.jpg)
DeterminingQualityofaQIStudy• Interventionsshouldconsidercurrentstandardsofcareorevidencebasedpracticerecommendations
• QIworkissubjecttobiasesandconfounders– Applicabilitytoyourcontext– Changesinpracticeovertime(drift/creep)– Variationintrendsofpatientoutcomesovertime
• Followupperiodhastobelongenough– Sustainabilityplansareimportanttodescribe
• Alloutcomesneedtobeidentified– Unintendedconsequences– Resourceutilization– Cost
![Page 28: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/28.jpg)
SQUIRE2.0
• StandardsforQualityImprovementReportingExcellence
• CreatedtoguidequalityofQIstudies• ProvideaframeworkforreportingQIstudies
– Usuallyapplicabletosystemlevelchangetoimprovequalitysafetyandvalueofhealcare
– PublishedstandarddirectingwrittenframeworkofQIwork
• Maybeadaptedtosuitdifferentmethodologies• AgeneralguidetowritingupQIwork
OgrincG,etal.BMJQualSaf2016;25:986-992.
![Page 29: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/29.jpg)
SQUIRE2.0• TITLEANDABSTRACT• Title:Indicatethatthemanuscriptconcernsaninitiativetoimprovehealthcare
• Abstract:– Provideadequateinformationtoaidinsearchingandindexing
– Summarizeallkeyinformationfromvarioussectionsofthetextusingastructuredsummary
• Eg.Background,localproblem,methods,interventions,resultsandconclusions
OgrincG,etal.BMJQualSaf2016;25:986-992.
![Page 30: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/30.jpg)
SQUIRE2.0• INTRODUCTION:WHYDIDYOUSTART?• Problemdescription:
– Natureandsignificanceoftheproblem• Availableknowledge:
– Summaryofwhatiscurrentlyknownabouttheproblemincludingrelevantpreviousstudies
• Rationale:– Informalorformalframeworks,models,conceptsandortheoriesusedtoexplaintheproblem,anyreasonsorassumptionsthatwereusedtodeveloptheintervention,andreasonswhytheinterventionwasexpectedtowork
• Specificaims:– Purposeoftheprojectandofthisreport
OgrincG,etal.BMJQualSaf2016;25:986-992.
![Page 31: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/31.jpg)
SQUIRE2.0• METHODS:WHATDIDYOUDO?• Context:
– Contextualelementsconsideredimportantattheoutsetofintroducingtheinterventions
• Interventions:– Descriptionoftheinterventioninsufficientdetailthatotherscouldreproduceit
– Specificsoftheteaminvolvedinthework• StudyoftheInterventions:
– Approachchosenforassessingtheimpactoftheintervention
– Approachusedtoestablishwhethertheobservedoutcomeswereduetototheintervention
OgrincG,etal.BMJQualSaf2016;25:986-992.
![Page 32: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/32.jpg)
SQUIRE2.0• METHODS:WHATDIDYOUDO?• Measures:
– Measureschosenforstudyingprocessesandoutcomesoftheinterventionsincludingrationaleforchoosingthem,theiroperationaldefinitionsandtheirvalidityandreliability
– Descriptionoftheapproachtotheongoingassessmentofcontextualelementsthatcontributedtothesuccess,failure,efficiencyandcost
– Methodsemployedforassessingcompletenessandaccuracyofdata• Analysis:
– Qualitativeandquantitativemethodsusedtodrawinferencesfromthedata
– Methodsforunderstandingvariationwithinthedata,includingtheeffectsoftimeasavariable
• Ethicalconsiderations:– Ethicalaspectsofimplementingandstudyingtheinterventionandhow
theywereaddressed,includingbutnotlimitedtoformalethicsreviewandpotentialconflictofinterest
OgrincG,etal.BMJQualSaf2016;25:986-992.
![Page 33: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/33.jpg)
SQUIRE2.0
• RESULTS:WHATDIDYOUFIND?• Results:
– Initialstepsoftheinterventionandtheirevolutionovertime,includingmodificationsmadetotheinterventionduringtheproject
– Detailsoftheprocessmeasuresandoutcome– Contextualelementsthatinteractedwiththeintervention
– Observedassociationsbetweenoutcomes,interventionsandrelevantcontextualelements
– Unintendedconsequencessuchasunexpectedbenefits,problems,failuresorcostsassociatedwiththeintervention
– DetailsaboutmissingdataOgrincG,etal.BMJQualSaf2016;25:986-992.
![Page 34: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/34.jpg)
SQUIRE2.0• DISCUSSION:WHATDOESITMEAN?• Summary:
– Keyfindings,includingrelevancetotherationaleandspecificaims
– Particularstrengthsabouttheproject• Interpretation:
– Natureoftheassociationbetweentheinterventionsandtheoutcomes
– Comparisionoftheresultswithfindingsfromotherpublications
– Impactoftheprojectonpeopleandsystems– Reasonsforanydifferencesbetweenobservedandanticipatedoutcomes,includingtheinfluenceofcontext
– Costsandstrategictradeoffs,includingopportunitycosts
OgrincG,etal.BMJQualSaf2016;25:986-992.
![Page 35: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/35.jpg)
SQUIRE2.0• DISCUSSION:WHATDOESITMEAN?• Limitations:
– Limitstothegeneralizabilityofthework– Factorsthatmighthavelimitedinternalvaliditysuchasconfounding,
biasorimprecisioninthedesign,methods,measurement,oranalysis
– Effortsmadetominimizeandadjustforlimitations• Conclusions:
– Usefulnessofthework– Sustainability– Potentialforspreadtoothercontexts– Implicationsforpracticeandforfurtherstudyinthefield– Suggestednextsteps
• OTHERINFORMATION• Funding:
– Sourcesoffundingthatsupportedthework.Roleifanyofthefundingorganizationinthedesign,implementation,interpretationandreporting
OgrincG,etal.BMJQualSaf2016;25:986-992.
![Page 36: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/36.jpg)
SQUIRE2.0
• Allowsfor– Transparency– Descriptionoftheentireprocess– Accuracyofreporting– Reportingofthe‘doing’and‘studying’ofQIwork
• Doesnotaddress– Howtoassessqualityofevidenceprovidedinthearticle
![Page 37: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/37.jpg)
Users’GuideforanArticleAssessingQualityImprovement
• Insightintohowtoassessthequalityofthearticle• EmphasizesspecificproblematicfeaturesofQIarticles
– STUDYDESIGN– BIASES
• Confounders,clustereffects,timetrendeffects• Generalizabilityandspread• Sustainability• Benefits,hassles,costs
– DATA• Dataquality,definitions,rigorousmeasurement• Size,precisionandeffectoftheresults• Outcomesandbalancingmeasures
Fanetal.JAMA2010;304(20):2279-2287
![Page 38: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/38.jpg)
Fanetal.JAMA2010;304(20):2279-2287
![Page 39: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/39.jpg)
QIDesignsThatWork• SteppedWedgedesign
– Sequentialrolloutofinterventionstudyunits(phases)overdefinedperiodsoftime
– Randomandsequentialcrossoverofclustersfromcontroltointervention
– Allpatientsreceivetheinterventionovertime– Canrandomizetheorderofinterventions
• Step– Dataandoutcomesmeasureatthepointwherethepatiententerstheintervention
• Wedge– Observeddifferencesinoutcomeincontrolvsintervention,thencansaythechangeisattributabletotheintervention
![Page 40: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/40.jpg)
SteppedWedgeDesign• Withindividualrecruitmentandwithoutconcealmentof
allocation(blinding)– Atriskofselectionbias– Effectoftheinterventionmightbeconfoundedwithtemporaltrends
• Eachclustercontributesbothexposedandunexposeddataandthereforecanactasitsowncontrol
• Timeisassociatedwithpotentialforchangesinpracticeandnewevidencesoshouldbeadjustedforintheanalysis
• Risingtideeffect– Promptingoftheinterventionorsentimenttowardsoverallimprovementmayimpacttheeffectside
HemmingKetal.BMJ2015;350:h391
![Page 41: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/41.jpg)
Fig 1 Schematic illustration of the conventional parallel cluster study (with variations) and the stepped wedge study.
K Hemming et al. BMJ 2015;350:bmj.h391
©2015 by British Medical Journal Publishing Group
![Page 42: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/42.jpg)
QIDesignsThatWork• Interruptedtimeseriesdesign
– Quasi-experimentaldesign– Evaluateslongitudinaleffectsofinterventionsthroughregressionmodelling
• Determineswhethertheintervention’seffectispresentbeyondtheunderlyingtrend– Wellthoughtout/definedtimelinesforinterventions
• Multiplemeasurementsbeforeandafter– Allowsadeterminationofregularvariationandtrends
• Interventioncanbestoppedandstartedmultipletimesorsingularly
KontopantelisEetal.BMJ2015;350:h2750
![Page 43: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/43.jpg)
Helderetal.BMCHealthServicesResearch2013,13:417
![Page 44: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/44.jpg)
QIDesignsThatWork
• ControlledBefore-Afterstudies,uncontrolledBefore-Afterstudies
• Prospectivedesign• Specificdatacollectedandoutcomesmeasuredbeforeinterventionandagainafterimplementation
• Differencescanbeassumedtoberelatedtotheintervention– Difficulttoidentifyappropriatecontrolgroup– Subjecttoconfoundersthatmaynotbemeasuredorunderstood
– Unabletoconfirmrelationshipascausal
Fanetal.JAMA2010;304(20):2279-2287
![Page 45: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/45.jpg)
Biases• Clustereffect
– Considerationforeffectofenvironmentorlocationofpracticethatinfluencestheoutcome
– Improvedwhenabletocompareeffectsindifferentlocationsortypesofpractices
• Commonbiases– Attritionbias
• Losstofollowup– Allocationbias
• Unclearallocationofpatientstointervention– Selectiveoutcomereporting
• Importantoutcomesomittedfromresults– Contamination
• Crossover,adoptionofthepracticeovertime
![Page 46: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/46.jpg)
DataQuality• Unitsofanalysis
– Processandoutcomemeasures– Clearlydefined,rationale
• CollectionaspartoftheQIstudy– Rigorousmethodsofdatacollection– Reviewofdatacollection– Trainingfordatacollectionandabstraction
• Reportingofmissingdata– Shouldreportsensitivityanalysesifmissingdataproportionislarge
• Balancingmeasures– Unintendedconsequences– Effectsonotheraspectsofcare
Fanetal.JAMA2010;304(20):2279-2287
![Page 47: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/47.jpg)
DataQuality
• Followup• CriticalinthesettingofQIinterventions• Determinesthesustainabilityoftheinterventionandthepotentialapplicabilityinothersettings
![Page 48: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/48.jpg)
DataQualityExample• AcommunicationtooltoimprovesituationalawarenessandpromoteproactivecareisimplementedinaNeonatalICU
• Carriedoutoverastudyperiodof6months,andfollowedupagain3monthsaftertheactiveintervention
• Itdemonstratesadecreaseinneedfor‘rescue’therapiessuchassalinebolusesandinotropesduringtheactivestudyperiod
• TheauthorspublishinareportthattheirinterventionwasasuccessandthisapproachshouldbeadoptedbyNICUsasastandardofcare
![Page 49: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/49.jpg)
![Page 50: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/50.jpg)
Generalizability• WhenevaluatingQIresearchforyourownpractice,must
considerthecontext• Aspectsofcontextinclude
– Physicalaspectsàcircumstances,environment,equipment,skill,location
– Culturalàmotivation,training,appetiteforchange,providers,leadership,organizationalclimate
– Resourcesàfinancial,stakeholderbuyin• Thearticleshouldrevealanunderstandingof
– Why,WhenandWheretheQImethodsusedworkedmosteffectively
– Assumptionsaroundthenatureoftheinterventionasapplicabletothecontexttheywereused
![Page 51: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/51.jpg)
OtherQIResearchEvaluationTools
• MUSIQ– ModelforUnderstandingSuccessinQuality
• ConceptualmodelthatcanbeappliedtoQIresearchtoidentifyfactorsthatleadtosuccessinQIresearch.
• Canbeused– ProactivelyindesigningQIstudies– Systematicwaytodescribeandevaluatethecontextualfactorsimpactingonaproject’ssuccess
– Toguidethecollectionandanalysisofdata• Identified25contextualfactorsthatinfluencethesuccessofQIresearch
KaplanHetal.BMJQualSaf2012;21:13-20
![Page 52: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/52.jpg)
KaplanHetal.BMJQualSaf2012;21:13-20
![Page 53: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/53.jpg)
OtherQIResearchEvaluationTools• PromotingActiononResearchImplementationinHealth
Services(PARIHS)– Proposesthatcertaincontextualelementsarerequiredinthesuccessfulimplementationofevidencebasedpracticeimprovements
• Theoreticalframeworksuggeststhatimplementationofresearchintopracticeisafunctionof– NatureoftheEvidence(E)– Context/Environmentintowhichitisimplemented(C)– NatureofhowtheprocessisFacilitated(F)
• TheseelementsshouldbedescribedinhighqualityQIstudiestodemonstratetherigorrequiredofsuccessfulQIresearch
KitsonAetal.QualityinHealthCare1998;7:149-158
![Page 54: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/54.jpg)
KitsonAetal.QualityinHealthCare1998;7:149-158
![Page 55: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/55.jpg)
AdditionalConsiderations• Interpretationofthedatashouldinclude
– Impactofthechangeontheintendedoutcome– Commentonthemechanismbywhichtheinterventionfacilitatedthechange
– Impactuponthesystemitself– Costevaluation(financial,workforce)– Factorslimitingvalidityandotherlimitations– Assessmentofusefulness,andotherapplicationsofthework
– Sustainability– Futureimplications
![Page 56: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/56.jpg)
Summary• PublishedresearchinthefieldofQIinhealthcareshouldbe
subjecttorigorousframeworkstoensureaccurateandcomprehensivereportingoffindings– Users’guidestothemedicalliteratureHowtouseanarticleaboutqualityimprovement
– Squire2.0• ImplementationoffindingsfromQIresearchshouldtake
intoaccount– Theoriginalcontextinwhichtheimplementationoccurred– Culturalfactors– StudyDesign– DataQuality– Riskofbias
![Page 57: QUALITY IMPROVEMENT - McMaster University](https://reader036.fdocuments.net/reader036/viewer/2022081700/62d5364b8a7deb277608d154/html5/thumbnails/57.jpg)