1 Implementation Science 1001 - University of Newcastle · Implementation Science 1001 A/Prof Jed...

www.newcastle.edu.au

1

Implementation Science 1001

A/Prof Jed Duff RN PhD FACORN

University of Newcastle, School Of Nursing And Midwifery


Implementation research

The scientific study of methods to

promote the systematic uptake of

research findings into routine

practice to improve the quality

and effectiveness of health

services and patient care

Evidence implementation

The dynamic and iterative process

that includes the synthesis,

dissemination, exchange and

application of knowledge to

improve health and health

services


Implementation Science

• A different type of research

• More relevant to stakeholders

• Emergent field

– Approaches still being

developed, tested

• Interface between research

and application

• Contextual

• Complex

• Multi-component programs /

policies

• Non-linear

• Transdisciplinary

• Multi-level and multi-method


Evidence practice gap

• 30 - 40% of patients dont get treatments of proven

effectiveness

• 20 - 25% of patients get care that is not needed or potentially

harmful

• 57% of Australians are not receiving evidence-based care


Ultimate Impact of a Magic Diet Pill

50% of Clinics Use Adoption 50%

50% of Clinicians Prescribe Adoption 25%

50% of Patients Accept Medication Reach 12.5%

50% Follow Regimen Correctly Implementation 6.2%

50% Continue TakingAfter 6 Months Maintenance 1.6%

Dissemination Step Concept % Impacted

50% of Those Taking Correctly Benefit Effectiveness 3.2%


ComponentEvidence implementation

vsImplementation research

AimBrings about improvement

Studies improvement methods

Intervention Applies interventions Studies interventions

Design Iterative pragmatic design (more) Classical design

Protocol Flexible adaptive protocol (more) Rigid protocol

Results Context specific (more) Generalisable


ProcessProduct Context EvaluationOutcome

Key Components of Implementation


• Research

• Guidelines

• Evidence

• Knowledge

• Knowledge tools

• EB Products

• EB Strategies




• Implementation

interventions

• Change strategy

• Facilitation

• Theories

• Models

• Frameworks





• Inner and outer

setting

• Culture

• Resources

• Leadership

• Regulation

• Accreditation




• Theories

• Models

• Frameworks

• Methods

• Designs




• System,

process,

outcome

• Individual,

organisational,

community





Theory, model, framework


IMPLEMENTATION RESEARCH


Broad Categories of Questions

• Process of delivery (How do we make it work?)

• Salience (Does it matter?)

• Safety (Will it do more harm than good?)

• Acceptability (Will people be willing to use it?)

• Cost-effectiveness (Is it worth buying?)

• Appropriateness (Is this the right intervention?)

• Reach (How many people exposed?)

• Intensity/dose (What is the expected/ needed strength of the intervention?)

• Satisfaction (Are stakeholders satisfied? To what degree?)

• Sustainability (Can it be continued over time?)


NSW Health Translational Framework


Implementation Research Framework (USA)

Replication

Adaptation

Sustainment / Scaling Up

Implementation

Effectiveness Studies

EfficacyStudies

Pre-intervention

Implementation

Research


Implementation Outcomes

Outcome Potential measure

Impact Audit, administrative data

Acceptability Interview/ focus group, survey, take-up/ refusal

Adoption Administrative data, interview/ focus group,

observation, self-report, survey

Appropriateness Interview/ focus group, survey

Feasibility Administrative data, survey, interview

Fidelity Self-report, checklists, observation

Implementation cost Administrative data

Reach Administrative data, audit

Sustainability Audit, interviews, survey, checklists.


Clinical effectiveness vs.

Implementation trial

Study Feature Clinical ResearchImplementation

Research

Study focus Clinical interventionImplementation

intervention/ strategy

Primary outcome Health outcomes

Processes of care,

fidelity, adoption,

reach…

Unit of randomization Patient Site, ward, clinician

Process evaluation Sometimes Always

Mixed method Sometimes Often


Implementation Trials


Hybrid Clinical Effectiveness/

Implementation Designs (USA)


Example: Hybrid Type III


Qualitative Methods in Implementation

Research


Qualitative and Mixed Methods

• Ethnography

• Realist Evaluation

• Case Study

• Qualitative Comparative

Analysis

• Network Analysis


Theories, Models and Frameworks


Process Theory: Knowledge to Action


Determinant Framework: Consolidated

Framework for Implementation Research


Classic Theories: Theory of Diffusion


Implementation Theories: Behaviour

Change Wheel


Evaluation Frameworks: RE-AIM

Dimension Question

ReachHow many and what proportion of the target

population is participating in the intervention?

Effectiveness What are the effects of the intervention in eligible

patients?

AdoptionWhat is the percentage of providers participating in

the program?

Implementation Was the intervention implemented as intended?

Maintenance Is the intervention maintained after the study period?


Change Strategies

• Audit & feedback; educational meetings and materials; opinion leaders; reminders

Individual

• Systems reengineering; redefining professional roles

Organisational

• Policy directives; outcomes based funding Regulatory

• Decision aids; patient held guidelinesPatient directed

• Disease prevention media campaignsMass media


Align Strategies to Barriers

Barrier Consider

Anxiety about new task Simulation

Perception/ reality mismatch Audit and feedback

Relevance Flexible standardisation

Beliefs and attitudes Local consensus meetings

Logistics and timing Process redesign


Align Strategies to Stage of Change

Awareness • Group presentation

Agreement • Consensus meeting

Adoption • Audit & feedback

Adherence • Reminders


Address identified barrier

Evidence strength and

quality

Relative advantage

Adaptability

Trialability and measurability

Complexity Design quality Cost

Building a Change Strategy


EVIDENCE IMPLEMENTATION


Knowledge-to-Action


Knowledge Creation

• Knowledge

generation

• Knowledge

synthesis

• Knowledge tools


Knowledge Application

• Identify need

• Adapt to context

• Assess barriers

• Select

interventions

• Monitor use

• Sustain use


Identify Knowledge Practice Gaps

• Clinical databases

• Chart audits

• Direct

observations

• Questionnaires

• Incidents

• Feedback


Adapt Knowledge to Local Context

• Workforce

• Skill mix

• Resources

• Models of care


Assess Barriers to Knowledge Use

• Observation

• Discussion

• Surveys

• Literature


Common Barriers

Behaviour

Capability

- Skills

- Knowledge

Opportunity

- Time

- Resources Motivation

- Internal

- External


Selecting Interventions

• Theoretically informed

• Mapped to barriers

• Aligned to stage of change

• Feasible, acceptable, measurable


Implementing Interventions


Pilot then Spread Change

All

Patients

All perioperative

POPULATION DEFINED

BY PROJECT AIM

TEST

POPULATION

TEST

POPULATION

TEST

POPULATION

Spread

Spread

Spread


Monitor Knowledge Use

• Systems

• Processes

• Outcomes


Sustaining Knowledge Use

• Standardisation

• Documentation

• Measurement and

review

• Training and

education


Resources


Resources

• Consolidated Framework for Implementation Research

(http://www.cfirguide.org/)

• NSW Health Translational Research Framework

(http://www.health.nsw.gov.au/ohmr/Pages/trgs.aspx)

• A guide to using the Theoretical Domains Framework of behaviour

change to investigate implementation problems

(https://implementationscience.biomedcentral.com/articles/10.1186/s1

3012-017-0605-9)

• Knowledge Translation (https://ktcanada.org)

http://www.cfirguide.org/

http://www.health.nsw.gov.au/ohmr/Pages/trgs.aspx

https://implementationscience.biomedcentral.com/articles/10.1186/s13012-017-0605-9

https://ktcanada.org/

DISCUSSION

[email protected]

1 Implementation Science 1001 - University of Newcastle · Implementation Science 1001 A/Prof Jed...

Documents

Transcript of 1 Implementation Science 1001 - University of Newcastle · Implementation Science 1001 A/Prof Jed...