Research Impact Evidence Types and Gathering Webinar July ...

ACU Engagement | Vice President Portfolio1 |

Evidence Types and Gathering

Demonstrating the changes achieved

Research Engagement Team

July 2020

Research Impact

2 | ACU Engagement | Vice President Portfolio

Research Impact

“…the contribution that research makes to the economy, society, environment or culture, beyond the contribution to academic research.”

ARC EI (2018)

5 | ACU Engagement | Vice President PortfolioPicture: Mike Burton


Theory of Change

Change that has been brought about as a result of the research activity

Observable signs that that change has occurred

Documented proof confirming that change has happened

Direct products or services resulting from your program or interventions activities

Changes in attitudes, values, behaviours or conditions


Potential Impacts and IndicatorsArea Types of impacts Indicators of reach and significance

Health and wellbeing of people

Health / Wellbeing / Welfare / Safety / Education

Clinical outcomes for patients/users or related groups have improved

Decisions by a health service or regulatory authority (to take, or not to take action) have been informed by research

Increased patient/user involvement in shaping and implementing policy and practice

Care and educational practices have changed Influence on CPD and training standards Misleading health claims are not included in

food packaging

Evidence from clinical trials Measures of improved clinical outcomes, public

behaviour or health services (lives saved, reduced infection rates)

Documented changes to clinical and/or public health guidelines (documented references to research evidence in guidelines)

Measures of physical health, working hours or days lost due to illness, number of days of hospitalisation

Measures of mental health, cognitive ability, mental health service referrals


Evidence Guiding Principles

AppropriateCausal

CredibleReliableRobust


Principle Advice

Robustness Development of sector indicators

Development of institutional indicators

Humility Attention to language

Encourage a rounded view

Skills in using indicators

Transparency Champion transparency

Selection of indicators

Interoperability

Infrastructure

Diversity Meaningful indicators

Best management practice

LFHE (2017)

Evidence Guiding Principles


Evidence HierarchyEvidence

Research

Expert review

User-review

Self-report

Informed opinion

LFHE (2017)


Evidence TypesArtefact Related EvidenceCommercial impactsNumbers qualifying in new skillsLegalPublic PolicyPractice Guidelinese-Mail and MailMedia and Social MediaWeblinks


Evidence TypesArtefact Related Evidence

Independent reviews

• Reports about research project undertaken and results• Testimonials from external experts

Awards • Comments from awarding bodies• Testimonials from those on the judging panels

IP - Patents, Licences

• Evidence of funding to support exploiting the research• Evidence of increase in sales

Published Reports • Testimonials may be needed to describe the link between the reports impacts and the research

Event attendance and feedback

• Event organiser delegate feedback

Testimonials • Quantitative reports showing the different made


Managing Risk

LFHE (2017)

DesignAnalysisTimingEthics

AttributionReporting


TOP TIPSStart as early as possible

Develop an impact canvas

Create a baseline

Independent verification

Capture throughout

Build a ‘storyboard’

Don’t stop at the end

ACU Engagement | Vice President Portfolio16 |

[email protected]

Work with us …

Jeanine ParsonsResearch Engagement Manager

Lucy ThompsonResearch Engagement and Project Officer

Research Impact Evidence Types and Gathering Webinar July ...

Documents

Transcript of Research Impact Evidence Types and Gathering Webinar July ...