Understanding Understanding Impact StatementsImpact Statements

H. Michael HarringtonH. Michael HarringtonExecutive Director, WAAESDExecutive Director, WAAESD

Revised 2009Revised 2009

Demand for Increased Demand for Increased AccountabilityAccountability

Government Performance and Results Act Government Performance and Results Act of 1993 (GPRA)of 1993 (GPRA) Required an accountability system based on Required an accountability system based on

performance measurement, including setting goals performance measurement, including setting goals and objectives and measuring progress toward and objectives and measuring progress toward achieving themachieving them

AREERA of 1998AREERA of 1998 Required Plans of Work, Annual ReportsRequired Plans of Work, Annual Reports

President’s Management Agenda - 2001President’s Management Agenda - 2001 The Performance Assessment Rating Tool The Performance Assessment Rating Tool

(PART) (PART) (http://www.whitehouse.gov/omb/part/)(http://www.whitehouse.gov/omb/part/)

Assessment based resource allocationsAssessment based resource allocations

What is Impact?What is Impact?

The quantifiable difference a program The quantifiable difference a program makes in the quality of life for its users.makes in the quality of life for its users.

A measurable change in condition.A measurable change in condition. Quantitative, measurable benefits of Quantitative, measurable benefits of

the research outputs as experienced by the research outputs as experienced by those who receive them.those who receive them.

- - However, the challenge has been to However, the challenge has been to assess, determine and effectively assess, determine and effectively communicate the impacts of our communicate the impacts of our efforts.efforts.

Simply put, impact Simply put, impact statements answer the statements answer the questions:questions:

So what?So what?Who cares?Who cares?

andand

Why?Why?

Who cares?Who cares?

The PublicThe Public CongressCongress Federal, state and local officialsFederal, state and local officials StakeholdersStakeholders External funding sourcesExternal funding sources Industry representativesIndustry representatives College leadershipCollege leadership

Why does their opinion Why does their opinion matter?matter?

Seeking quantifiable benefits of Seeking quantifiable benefits of programsprograms

Have competition for their attention Have competition for their attention and moneyand money

Exercise some type of control over Exercise some type of control over your programsyour programs

““The Golden Rule”!!!! $$$$$$$$$$$$The Golden Rule”!!!! $$$$$$$$$$$$

What is an Impact What is an Impact Statement?Statement?

A brief summary in lay terms that A brief summary in lay terms that describes the difference that your efforts describes the difference that your efforts have made.have made. Highlights the difference your program is Highlights the difference your program is

making for the public good.making for the public good. Concisely summarizes what you did to Concisely summarizes what you did to

achieve this difference.achieve this difference. Clearly states payoffs to society.Clearly states payoffs to society. Answers key questions: So what? Who cares? Answers key questions: So what? Who cares?

Why?Why?

University of Wisconsin-Extension, Program Development and Evaluation

Impacts in the context of the Logic Model

What we do

Who we reach

What results

INPUTS OUTPUTS OUTCOMES

Program investments

Activities Participation Short Medium

What we invest

Long Term

Impacts

ISSUE

OutcomesOutcomes

Adoption of technologyAdoption of technology Creation of jobsCreation of jobs Reduced cost to the consumerReduced cost to the consumer Less pesticide exposure to farmersLess pesticide exposure to farmers Access to more nutritious foodAccess to more nutritious food Cleaner environment and healthier Cleaner environment and healthier

communities communities

Reports, publications, patents, data, Reports, publications, patents, data, workshops or informationworkshops or information

Description of the program or processDescription of the program or process Number of persons attending a meetingNumber of persons attending a meeting Number of persons enrolled in a programNumber of persons enrolled in a program

These are outputs!!!These are outputs!!!

IMPACT

Elements of a good Impact Elements of a good Impact Statement?Statement?

It illustrates change in at least one It illustrates change in at least one of the following:of the following:– Economic value or efficiencyEconomic value or efficiency– Environmental qualityEnvironmental quality– Societal/individual well-beingSocietal/individual well-being

An Impact Statement An Impact Statement relating to economic returnrelating to economic return

Five years ago, Anderson County pork Five years ago, Anderson County pork producers spent $17 more than the state producers spent $17 more than the state average to raise a market hog. We helped average to raise a market hog. We helped them improve their record keeping and them improve their record keeping and production practices, and costs dropped production practices, and costs dropped by $20 to $3.19 BELOW the state by $20 to $3.19 BELOW the state average. Each farm’s profit increased average. Each farm’s profit increased $345,000 over five years, bringing more $345,000 over five years, bringing more hogs, more jobs, and more spending to hogs, more jobs, and more spending to the county.the county.

An Impact Statement An Impact Statement relating to environmental relating to environmental qualityqualityChopped waste paper is an economical Chopped waste paper is an economical substitute for wood chips commonly used as substitute for wood chips commonly used as bedding by the horse industry. Our bedding by the horse industry. Our scientists have found that the paper absorbs scientists have found that the paper absorbs moisture better too. By using some of the moisture better too. By using some of the 76 million tons of paper Americans throw 76 million tons of paper Americans throw away each year, researchers can reduce away each year, researchers can reduce landfill demands, save a few trees and keep landfill demands, save a few trees and keep horses comfy all at once.horses comfy all at once.

Can this be improved, if so how??Can this be improved, if so how??

An Impact Statement An Impact Statement relating to health and relating to health and social wellbeingsocial wellbeing

Social/Individual wellbeing… (health)Social/Individual wellbeing… (health)

No standards exist for wooden basketball, dance No standards exist for wooden basketball, dance and aerobics floors. So, we’re setting them. Our and aerobics floors. So, we’re setting them. Our scientists study the role of floor type and scientists study the role of floor type and construction in chronic-use injuries that often make construction in chronic-use injuries that often make people stop exercising. Computer models predict people stop exercising. Computer models predict how a floor reacts to various forces or how a floor reacts to various forces or environmental changes. Those predictions, and environmental changes. Those predictions, and what doctors know about chronic athletic injuries, what doctors know about chronic athletic injuries, bring a prescription for safer exercise for athletes of bring a prescription for safer exercise for athletes of all ages and abilities.all ages and abilities.Can this be improved, if so how??Can this be improved, if so how??

Reporting potential Reporting potential impact...impact...

Potential impact should be Potential impact should be considered, especially in basic considered, especially in basic research and teaching or youth research and teaching or youth education work.education work.

Example of “potential Example of “potential impact”impact”

We bought special software for We bought special software for classroom computers. The students classroom computers. The students learned to analyze the total true learned to analyze the total true cost of producing food products. cost of producing food products. Using the same software industry Using the same software industry uses makes these students ready uses makes these students ready for the job market and ready to for the job market and ready to enhance the food industry.enhance the food industry.