Defining and Measuring SuccessMeasuring Success
Transcript of Defining and Measuring SuccessMeasuring Success
![Page 1: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/1.jpg)
Defining and Measuring SuccessMeasuring Success Joint Funder Training
February 23, 2018
![Page 2: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/2.jpg)
Session 1:● Importance and role of Performance Management● Introduce and create a Theory of Change ● Create a roadmap for defining success
Session 2:
● Identify data that will gauge progress & success
● Collect and use this data to improve services
Training Focus
![Page 3: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/3.jpg)
Today’s Agenda
⚫Introductions - 25 mins⚫Importance of Outcomes & Impact - 15 mins⚫Theory of Change – 15 mins⚫Theory of Change Exercise - 15 mins⚫Break - 5 mins⚫Introduction to Logic Models and Indicators - 1 hour⚫Exercises - 20 mins.⚫Q & A
![Page 4: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/4.jpg)
Take a Minute and Answer
➢What do you think of when you hear impact, outcomes, evaluation, logic models?
➢What do you hope to get out of today’s session?
![Page 5: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/5.jpg)
Today’s Presenters
Melinda McAliney
Director,
Brown Sisters Foundation
Rebekah Miller
Program Officer,
Lutheran Foundation of St. Louis
Emily Uzzle
Director, Learning and EvaluationUnited Way of Greater St. Louis
![Page 6: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/6.jpg)
Why Funders Care
⚫Strategic Plans
⚫Mission/Vision
⚫Board
⚫Constituents
⚫Clients/End Users
⚫Limited Resources
⚫Increased Scrutiny
⚫Professional Ethical Obligations
⚫Transparency
⚫Accountability
![Page 7: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/7.jpg)
Members of Funders Learning & Evaluation Group (FLEG)
⚫ARCHS St. Louis
⚫Brown Sisters Foundation
⚫Community and Children’s Resource Board of St. Charles
⚫Daughters of Charity Foundation
⚫Jewish Federation of St. Louis
⚫Lutheran Foundation of St. Louis
⚫Mental Health Board
⚫Missouri Foundation for Health
⚫St. Louis County Children’s Services Board
⚫The Staenberg Group
⚫United Way of Greater St. Louis
![Page 8: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/8.jpg)
Exercise
How did you get here today?
![Page 9: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/9.jpg)
The Importance of Outcomes & Impact
![Page 10: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/10.jpg)
Societal Focus on Outcomes
● Accessibility of technology
● Increased accountability
● SROI and impact
● Complex social issues
● Availability of best practices &
evidence base
![Page 11: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/11.jpg)
Organizational Focus on Outcomes
● Set goals and assess progress
● Determine if services help or harm
● Improve service quality
○ Build a learning culture
● Focus resources to maximize impact
● Better understand and communicate impact
○ Attract additional resources
![Page 12: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/12.jpg)
Organizational Progression
Good Intentions
Counting Outputs
Measuring Outcomes
Managing Performance
![Page 13: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/13.jpg)
P Design (or revise) your processD Implement your plan C Measure & analyze results - compare with expectationsA Take action based on what you learned
PDCA CYCLE
![Page 14: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/14.jpg)
Theory of Change
![Page 15: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/15.jpg)
• Bridges strategy and results
• Blueprint for solving community/client issue
• Starts with desired change
o Identifies efforts to achieve change
• Articulates assumptions
o How & why change will happen
Theory of Change Basics
![Page 16: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/16.jpg)
Theory of Change - Key Components
Desired Change/
Outcomes
Programs, Services &
Interventions
Assumptions
![Page 17: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/17.jpg)
Theory of Change - Different Forms
• Conceptual foundation
• Formal process and product
o Causal Pathway Map
o Outcomes Framework
![Page 18: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/18.jpg)
Theory of Change - Key Questions
• Who are you seeking to influence?
• What benefits are you seeking to achieve?
• How will you make this happen?
• Why will your theory work?
• When will you achieve them?
• What is your context?
![Page 19: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/19.jpg)
A Robust Theory of Change is...
• Meaningful
• Plausible
• Doable
• Measureable
• Monitorable
![Page 20: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/20.jpg)
Theory of Change - Examples & Resources
• Fivers Children Foundation
• SOAR Opportunity Fund
• Templates
• Mission Box https://www.missionbox.com
• Annie E. Casey Foundation http://www.aecf.org/resources/theory-of-change/
• TOCO (Theory of Change Online) software www.theoryofchange.org
• David Hunter Consulting http://dekhconsulting.com
![Page 21: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/21.jpg)
BREAK!!
![Page 22: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/22.jpg)
Introduction to Logic Models
![Page 23: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/23.jpg)
Source: Latin American Youth Center Learning and Evaluation Division
Which Program Would You Replicate?
Provides tutoring to 500 students
Provides tutoring to 50 students
5,000 hours of tutoring offered
5,000 hours of tutoring offered
Each student receives an average of 10 hours of tutoring
Each student receives an average of 100 hours of tutoring
No evidence of changes in academic performance
40 students increased reading levels by at least one grade level
Program 1 Program 2
![Page 24: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/24.jpg)
Logic Models: Definition
A simple, visual way to show your program – from soup to nuts
A systematic & visual way to present & share your understanding of the relationships among the resources you
have to operate your program (inputs), the activities you plan to do (activities/services), and the changes or results you
hope to achieve (outcomes/impact).
W.K. Kellogg Foundation
![Page 25: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/25.jpg)
A Logic Model
• Is . . .
• A means to an end. • A tool.• A visual representation of
a logical thought process.• Ever-evolving.• Yours.
• Is Not . . .
• An end in itself. • A Product.• A collection of
disconnected parts.• Set in stone.• Ours.
![Page 26: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/26.jpg)
Logic Model Components: Definitions & Examples
![Page 27: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/27.jpg)
Logic Models: Shapes and Sizes
![Page 28: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/28.jpg)
Traditional Logic Model
Resources/ Inputs
Strategies/Activities
ClientOutcomes
Outputs Impact
Resources needed to operate your program effectively and efficiently
If you have the necessary resources, then you can use them to implement the strategies
If your strategies are fully implemented and of high quality, then the amount of service/product will be produced
If you accomplish your planned strategies, thenclients will benefit in certain ways
If these benefits to clients are achieved, then certain changes in organizations, communities or systems will occur
Influencing Factors and Trends
Source: Adapted from TCC Group
![Page 29: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/29.jpg)
Traditional Logic Model
Source: TCC Group
![Page 30: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/30.jpg)
Changing the Model
Source: TCC Group
![Page 31: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/31.jpg)
Logic Model Template – Programs
Inputs(Resources)What do you need in order to do what you do?
Activities(Services)What will you do?
OutputsHow much will you do? How many will you serve?
Outcomes(Results)What difference will it make?
Materials, Staff, Equipment, Space, Equipment, Training
Align with Budget and Narrative
Activities, Services,Efforts
Activities
Numbers Served
Knowledge, Beliefs, Attitudes, Skills
Behavior
Status/Condition
![Page 32: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/32.jpg)
Types of Outcomes – Programs
• Knowledge, Skill, Attitude, Belief– What will clients know or believe as a result of your program?
• Ex. Gain knowledge about positive parenting.
• Behavior– What will clients do differently as a result of your program?
• Ex. Interact more positively with children.
• Condition/Status– What will be different about your clients’ lives as a result of your program?
• Ex. Family remains intact.
![Page 33: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/33.jpg)
Logic Model Template – Capacity Building/Project
Inputs(Resources)What do you need in order to do what you do?
Activities(Services)What will you do?
OutputsHow much will you do? How many will you serve?
Outcomes(Results)What difference will it make?
Materials, Staff, Equipment, Space, Equipment, Training
Align with Budget and Narrative
Activities, Services,Efforts
Activities
Numbers Served
Short-term
Intermediate
Long-term
![Page 34: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/34.jpg)
Types of Outcomes – Capacity Building/Projects
• Short-term– The first meaningful changes that follow directly from an activity
• Ex. Add X volunteers
• Intermediate– Success milestone between short-term & long-term
• Increased volunteer satisfaction
• Long-term– Second-order changes that result from successful achievement of short-term
outcomes over time • Increased volunteer retention
![Page 35: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/35.jpg)
Our Logic Model Template
Inputs(Resources)What do you need in order to do what you do?
Activities(Services)What will you do?
OutputsHow much will you do? How many will you serve?
Outcomes(Results)What difference will it make?
Materials, Staff, Equipment, Space, Equipment, Training
Quantified
Align with Budget and Narrative
Activities, Services,Efforts
Activities Quantified
Numbers Served
Knowledge, Beliefs, Attitudes, Skills /Short-term
Behavior / Intermediate
Status or Condition /Long-term
![Page 36: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/36.jpg)
Start at the End
• Design programs with the End in mind
• Identify various levels/types of outcomes
– Start with ultimate ends
– Then ask yourself, “What has to happen in order for C to occur?” = B
– Then ask yourself, “What has to happen in order for B to occur?” = A
![Page 37: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/37.jpg)
Show Your Logic
Inputs(Resources)
Activities(Services)
Outputs Outcomes(Results)
In order to do that (activities), we must have this (inputs).
In order to provide that (outputs), we must do this (activities).
To achieve these results (outcomes), we must provide this (outputs).
![Page 38: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/38.jpg)
Logic Model: An Analogy
Inputs(Resources)What do you need in order to do what you do?
Activities(Services)What will you do?
OutputsHow much will you do? How many will you serve?
Outcomes(Results)What difference will it make?
Ingredients● Eggs● Oil● Flour
OvenMuffin tin
Instructions● Preheat● Grease pan● Mix dry ingredients● Mix wet ingredients● Fill 2/3 full● Bake
Makes 12 muffins ● The muffins taste yummy
● People eat so many they gain weight
● People ask for more
● You open a muffin bakery
![Page 39: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/39.jpg)
Logic Model Template
Inputs
(Resources)
Activities
(Services)Outputs Outcomes
(Results)
Materials, Staff,
Equipment, Space,
Equipment, Training
Activities, Services,
Efforts
Activities Quantified Knowledge, Beliefs,
Attitudes, Skills
Behavior
Status/Condition
vs.
![Page 40: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/40.jpg)
Outputs vs. Outcomes
• Outputs– Represent milestones in program
implementation– Describe activities– Are about your efforts– Keywords:
• Attend, complete, provide, engage, recruit, enroll, receive
• Outcomes– Represent “solutions” to the
problem you identified in your “needs statement”
– Describe change– Are about the client– Keywords:
• Increase, decrease, improve, change, gain, implement, apply, demonstrate, more, less
![Page 41: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/41.jpg)
Output or Outcome?
1. Clients will create individualized service plans.
2. Clients will be able to identify their medications and associated side effects.
3. 100 clients will receive health screenings.
4. Clients will report satisfaction with services.
5. Clients will experience reduced symptoms of anxiety and/or depression.
6. 150 clients will get jobs.
![Page 42: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/42.jpg)
Activities vs. Outputs vs. Outcomes
Activity(What?)
Output(How much?)
Outcome(So what?)
Teach weekly workshops 32 workshops Clients gain knowledge of coping skills.
Provide lunch every M, T, W
Serve 300 lunches to 150 people Clients experience the love of God.
Provide Case Management Develop case plans for 15 clientsProvide 100 home visits
Clients will reduce risk factors and increase safety at home.
Match & Facilitate Mentoring Make 12 mentor matches.10 mentor meetings/year
Clients gain knowledge in job seeking.
Subsidize & Manage Transitional Housing
House 20 ex-offenders for 6-9months each
Ex-offenders avoid recidivism.
![Page 43: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/43.jpg)
Let’s Practice!
![Page 44: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/44.jpg)
Example Program• Program Goal:
– To strengthen families and prevent child abuse and neglect
• Services: – Provides in-home individual and
family counseling, parent training, and case management to at-risk families
![Page 45: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/45.jpg)
InputsList & quantify the materials, staff, equipment, training, etc. that you need to deliver the program
ActivitiesList the various activities you will perform to deliver your program
OutputsList what & quantify how much you will deliver as a result of your activities.
OutcomesDescribe broadly the change your program is intended to make in the lives of participants.
Completing a Logic Model
START
Knowledge, Beliefs,
Attitudes, Skills
Behaviors
Status & Condition
![Page 46: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/46.jpg)
Brainstorming Program Outcomes: Practice
• Status/Condition – ultimate ends, life trajectory change
– What will be different in the client’s life as a result of this program?
• Behavior Change
– What does a client need to DO, in order to achieve that status/condition change? What behavior
of theirs will contribute to that ultimate change?
• Knowledge/Attitude/Belief/Skill Change
– What does a client need to know/believe in order to be able to DO the necessary things?
![Page 47: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/47.jpg)
Brainstorming Program Activities & Outputs: Practice
• In order to support clients in achieving those outcomes, what do WE need to do?
(Activities)
• And how much do we need to do? (Outputs)
![Page 48: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/48.jpg)
Brainstorming Program Inputs: Practice
• In order to carry out our activities and deliver all our outputs, what do we need to
have?
– Materials
– Equipment
– Staff
– Training
– Space
– Partnerships
– Etc.
![Page 49: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/49.jpg)
Inputs(Resources)
Activities(Services)
Outputs Outcomes(Results)
● 1 FT Family Therapist
● 20% FT Program Manager
● 20%FT Intake Assistant
● Protective Factors training
● Therapeutic games & toys
● Cell phone for therapist
● Mileage reimbursement
&/or car for therapist
● Pool of funds for basic
needs assistance
● Marketing presentations
at schools
● Phone screenings &
resource referral
● Comprehensive
assessment
● Individualized service
planning
● Weekly in-home therapy &
case management
● Basic needs assistance
when appropriate
● 300 families screened
● 200 families served with at
least 1 session
● 150 families complete
program
● 4,800 sessions
Knowledge, Beliefs, Attitudes, Skills
● Parents gain knowledge of positive parenting strategies
● Parents learn skills to reduce stress
Behavior
● Parents interact more positively with children
● Children reduce psychiatric symptoms & difficult behaviors
Status/Condition
● Families remain intact● No incidents of child abuse
& neglect
Completed Program Logic Model Example
![Page 50: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/50.jpg)
Example Project
• Project Goal:
– To increase number of new donors
![Page 51: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/51.jpg)
InputsList & quantify the materials, staff, equipment, training, etc. that you need to deliver the program
ActivitiesList the various activities you will perform to deliver your program
OutputsList what & quantify how much you will deliver as a result of your activities.
OutcomesDescribe broadly the change your program is intended to make in the lives of participants.
Completing a Logic Model
START
Short-term
Intermediate
Long-term
![Page 52: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/52.jpg)
Brainstorming Project Outcomes: Practice
• Long-term– Second-order changes that result from successful achievement of short-term
outcomes over time
• Intermediate– Success milestone between short-term & long-term
• Short-term– The first meaningful changes that follow directly from an activity
![Page 53: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/53.jpg)
Brainstorming Project Activities & Outputs: Practice
• In order to achieve those outcomes, what do WE need to do? (Activities)
• And how much do we need to do? (Outputs)
![Page 54: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/54.jpg)
Brainstorming Project Inputs: Practice
• In order to carry out our activities and deliver all our outputs, what do we need to
have?
– Materials
– Equipment
– Staff
– Training
– Space
– Partnerships
– Etc.
![Page 55: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/55.jpg)
Inputs(Resources)
Activities(Services)
Outputs Outcomes(Results)
● 1 development person
● Donor relations
committee
● Marketing materials
● Fundraising budget
● Donor relations database
● Develop clear case
statement
● Prepare marketing
materials
● Develop donor relations
committee
● Identify potential donors
● Hold fundraising event
● Meet with potential
donors
● Invite potential donors to
Agency XYZ for tour
● Offer online giving option
● Send annual appeal
● Participate in community
events
● Thank donors twice/year
● Marketing materials
created & used
● Donor relations
committee created &
actively meeting
● 200 potential donors
identified
● 1 fundraising event held
● Valentine’s Day appeal
sent
● Met with 100 potential
donors
● Hosted 50 tours
● Attended 20 community
events
● Online giving button
created
Short-term
● More people are aware of Agency XYZ
● More people are connected to Agency XYZ’s mission
Intermediate
● Increased number of new donors
Long-term
● Donors are retained● Donors increase their gift
Completed Project Logic Model Example
![Page 56: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/56.jpg)
Questions?
![Page 57: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/57.jpg)
Let’s Workshop Yours
![Page 58: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/58.jpg)
Questions to Get You Started
• What are your hopes/dreams for your project/people/group?
• What do you hope to accomplish?
• What will success look like?
Translate into outcomes• Knowledge, attitude, belief, skill
• Behavior
• Condition/status
• Short-term
• Intermediate
• Longer-term
![Page 59: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/59.jpg)
59
Great Job!!!
![Page 60: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/60.jpg)
And……We’re Not Done YetDeveloping Measurable Indicators
![Page 61: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/61.jpg)
An indicator is a specific, observable, and measurable characteristic or change that will represent achievement of the outcome.
--United Way of America
Indicators
A.K.A. – What will it look, taste, act, sound, and/or feel like when we reach this outcome?
![Page 62: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/62.jpg)
Making It Measurable
• Outcome: What are we trying to accomplish?
– Indicator: What will that look/sound/feel/taste/act like?
• Evaluation Method/Measure: How will we know or track?
![Page 63: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/63.jpg)
How it all fitsInputs(Resources)What do you need in order to do what you do?
Activities(Services)What will you do?
OutputsHow much will you do? How many will you serve?
Outcomes(Results)What difference will it make?
Indicators(Results - Specific)What will the difference look, feel, taste, sound, act like?
Materials, Staff, Equipment, Space, Equipment, Training
Align with Budget and Narrative
Activities, Services,Efforts
Activities
Numbers Served
Knowledge, Beliefs, Attitudes, Skills
Behavior
Status/Condition
-Specific
-Measurable
-Quantified -Targets
-Required Format
-Time-bound
![Page 64: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/64.jpg)
Same But Different
Outcome
Parents gain knowledge of positive
parenting strategies.
Indicator
75 of 80 (94%) of parents who
participate in at least 10 counseling
sessions will gain knowledge of
positive parenting strategies within
3 months.
![Page 65: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/65.jpg)
Writing a Strong,
Clear Indicator
![Page 66: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/66.jpg)
Indicators
__ of ___ (___%) participants who ____ will ____ by _____.
![Page 67: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/67.jpg)
Indicators
__ of ___ (___%) participants who ____ will ____ by _____.
Each Indicator specifies 6 components:• # Achieved• # Measured• % Achieved• “Who”: Participants included in Measure (subset)• “Will”: Outcome• “By”: Timeframe
Example:75 of 80 (94%) of parents who participate in at least 10 counseling sessions willgain knowledge of positive parenting strategies within 3 months.
![Page 68: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/68.jpg)
Why Does “Who” Matter?
• Not all participants receive the same type or level of service, so we can’t expect them all to experience the same type or level of change, right? – Drop Out– Multi-service programs
![Page 69: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/69.jpg)
Writing Indicators: Key Words
• Focused on Change
• Gain, increase, demonstrate,
express, etc.
• Apply, choose, demonstrate, join,
use, etc.
• Focused on Activities
– Receive, participate, attend,
complete, enroll
![Page 70: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/70.jpg)
Crafting Indicators: Let’s Practice
__ of ___ (___%) participants who ____ will ____ by _____.
![Page 71: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/71.jpg)
Inputs(Resources)
Activities(Services)
Outputs Outcomes(Results)
● 1 FT Family Therapist
● 205 FT Program Manager
● 20%FT Intake Assistant
● Protective Factors training
● Therapeutic games & toys
● Cell phone for therapist
● Mileage reimbursement
&/or car for therapist
● Pool of funds for basic
needs assistance
● Marketing presentations
at schools
● Phone screenings &
resource referral
● Comprehensive
assessment
● Individualized service
planning
● Weekly in-home therapy &
case management
● Basic needs assistance
when appropriate
● 300 families screened
● 200 families served with at
least 1 session
● 150 families complete
program
● 4,800 sessions
Knowledge, Beliefs, Attitudes, Skills
● Parents gain knowledge of positive parenting strategies
● Parents learn skills to reduce stress
Behavior
● Parents interact more positively with children
● Children reduce psychiatric symptoms & difficult behaviors
Status/Condition
● Families remain intact● No incidents of child abuse
& neglect
Completed Program Logic Model Example
![Page 72: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/72.jpg)
Completed Program Indicator Example
Outcomes Indicators
Parents gain knowledge of positive parenting strategies
165 of 175 parents (94%) who participate in at least 10 counseling sessions will gain knowledge of positive parenting strategies within three months.
Parents learn skills to reduce stress 165 of 175 parents (94%) who participate in at least 10 counseling sessions will gain knowledge of strategies to reduce stress by discharge.
Parents interact more positively with children
140 of 175 parents (80%) who participate in at least 10 counseling sessions will demonstrate improved parent/child interactions by discharge.
Children reduce psychiatric symptoms & difficult behaviors
45 of 60 children (75%) who have mental health issues and complete at least 10 counseling sessions will demonstrate improved psychiatric symptoms & behavior.
Families remain intact 145 of 150 families (97%) who complete the program will remain intact at discharge.
No incidents of child abuse & neglect 145 of 150 families (97%) who complete the program will remain free of child abuse and/or neglect at 3 months post discharge.
![Page 73: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/73.jpg)
Inputs(Resources)
Activities(Services)
Outputs Outcomes(Results)
● 1 development person
● Donor relations
committee
● Marketing materials
● Fundraising budget
● Donor relations database
● Develop clear case
statement
● Prepare marketing
materials
● Develop donor relations
committee
● Identify potential donors
● Hold fundraising event
● Meet with potential
donors
● Invite potential donors to
Agency XYZ for tour
● Add online giving option
● Send annual appeal
● Participate in community
events
● Thank donors twice/year
● Marketing materials
created & used
● Donor relations
committee created &
actively meeting
● 200 potential donors
identified
● 1 fundraising event held
● Valentine’s Day appeal
sent
● Met with 100 potential
donors
● Hosted 50 tours
● Attended 20 community
events
● Online giving button
created
Short-term
● More people are aware of Agency XYZ
● More people are connected to Agency XYZ’s mission
Intermediate
● Increased number of new donors
Long-term
● Donors are retained● Donors increase their gift
Completed Project Logic Model Example
![Page 74: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/74.jpg)
Completed Project Indicator Example
Outcomes Indicators
More people are aware of Agency XYZ 10% annual growth in awareness of Agency XYZ by target audience.
More people are connected to Agency XYZ’s mission
225 of 250 (90%) of donors indicate a close connection to Agency XYZ’s mission.
Increased number of new donors Grow donations of new donors by 15% annually.
Donors are retained 215 of 250 (86%) of donors renew their gift annually.
Donors increase their gift 125 of 250 (50%) of donors increase their gift annually by 10%.
![Page 75: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/75.jpg)
Let’s Workshop Yours
![Page 76: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/76.jpg)
76
Great Job!!!
![Page 77: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/77.jpg)
Questions?
![Page 78: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/78.jpg)
Tips for Success
● Remember your WHY● Keep it simple● It’s not a 1-time thing - keep at it, keep learning● Perfection is the enemy of good● Have staff/volunteers sit at the table● Have fun and enjoy stronger programs!
![Page 79: Defining and Measuring SuccessMeasuring Success](https://reader035.fdocuments.net/reader035/viewer/2022062405/62ab74428e0d5300bb314a0d/html5/thumbnails/79.jpg)
THANK YOU!And Good Luck!
(and please complete your survey!)