COMPREHENSIVE PROGRAM EVALUATION

Internal EvaluationSherri Kendall, LPCCEO, Aid to Victims of Domestic AbuseHouston

External Program Evaluation / ResearchJeff Temple, PhDDirector, Behavioral Health and Research Department of Ob/Gyn UTMB Health

PROGRAM EVALUATION Part 1 – Internal Evaluation

Sherri KendallAid to Victims of Domestic Abuse (AVDA)Houstonsherrik@avda-tx.org713.715.6925

Basic Questions

Why do we evaluate?What do we evaluate?How will we evaluate?When will we evaluate?What do we do AFTER we’ve

evaluated?

Why evaluate?

1. To determine if we are meeting our mission.2. To determine if we are meeting our

targets/goals for the program.3. Based on results, to modify program (and/or

training) to improve program effectiveness.4. To be able to accurately demonstrate

effectiveness to our funders.5. To bolster support for legislation (and

funding) for BIPP through demonstrating effectiveness.

Scope of Evaluation

Evaluation should seek to provide a balance between both depth and breadth, providing an overview of multiple evaluation criteria, and with the option for follow-up on areas which, once evaluated, are found to be problematic or not meeting goals.

What to evaluate - MISSION

Are we meeting our mission? Improving Victim Safety

Impact Reducing Offender

Recidivism & Continued Abuse

Batterer Accountability Meeting Community

Needs

Additional Goals: Societal Change re: all

forms of oppression Collaboration & a

Coordinated Community Response

Contributing to the DV Field

Growth-promoting, satisfying workplace

Others??

Program Evaluation may be based on:

GoalsProcessOutcomesNeeds AssessmentAccreditationCost/benefit AnalysisEffectivenessEfficiency

Meeting Targets & Goals

MEASURABLE OUTPUTS

Number of BIPP participants servedCompletion of participants vs. dropoutsOutreach to victims100% Compliance with BIPP Guidelines &

funder requirementsTrainings, presentations, collaborations

Meeting Targets & Goals

MEASURABLE OUTCOMES

Reduced abuseIncreased victim safetyOffender accountabilityMeeting community need

Measuring OUTPUTS

Number of BIPP participants servedMAR / Actual Outputs Report (from referral to exit)Caseload/activity measurement per facilitator

Completion of participants vs. dropoutsMAR – don’t limit your exit categoriesWHY are they dropping?Can high completion rate be a negative?

Outreach to victimsVictim & Partner letters and resourcesPhone contact (safety concerns to consider)

Compliance with BIPP Guidelines & funder requirementsExternal audit results & internal ongoing monitoring

Trainings, presentations, collaborations

Measuring OUTCOMES Cognitive awareness

Pre/post tests Offender Exit Survey Exit Plan of Non-Abuse

Reduced abuse & Increased victim safety Recidivism rates Exit Survey (client & victim/partner) Continued follow-up

Meeting community need Operating groups in under-served areas Accessibility to clients (cost, schedule, location) Community Partner & Referral Surveys Making trainings, presentations, consultations available to

community partners (not for purposes of profit)

When to begin program evaluation

NOW!

Start small…

INCREASE in breadth and depth as you can.

Post-Evaluation

Step 1 Analyze data, share with Board and Staff

Step 2 Set NEW goals & targets

Step 3 Develop Plan of Action to meet goals

Step 4 Implement Plan of Action

Step 5??

Repeat Steps 1-4

Resources http://managementhlep.org/evaluation/program-

evaluation-guide.htm

http://www.aecf.org/KnowledgeCenter/Publications.aspx?pubguid={4977C910-1A39-44BD-A106-1FC8D81EB792}

(A Guide to Measuring Advocacy and Policy)

http://managementhelp.org/evaluation/program-evaluation-planning.htm(Checklist for Program Evaluation Planning)