CONNECTICUT HEALTH FOUNDATION:

Update on Evaluation Planning for the Strategic Plan

2

CT HEALTH: LEVELS OF HEALTH EQUITY CHANGES

123

Individuals impacted by CT Health•Individual-level changes•Example: Uninsured people of color enrolled in CT Health Access; Fellows develop leadership skills

Organizations, systems, and policies influenced by CT Health• Changes in policies, procedures, and practices•Example: standards adopted and practiced by an organization or state agency

Health equity in the State of Connecticut• Population-level changes•Example: Reduction in disparities in emergency room visits due to improvement in preventive care

2

3

CT HEALTH: EVALUATION APPROACH

The Evaluation Approach

The Balanced Scorecard – Reports to the Board

To provide more information/data to staff and board that is learning-focused and actionable

To monitor outputs and outcomes To provide data to populate the

Balanced Scorecard

CT Health Effort & Results: the Foundation’s efforts and results

State of the State: changes related to health equity in CT

4

The work of CT HealthThe work of CT Health grantees, Fellows, allies, etc.

Long-term changes brought about by many players

State-level Changes:•Reduction in health disparities•Changes in state-level policies

PROGRAM

EVALUATION

Outcome Evaluation•Changes in systems and policies•Changes in organizations’ capacities•People and partners are better off•Fellows are strengthened

Implementation Evaluation•Work implemented•Strategies to achieve outcomes•Lessons learned•Mid-course adjustments

Informs numerical Balanced Scorecard

PROGRAM & EVALUATION BY TIME

5

CT Health CT Health grantees, Fellows, partners, allies, etc.

Implementers, decisionmakers, and systems that must change to bring about greater health equity

Influence Influence

Influence

Influence

Influence

INFLUENCE

Goal 1

Leverage opportunities to advance health equity in reforming health care

Objective 1: Promote health insurance enrollment and navigation support systems that will increase and maintain coverage.

Objective 2: Foster the inclusion of mental, oral, and physical health in an integrated health care system.

6

Objective 2

7

GOAL 1: EVALUATION QUESTIONS

Objective 1

❶ How did CT Health help with the preparation for enrolling uninsured individuals of color in Access Health CT and Medicaid?

❷ How many people were enrolled?

❸ How did CT Health help with the preparation for developing an integrated health system?

❹ What has been the progress towards an integrated system?

8

Outputs Outcomes Data Collection Examples• Proportion of CT Health funds

for navigation support systems• # of navigation support systems

funded through regrants• An assessment protocol to

evaluate systems’ effectiveness• Standards for uniform data

collection

• Increased total enrollment

• New Enrollment• Disenrollment• Continuity of Coverage• Adoption of assessment

protocol by Access Health CT and Medicaid

• Establishment of a data collection system

• Tracking of number and amount of regrants re

• Tracking of enrollees, disenrollees, new enrollees, and changes in coverage plans

• Survey of the navigation support system regrantees

EVALUATION PLAN: GOAL 1❶ How did CT Health help with the preparation for enrolling uninsured individuals of color in Access Health CT and Medicaid?❷ How many people were enrolled?

9

EVALUATION PLAN: GOAL 1❸ How did CT Health help with the preparation for developing an integrated health system?❹ What has been the progress towards an integrated system?

Outputs Outcomes Data Collection Examples• Research papers and other

products• A research dissemination plan• CT Health Training Module for

selecting dental health benefits• Amount of funding for

integration efforts

• Improved knowledge about promising models• Informed policymakers

and other decision makers• Decisions to use

promising models• Integrated systems occur,

step-by-step

• Review of papers and other products• Review of dissemination

plan• Survey of grantees and CT

Health staff• Interviews with

policymakers and other decisionmakers• Surveys of systems’

representatives

Goal 2

Strengthen leadership and network capacity to promote health equity in health careaccess and delivery.

Objective 1: Cultivate diverse, skilled health equity leaders that advocate for and effect change in private, public and non-profit sectors.

Objective 2: Advance public policies that promote health equity by establishing a health advocacy entity.

10

Objective 2

11

GOAL 2: EVALUATION QUESTIONS

Objective 1

❷ What is the capacity of the Health Leadership Fellows Program?

❸ What is the progress of the Health Leadership Fellows Program?

❹ What is the capacity of the health advocacy entity?

❺ What is the progress of the health advocacy entity?

❶ What is the influence of CT Health, its staff, its Board, its grantees, the fellows, and other CT Health stakeholders to promote health equity?

12

EVALUATION PLAN: GOAL 2❶ What is the influence of CT Health, its staff, its Board, its grantees, the Fellows, and other CT Health stakeholders to promote health equity?

Outputs Outcomes Data Collection• Activities and

efforts undertaken to influence decisionmakers

• Interactions with decisionmakers

• Creation of new supporters and champions

• Creation and implementation of solutions for health care access and delivery

• Tracking of influence activities, outputs, and outcomes

• “Bright spots” case studies to examine successful influence outcomes to understand the role of CT Health and its partners

13

EVALUATION PLAN: GOAL 2❷ What is the capacity of the Health Leadership Fellows Program?

❸ What is the progress of the Health Leadership Fellows Program?

Outputs Outcomes Data Collection• # of new

Fellows• Total # of

Fellows• HFLP activities

• More health equity leaders

• Skill set• Network for health

equity• Increased capacity

• Tracking of HLFP fellows

• Activity of CT Health, partners, and HLFP fellows in health care access and delivery efforts

• Supporters and champions

• Solutions for health care access and delivery

• Annual study of HLFP fellows’ continued engagement in supporting health equity

14

EVALUATION PLAN: GOAL 2❹ What is the capacity of the health advocacy entity?

❺ What is the progress of the health advocacy entity?

Outputs Outcomes Data Collection• Legal status• Staffing for

operations and program

• Strategies/activities to advance policies

• Network building and coordination

• Capacity assessment in seven dimensions: basic functioning & structure, champions, leadership, learning, partnerships, reputation & visibility, and sustainability

• Strategies/ activities to advance public policies that promote health equity

• Network to advance public policies

• Relationships with decision makers

• Progression among target audiences

• Systems, practice, and policy change

• Network analysis of the health advocacy entity’s position and contribution

• Decision maker mapping to analyze evidence of influence

Evaluation Plan

Questions&

Feedback

15