Assessing the Capacity of Community Coalitions to Advocate for Change

42
Veena Pankaj Kat Athanasiades Ann Emery Johanna Morariu Assessing the Capacity of Community Coalitions to Advocate for Change Advocacy Evaluation Breakfast Series Hosted by the Aspen Institute Washington, DC May 22, 2013

description

Research has shown that high-capacity coalitions are more successful in effecting community change. While a number of coalition assessment tools have been developed, documentation is scarce regarding how they are implemented, how the results are used, and whether they are predictive of coalition success in collaborative community change efforts. Developed for a health promotion initiative of a major health foundation, this tool is designed to assess coalition progress in eight key areas across twelve different community coalitions, over the course of a three year initiative. On May 21, 2013, Veena Pankaj, Kat Athanasiades, Ann Emery, and Johanna Morariu gave a presentation titled "Assessing the Capacity of Community Coalitions to Advocate for Change." The panel was hosted by the Advocacy Planning and Evaluation Program (APEP) at the Aspen Institute in Washington, DC. The session focused on a coalition assessment tool that was designed by Innovation Network to assess changes in coalition capacity over time. Presenters shared lessons learned from the first year of the initiative about developing and deploying the assessment tool, as well as what these tools can--and can't--tell you about a coalition's capacity in conducting community change work. In addition presenters shared how information collected from this assessment can be communicated back to the coalitions using data visualization approaches to effectively communicate the data.

Transcript of Assessing the Capacity of Community Coalitions to Advocate for Change

Page 1: Assessing the Capacity of Community Coalitions to Advocate for Change

Veena PankajKat AthanasiadesAnn EmeryJohanna Morariu

Assessing the Capacity of Community Coalitions to Advocate for Change

Advocacy Evaluation Breakfast SeriesHosted by the Aspen Institute

Washington, DCMay 22, 2013

Page 2: Assessing the Capacity of Community Coalitions to Advocate for Change

Veena PankajDirector [email protected]

Kat AthanasiadesAssociate [email protected]

Ann EmeryAssociate [email protected]

Johanna MorariuDirector [email protected]

www.innonet.org | @InnoNet_Eval | #CATeval

About Us

Page 3: Assessing the Capacity of Community Coalitions to Advocate for Change

#CATeval@InnoNet_Eval@KatAthanasiades@AnnKEmery@J_Morariu

Let’s Connect

www.innonet.org | @InnoNet_Eval | #CATeval

Page 4: Assessing the Capacity of Community Coalitions to Advocate for Change

What’s the first thing to come to mind when you hear

advocacy evaluation?

www.innonet.org | @InnoNet_Eval | #CATeval

Page 5: Assessing the Capacity of Community Coalitions to Advocate for Change

What’s the first thing to come to mind when you hear

coalition assessment?

www.innonet.org | @InnoNet_Eval | #CATeval

Page 6: Assessing the Capacity of Community Coalitions to Advocate for Change

How does this session relate toyour work and interests?

www.innonet.org | @InnoNet_Eval | #CATeval

Page 7: Assessing the Capacity of Community Coalitions to Advocate for Change

Agenda

1 Background

2 Development & Implementation

3 Reporting to Stakeholders

4 Strengths & Challenges

5 Summary & Applicationswww.innonet.org | @InnoNet_Eval | #CATeval

Page 8: Assessing the Capacity of Community Coalitions to Advocate for Change

Agenda

12 Development & Implementation

3 Reporting to Stakeholders

4 Strengths & Challenges

5 Summary & Applications

Background

www.innonet.org | @InnoNet_Eval | #CATeval

Page 9: Assessing the Capacity of Community Coalitions to Advocate for Change

Agenda

12 Development & Implementation

3 Reporting to Stakeholders

4 Strengths & Challenges

5 Summary & Applications

Background

www.innonet.org | @InnoNet_Eval | #CATeval

Page 10: Assessing the Capacity of Community Coalitions to Advocate for Change

Snapshots

DevelopedImplemented

Report

Aug 2012

Sept2012

Jan 2013

Development & Implementation2

Oct2012

www.innonet.org | @InnoNet_Eval | #CATeval

Page 11: Assessing the Capacity of Community Coalitions to Advocate for Change

Seven categories of CATBasic Functioning and Structure

Ability to Cultivate and Develop Champions

Coalition Leadership

Ability to Develop Allies and Partnerships

Development & Implementation2

Reputation and Visibility

Ability to Learn from the Community

Sustainability

www.innonet.org | @InnoNet_Eval | #CATeval

Page 12: Assessing the Capacity of Community Coalitions to Advocate for Change

Vetting processKansas Health Foundation staff

GEO Place-Based Community of Practice

Kansas Advisory Committee

Development & Implementation2

Healthy Communities Initiative Technical Assistance

team

Coalition members

www.innonet.org | @InnoNet_Eval | #CATeval

Page 13: Assessing the Capacity of Community Coalitions to Advocate for Change

Development & Implementation2

56 coalition members

12 TA providers

68 total responses

www.innonet.org | @InnoNet_Eval | #CATeval

Page 14: Assessing the Capacity of Community Coalitions to Advocate for Change

Agenda

12 Development & Implementation

3 Reporting to Stakeholders

4 Strengths & Challenges

5 Summary & Applications

Background

www.innonet.org | @InnoNet_Eval | #CATeval

Page 15: Assessing the Capacity of Community Coalitions to Advocate for Change

Reporting to Stakeholders3

Report SnapshotsMemos

www.innonet.org | @InnoNet_Eval | #CATeval

Page 16: Assessing the Capacity of Community Coalitions to Advocate for Change

Overall Scores

Reporting to Stakeholders3

Community 6Community 4Community 9Community 8Community 2

Community 11Community 7

Community 12Community 3Community 5

Community 10Community 1

29%

40%

55%

64%

66%

68%

69%

70%

77%

79%

80%

81%

www.innonet.org | @InnoNet_Eval | #CATeval

Page 17: Assessing the Capacity of Community Coalitions to Advocate for Change

Reporting to Stakeholders3

1-page Community Snapshots

www.innonet.org | @InnoNet_Eval | #CATeval

Page 18: Assessing the Capacity of Community Coalitions to Advocate for Change

Reporting to Stakeholders3

Memos

www.innonet.org | @InnoNet_Eval | #CATeval

Page 19: Assessing the Capacity of Community Coalitions to Advocate for Change

Reporting to Stakeholders3

0% 20% 40% 60% 80% 100%

Series3

52%

Basic Functioning and Structure

Allies and Partnerships

Champions

Reputation and Visibility

Learn from Community

Coalition Leadership

Sustainability

Overall

Community Members

www.innonet.org | @InnoNet_Eval | #CATeval

Page 20: Assessing the Capacity of Community Coalitions to Advocate for Change

Reporting to Stakeholders3

0% 20% 40% 60% 80% 100%

Basic Functioning and Structure

Allies and Partnerships

Champions

Reputation and Visibility

Learn from Community

Coalition Leadership

Sustainability

Overall

TA Providers

www.innonet.org | @InnoNet_Eval | #CATeval

Page 21: Assessing the Capacity of Community Coalitions to Advocate for Change

Reporting to Stakeholders3

0% 20% 40% 60% 80% 100%

Series3Basic Functioning and Structure

Allies and Partnerships

Champions

Reputation and Visibility

Learn from Community

Coalition Leadership

Sustainability

Overall

Community Members

TA Providers

www.innonet.org | @InnoNet_Eval | #CATeval

Page 22: Assessing the Capacity of Community Coalitions to Advocate for Change

Reporting to Stakeholders3

Report

Region?Time in coalition?Time in community?Engagement?Number of members?Number of new members?

www.innonet.org | @InnoNet_Eval | #CATeval

Page 23: Assessing the Capacity of Community Coalitions to Advocate for Change

Reporting to Stakeholders3

More time in coalition

More coalition members

Higher scores

www.innonet.org | @InnoNet_Eval | #CATeval

Page 24: Assessing the Capacity of Community Coalitions to Advocate for Change

Agenda

12 Development & Implementation

3 Reporting to Stakeholders

4 Strengths & Challenges

5 Summary & Applications

Background

www.innonet.org | @InnoNet_Eval | #CATeval

Page 25: Assessing the Capacity of Community Coalitions to Advocate for Change

This survey is too long for busy people.

—Coalition member

Strengths & Challenges4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 26: Assessing the Capacity of Community Coalitions to Advocate for Change

I hadn’t thought about us collecting feedback on whether the community is satisfied with our work because we are so busy doing the work… Very interesting question.

—Coalition member

Strengths & Challenges4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 27: Assessing the Capacity of Community Coalitions to Advocate for Change

The initial mission, vision, and values are defined but under development.

—Coalition member

Strengths & Challenges4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 28: Assessing the Capacity of Community Coalitions to Advocate for Change

Our monetary resources are limited to the planning grant monies.

—Coalition member

Strengths & Challenges4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 29: Assessing the Capacity of Community Coalitions to Advocate for Change

These questions… are good questions for us to have as a guide for our work.

—Coalition member

Strengths & Challenges4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 30: Assessing the Capacity of Community Coalitions to Advocate for Change

Realistically, many of these points cannot be accomplished within a year, but it is a goal to strive towards.

—Coalition member

Strengths & Challenges4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 31: Assessing the Capacity of Community Coalitions to Advocate for Change

a. Integrate multiple perspectivesb. Show change over timec. Contextual data about policy changesd. Aggregate and community-level datae. Tool & evaluation = intervention

Strengths4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 32: Assessing the Capacity of Community Coalitions to Advocate for Change

a. Integrate multiple perspectivesb. Show change over timec. Contextual data about policy changesd. Aggregate and community-level datae. Tool & evaluation = intervention

Strengths4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 33: Assessing the Capacity of Community Coalitions to Advocate for Change

a. Integrate multiple perspectivesb. Show change over timec. Contextual data about policy changesd. Aggregate and community-level datae. Tool & evaluation = intervention

Strengths4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 34: Assessing the Capacity of Community Coalitions to Advocate for Change

a. Integrate multiple perspectivesb. Show change over timec. Contextual data about policy changesd. Aggregate and community-level datae. Tool & evaluation = intervention

Strengths4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 35: Assessing the Capacity of Community Coalitions to Advocate for Change

a. Integrate multiple perspectivesb. Show change over timec. Contextual data about policy changesd. Aggregate and community-level datae. Tool & evaluation = intervention

Strengths4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 36: Assessing the Capacity of Community Coalitions to Advocate for Change

a. Ratings are opinionsb. Self-awareness low at firstc. Languaged. Focus changes over time

Challenges4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 37: Assessing the Capacity of Community Coalitions to Advocate for Change

a. Ratings are opinionsb. Self-awareness low at firstc. Languaged. Focus changes over time

Challenges4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 38: Assessing the Capacity of Community Coalitions to Advocate for Change

a. Ratings are opinionsb. Self-awareness low at firstc. Languaged. Focus changes over time

Challenges4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 39: Assessing the Capacity of Community Coalitions to Advocate for Change

a. Ratings are opinionsb. Self-awareness low at firstc. Languaged. Focus might change over time

Challenges4

www.innonet.org | @InnoNet_Eval | #CATeval

Page 40: Assessing the Capacity of Community Coalitions to Advocate for Change

Agenda

12 Development & Implementation

3 Reporting to Stakeholders

4 Strengths & Challenges

5 Summary & Applications

Background

www.innonet.org | @InnoNet_Eval | #CATeval

Page 41: Assessing the Capacity of Community Coalitions to Advocate for Change

Materials

www.innonet.org

Where We’ve Been

www.innonet.org | @InnoNet_Eval | #CATeval

Page 42: Assessing the Capacity of Community Coalitions to Advocate for Change

Assessing the Capacity of Community Coalitions to Advocate for Change

Thank You!

Veena PankajDirector [email protected]

Kat AthanasiadesAssociate [email protected]

Ann EmeryAssociate [email protected]

Johanna MorariuDirector [email protected]

www.innonet.org | @InnoNet_Eval | #CATeval