Impact Assessment:Bangladesh Leadership Development Program

Presented at the annual conference of the World Association for Public Opinion Research

Austin, Texas - May 11, 2016 Nurhan Kocaoglu, Zahra Lutfeal i – Counterpart Internat ional

Ju l ie E. Phelan, Gary Langer, Gregory G. Holyk – Langer Research Associates

Matthew Warshaw – D3 Systems Inc.

Nurhan KocaogluCounterpart International

Project Background

Funded by USAID, implemented by Counterpart International in partnership with five Bangladesh CSOs, 2012-15

Train current and future leaders to participate effectively in community development; enhance their civic engagement and democratic values Build and support the capacity of adult

community leaders Encourage emerging youth leaders to become

change agents for democratic processes and local development  

BLDP Background

Among the world’s poorest, most densely populated countries

Annual GNI per capita $1,097 (2014); 32% povertyLittle economic opportunity, broad environmental

degradation, lack of access to clean water, electricity and sewage systems; unsafe working conditions, substandard construction/; persistent gender inequities

Developing democracy; centralized, insular and entrenched political system

Pervasive corruption and distrust of national gov’tLocal development dominated by connected elites,

chained to political and financial gain

Country Background: Bangladesh

Lack of understanding of civil rights and responsibilities

Lack of participation in community decision making

Lack of awareness of means by which elected officials can be held accountable

Absence of decentralized, independent community-level leadership

BLDP Concerns

Identify adult and youth community leaders via CSO partners

Train in participatory rural appraisal techniques to identify key development needs and identify assets and resources available to address them

Build capacity of participants to engage with other community members, local government officials and other civil society leaders to promote needed development and improve accountability

BLDP Intervention Approach

Review the community development/civic engagement literature to inform BLDP curriculum and assessment plan

Conduct an independent, empirically based assessment of BLDP’s effectiveness

Assessment produced by Langer Research Associates; field work management by D3 Systems, Inc.; field work by ORG Quest Ltd.

Research Needs

Gary LangerLanger Research Associates

Research Design and Execution

Is the BLDP achieving its goal of increasing the leadership capacity, skills, engagement and effectiveness of its participants?

What does the literature tell us about effective civic engagement and how can it inform our research design?

Research Questions

Importance of cultural context in leadership training Sensitivity toward norms of traditional behavior

for women Impact on women’s views of their ability to

effect changeCultural norms reflect deeply ingrained underlying

values, inc. religious beliefs, that are difficult to influence

Underscore compatibility of civic involvement/democratic values and religious/traditional beliefs by emphasizing shared concepts, e.g., tolerance, respect, community

Buy-in from religious, cultural/traditional or business leaders promotes program legitimacy

Literature Review – Key Findings (I)

Information encourages interest and empowers individuals to take an active role in community affairs

Enhanced leadership skills promote confidence and self-efficacy; these encourage involvement

Program effects may be subtle, require multiple measures

Beware of ceiling effectsLocal living conditions and quality of instruction

(teachers, teaching materials, topics and strategies) impact success

Literature Review – Key Findings (II)

Assist in design of participant databaseConduct F2F pre-treatment interviews with a random

sample of 1,750 Cohort 1 participants, Feb. 21-March 24, 2013

F2F post-treatment interviews with a random sample of 1,731 Cohort 1 and 2 participants and pre-treatment interviews with 1,750 Cohort 3 participants, Jan. 12-Feb. 16, 2015

Combine questions in construct-specific indices (tested with Cronbach’s alpha) mapped to program performance benchmarks

Given large sample sizes, use a more rigorous approach - Cohen’s d - to assess significant change in index scores (difference between two means divided by stdev)

Assessment

Key Findings

Importance of civic values

Are civic & religious values compatible?

Acceptance of others

See community as highly respectful of…• Religious leaders of other faiths: +21 pts• Ethnic and religious minorities: +11 • Women who are involved in the community: +9• Young women who are involved in the community: +14

Willingness to work with others

Civic participation rates

Leadership roles

Information

Self-efficacy

Belief you can have any influence on local government

Pre-training: 40%Post-training: 61%

Ability to influence government

Efficacy: Accountability

Efficacy: Self confidence

Rate self as highly skilled in Teamwork: +18 ptsProblem-solving: +18Communication: +17Conflict resolution: +17Decision making: +17

Efficacy: Group skills

Overall impacts

The BLDP successfully produced measurable, positive advances in trainees’ political and community engagement and commitment to community development

Gains were broadly based across metrics, including: Greater understanding of democracy and

development issues Broader belief in own ability to effect change Enhanced acceptance of others More extensive involvement in community

activities

Conclusions

Gains were smaller among previously trained participants; offer them enhanced training or mentoring roles

Gains were smaller among those in more difficult living conditions; offer them additional support

Gains differed among implementing partners; ensure and monitor training quality

Address room for additional improvement in some areas, e.g. efficacy and involvement in community development activities

Recommendations

Takeaways for Counterpart

Capacity building and learning experience Solidifying and building upon the organization’s workBest practices of creating change & ensuring

sustainabilityDesired effect?

Insights & Gains

Impact Assessment:Bangladesh Leadership Development Program

Thank you!