Africa RISING Monitoring and Evaluation activities in West Africa

Justice Ajaari, IFPRI

Africa RISING–CSISA Joint Monitoring and Evaluation Meeting, Addis Ababa, Ethiopia, 11-13 November 2013

oAR-WA ObjectivesoAR-WA ActivitiesoAR Systems & Siteso Expected ResultsoM&E FocusoPerformance IndicatorsoCustomized IndicatorsoData QualityoM&E Reflections

Outline of Presentation

oTransform agricultural systems through sustainable intensification (SI)

oSI:- producing more (agricultural) output from same area of land, while:

• reducing negative environmental impacts

• increasing contributions to natural capital and flow of

environmental services

AR-WA Objectives

Systems & Siteso Cereal-based farming systems - Sudano-Sahelian zone of West Africa (WA -AR)o Crop-livestock systems - Ethiopian highlandso Maize-legume-livestock systems - Eastern & Southern Africa

Activitieso Diagnosis & design of technology combinations o On-farm & on-station trials of new combinations of existing

technologieso Institutional and/or value chain improvements

oSustainable higher productivityoReduced negative environmental impactsoIncreased contributions to natural capital & flow of

environmental servicesoImproved Value chain conduct and performance??oImproved market efficiency??oImproved Agric. Extension Effectiveness??

Expected Results

oMonitoring• Field Visits (Mali & Ghana Field Visits)• USAID Feed the Future Indicators• Customized Indicators

oCapacity Building• Mali Partners M&E Workshop (September, 2013)• Ghana Partners M&E Workshop (November, 2013)• Partner Driven Studies-Qualitative Research

o Evaluation• Baseline Evaluation-Household/ Community Survey

Ghana-November/December, 2013 & Mali-January/February,2014

• Endline Impact Evaluation (2016)

Current M&E Focus

o Number of Hectares under improved technologies or management practices as result of USG assistance

o Number of Farmers and others who have applied new technologies or management practices as a result of USG assistance

o Number of individuals who have received USG Supported short-term agricultural sector or food security training

o Number of food security private enterprises (for profit), producer organizations, water users associations, women’s group, trade and business associations and Community-based organization (CBO) receiving USG assistance.

Performance Indicators-FTF/AR

o Number of Public-Private Partnership Formed as a result of FTF assistance

o Number of members of Producer Organizations and Community based Organizations receiving USG assistance

o Number of private enterprises (for profit), producers organizations, water users associations, women's groups, trade and business associations, and community-based organizations (CBOs) that applied new technologies or management practices as a result of USG assistance

AR-WA FTF Indicators-Cont.

o Number of new technologies or management practices in one of the following phases:

• Phase 1: Number of new technologies or management practices under research as a result of USG assistance

• Phase 2: Number of new technologies or management practices under field testing as a result of USG assistance

• Phase 3 Number of new technologies or management practices made available for transfer as a result of USG assistance

AR-WA FTF Indicators-Cont.

oNumber of Vulnerable Households Benefiting directly form USG

oNumber of individuals who have received USG Supported long-term agricultural sector or food security training

Proposed additional FTF indicators for in House Use

oEarly Warning Indicators:• Rainfall• Fuel• Food Prices• Input Costs

oAgronomic indicators:• Yield • Pest and disease resistance

Customized indicators

What Next?

What should occur in the next two years to

improve M&E

USAID:

• ADS 203.3.5.1: “To be useful in managing for results and credible for reporting, data need to meet quality standards”

• ADS 203.3.5.2: “Purpose of DQA: aware of the extent to which the data integrity can be trusted to influence management decisions”

MCC: • Section 5.4.1- M&E policy: ‘’Good data quality is essential to maintain a high

level of confidence in the decisions that are made using the data’’

World Bank: • Data Quality Assessment Framework (DQAF):..” assessing data quality that

brings together best practices and internationally accepted concepts and definitions”

Data Quality

Implementing Partner Level (Primary Data Source)

Intermediate aggregation level (District, Region)

M&E unit(aggregation at the highest level of a program -PMP)

M&E System

DATA QUALITY Accuracy, Reliability, Completeness,

Precision, Timeliness, Integrity

M&E SYSTEM

• Appropriate data management systems are in place (from lowest to the highest level)

• Data Verification to Verify the accuracy of reported data for key indicators

• M&E Tools

AR-WA Field Data M&E System

Data Quality

1. Accuracy

2. Reliability

3. Completeness

4. Precision

5. Timeliness

6. Integrity

AccuracyData should clearly and adequately represent the intended results.

AR-WA requires that each level of data is aggregated correctly is documented through source data

ReliabilityThe data are measured and collected consistently.

AR-WA requires the use of consistent and standardized data collection tools to collect data

Completeness

Completely inclusive: an information system represents the complete list of eligible names and not a fraction of the list.

AR-WA requires comprehensive beneficiaries’ level information

Precision

The data have sufficient detail.

AR-WA requires that indicators have standardized definitions and are disaggregated by gender, location and other key variables

Timeliness

Data are up-to-date (current), and information is available on time.

AR-WA requires timely reporting

IntegrityThe data are protected from deliberate bias or manipulation for political or personal reasons.

AR-WA requires all datasets to be of the highest integrity and quality

If you do not measure results, you cannot tell success from failure

If you can not see success, you can not reward it If you can not reward success, you are probably rewarding

failure If you can not see success, you can not learn from it If you can not recognize failure, you can not correct it If you can demonstrate results, you can win public

support

M&E Reflections