M E T R Monitoring and Evaluation for Timely Responses

“Measuring the right things in the right way at the right time”

Briefing for Discussion at FEMA, IPB DramagaWednesday 20th May 2015, v2

Documents also provided,- METR two-page summary- METR checklist- METR team-building and project engagement

METR adds value to existing methodologies for M&E of development

projectsguided by project goals within wider development contextexternal rapid project performance assessment (3-4 weeks)

World Bank (2004) Monitoring and Evaluation: Some Tools, Methods and Approaches, Section 14

extension of EuropeAID M&E EuropeAid (2002) Project Cycle Handbook, Annex 5.3.3.

ex-post, midterm evaluation

METR Informs,

PROJECT IMPLEMENTERSPROJECT DESIGNERS of donor agenciesPROJECT BENEFICIARIES / PARTNERSPOLICY MAKERS, directly or indirectly

Projects appropriate for METR

1) Natural resource / environmental management2) Fisheries, forestry, agroforestry, agriculture production and trade3) Public health & education4) Microfinance 5) Conflict resolution6) Rehabilitation and Reconstruction after Natural/Human Disaster relief7) Climate change adaptation

METR Team Resources to assess project interventions

Science and Technology Economics Institutional Development

METR Emphasis1.Impact-oriented, direct and proxy indicators2.Clearly distinguishes between design and implementation

contribution to success/failure3.Employs counterfactuals to assess attribution4.Achieves understanding of the nature of the problem and its

solution ~ from Problem Tree to Program Logic5.Follows objective yet appreciative inquiry6.Assesses the crucial role of MUTUAL TRUST among key

stakeholders7.Encourages Shared learning among not only project

beneficiaries/partners, implementers and donors but also policy-makers

Five Guiding Questions about the Project

1. “Is there sufficient mutual trust among key stakeholders (ToT)?”2. “What we thought we knew but experience taught us

otherwise?”3. “Are lessons being learned and shared or just identified?” 4. “What was your best moment on the project?”5. “What will happen on the first day after the last day of the

project?”

METR Report Structure covers

I. PROJECT DESIGN:Understanding the nature of the problem ~ problem treeTranslating understanding into program logic ~ logical framework

II. PROJECT IMPLEMENTATION:• Efficiency of delivery of benefits• Effectiveness of outreach to targeted groups• Impact beyond set-up of projects with target groups• Sustainability beyond the project assistance lifetime (likelihood, if project still on-going)• Lessons Learned about unexpected outcomes of the project, good and bad• Recommendations for improvement addressed to donor provider

III. FEEDBACK: incorporating key stakeholder responses

Distinguishing between maximizing and optimizing productivity