Monitoring & Evaluation:Overview

Sam MuhulaCHAK-M&E OfficerACHA-P workshop

• Do you ever wonder how -%age of ART clients in 6 month cohort undergoing repeat CD4 testing rose from 52% to 73% is come about?

OR• Prevalence of low birth weight in a country is

20%, • Results from M&E efforts

What is M&E

• Process by which data is collected, analyzed in order to provide information to policy makers and others for use in program planning and project management

Monitoring Evaluation• What do you do? • Measures how well the program

activities have met expected objectives?

• How much does implementation vary from site to site?

• Extent to which changes in outcome can be attributed to the program

• Did the program benefit the intended people?

• Focuses more on quality of program

• ongoing continuous process • carried out at intervals

• collection of data at multiple points thr’out program cycle

• data collected at intervals

• determine if activities need adjustments to improve desired outcomes

• control group needed- change in outcome attributed to program

Graphic illustration of program monitoring over time

• Intention is to reduce the gap

Graphic illustration of program impact

Use of information

• Find out causes of attrition in our program– Lost To Follow Up- Community component– Death- find out major cause of death– Transferred out- why – Stopped ART- self or physician?

M & E functionsYes No

Illustrates progress towards achievementsHighlights successes & shortcomings management of useful informationProvide information needed for planning & decision makingProvides evidence of effects of interventionsSet up feedback systemsneutral

× Used to “police” others and there work× determines failure× identifies those to punish× data manipulation to create false outcomes × data only reported upwards , and not used locally

M & E plans

M&E plan includes; • Anticipated relationship between activities,

outputs and outcomes• List of data sources• Cost estimates for M&E activities• Responsible parties• Monitoring schedule• Indictor definitions • Dissemination and utilization plan of

information gained

M&E plan matrix Objective Performa

nce Indicators

Indicator Definition Data Sour

ce

Responsib

le party

Frequency of reports

Target Values

To facilitate south -south exchange & learning

No. of facilitated visits conducted

The indicator describes the facilitated exchange and learning visits among the south-south partners and CHAs for learning practical lessons from the experiences that exist

Monthly/quarterly/bi-annually/annually

Indicators• Variable that measures an aspect of a program• Measures the value of change in meaningful

units• Focuses in a single aspect of a program– Narrowly defined to capture the aspect as precisely

as possible

• Can be quantitative or qualitative– Quantitative-numeric (Nos. or &ages)– Qualitative-descriptive (can be used to supplement

the Nos. & %ages)

Indicators (cont)

• Qualitative indicators adds richness of information about the context in which the program has been operating– Examples; availability of updated CHAs directory,

updated ACHAP website

Challenges with M&E• Advance proper planning– M&E and programs do not communicate– Issues with budget– Not able to meet targets– Not able to evaluate program

• Different funders=different and ever changing monitoring &reporting requirements

• Inadequate understanding of what M&E is all about

• Poor reporting culture

Some online resources;

• Measure evaluation training website– http://www.cpc.unc.edu/measure/training

• Global health e-learning website – http://www.globalhealthlearning.org.