Annual Outcome Survey

Training WorkshopPrepared by DEPOCENBac Kan Province, Vietnam

April, 2011

First thing first

• Greetings

• Working agenda• Purpose• Expected outcome

• Working format• Lectures (short)• Hand-on experience• Group discussion and group work

• Working schedule• Annual Outcome Survey

Working agenda

• Purpose• Conduct an Annual Outcome/Impact Survey for Backan• Training and capacity building for all other provinces

• Expected outcome• Standard and typical Annual Outcome/Impact survey for

Backan• Findings from this survey would assist the

implementation of IFAD project in Backan (corrective action)

• M&E officers are able to replicate and adapt similar Annual Outcome Survey in their provinces with minimal support from DEPOCEN

Working format

• Lectures (a series of short lectures on selected topics)• Hand-on experience

• Sampling• Sample design• Sampling construction

• Questionnaire design/modification• Based on log-frame of Backan project to modify

the standard IFAD questionnaire to suite with Backan situation

• Fieldwork interviews• First hand experience in conducting fieldwork

• Data entry and data analysis• Group discussion and group work

• Fieldwork group• Data group

Working schedule

See the attached agenda for detailed information

Day 1: Sample design and selection

Day 2: Questionnaire design

Day 3: Fieldwork training and data entry

Day 4-12: Fieldwork implementation and data entry under direct supervision by DEPOCEN

6

Consideration for conducting the survey

Ti and Ci : measurable characteristic of the population, i = time of observation (0,1).

T0: programme group T1: programme group

C0: control group C1: control group

Baseline Follow-up

1. Best case scenario: quasi-experimental design

intervention

Annual Outcome Survey and RIMS

RIMS is a comprehensive system for measuring, aggregating, and reporting on the results and impact of IFAD supported country programmes and projects;

RIMS is made up of a standardized list of common indicators that could be applied across all IFAD projects and programmes:

1st level indicators (outputs); 2nd level indicators (outcomes); 3rd level indicators (impact)

Annual Outcome

surveyRIMS Impact survey

Report and M&E system

1st and 2nd level Indicators

First level indicators (outputs)

• People trained in infrastructure management• People trained in improved agricultural practices• Kilometers of road constructed

Second level indicators (outcomes)

• Community groups manage infrastructure in a sustainable way

• Acres of land under improved agricultural practices• Community is using the road to market their produces

Annual Outcome

survey

1st LEVEL

RESULTS

[OUTPUTS]

2ND LEVEL RESULTS

[OUTCOMES]

IMPACT

Project Results-Chain

RIMS 1st level

Indicators

RIMS 2nd level

Indicators

RIMS 3rd level

Indicators

3rd level Indicators (RIMS Impact Survey)

MDGs RIMS 3rd level (impact) I ndicators Goal 1: Eradicate extreme poverty and hunger

Households with improvement in household assets ownership index, based on additional assets (productive assets, improved housing, etc.)* Reduction in the prevalence of child malnutrition*

Goal 2: Achieve universal primary education

Net enrolment ratio in primary education

Goal 3: Promote gender equality and empower women

Literacy rate (by gender) Ratio of literate f emales to males

Goal 6: Combat HIV/AIDS, malaria and other diseases

Reduction in the incidence of inf ectious disease (HI V/ AI DS, malaria, tuberculosis)

Goal 7: Ensure environmental sustainability

People with access to improved sanitation People with sustainable access to an improved source of water (drinking water)

* Mandatory for all projects under RIMS (Anchor Indicators)RIMS survey

LFs include other indicators that are not specified under RIMS

Annual Outcome Survey & Logical Framework

Narrative Summary

Objectively Verifiable

Indicators*

Means of Verification

s

Assumptions

Goal (Impact)

(incl. RIMS 3rd level results indicators)

Purpose (Outcomes)

(incl. RIMS 2nd level results indicators)

Outputs (incl. RIMS 1st level results indicators)

Activities

Inputs

Annual Outcome Survey & Logical Framework

Objective hierarchy

Project Logic

Goal (Impact)

Improved food security of 50% households in X area

Purpose (Outcomes)

70% of the farmers adopted sustainable agricultural practices

Outputs 700 farmers received training on sustainable agricultural techniques

Activities

(Process)

Conduct 5 training on sustainable agricultural techniques

Inputs Staff, Resources

Annual Outcome Survey & Logical Framework

Objective hierarchy

Indicators

Goal (Impact)

% households in X area reports increased food adequacy

% households in X area reports increased dietary diversity

Purpose (Outcomes)

% of farmers adopted sustainable agricultural practices

Outputs # of farmers received training on sustainable agriculture

Activities

(Process)

# of training on sustainable agriculture organized

Inputs Staff, Resources

Annual Outcome Survey & Logical Framework

Objective hierarchy

Project Logic

Goal (Impact)

Reduction in diarrheal incidence in X area

Purpose (Outcomes)

80% of the HHs use safe water in all purposes70% of HHs practice improved personal hygiene

65% of HHs use sanitary latrine

Outputs 200 women received counseling on safe water, personal hygiene and sanitary practices

160 households received subsidized latrine

Activities

(Process)

Conduct 15 counseling sessions on the importance of safe water, personal hygiene & sanitation

Distribute 160 sanitary latrines at a subsidized cost

Inputs Staff, Resources

Annual Outcome Survey & Logical Framework

Objective hierarchy

Indicators

Goal (Impact)

% of HHs report diarrheal incidence in the last two weeks

Purpose (Outcomes)

% of the HHs use safe water in all purposes% of HHs practice improved personal hygiene

% of HHs use sanitary latrine

Outputs # of women received counseling on safe water, personal hygiene and sanitary practices

# of subsidize latrine distributed

Activities

(Process)

# of counseling sessions conducted

Inputs Staff, Resources

Annual Outcome Survey: WHY?

IFAD is not attempting to report on all aspects of the project but rather on a limited number of indicators;

(i) Measure changes happening at the household level in terms of livelihoods and food security during the project life

(ii) assess targeting efficiency;(iii) provide evidence of project success or failure; and (iv) provide timely performance information necessary to

undertake corrective actions.

Annual Outcome Survey and RIMS Reporting Requirements

1. Annual Reporting

Pre Mid-Term Projects Post Mid-term Projects

-Report on 1st level indicators

-Report on 1st level indicators-Report on 2nd level indicators and ratings

2. Baseline, Mid-Term, Completion

- RIMS Impact Survey

Annual Outcome

survey