DCED … in

practice

from the Pacific

to Africa

Addis Ababa

Results Measurement Session

6 November 2012

The projects …

Solomon Islands Cocoa Livelihoods

Improvement Project (CLIP): in cocoa

sector value chain (the Pacific).

vs

Southern Africa Seeds and Markets

project (SAMP): in seeds sector (Southern

Africa).

Both work in input markets but also support

the development of the “output” markets (

including export market for CLIP and

agrodealers network for SAMP)

The Pacific:

Cocoa Livelihood Improvement Project

(CLIP) The AU$5.15m project, was funded by AusAID; the overall aim

was to enable rural villagers in Solomon Islands to earn regular, reliable as well as sustainable income from growing cocoa.

Through its activities CLIP specifically aimed to: Increase cocoa exports from 4,500MT (2009) to 6,000MT in three years (2012), 10,000MT in five years and 15,000MT in ten years;

It was initially part of Agriculture Livelihood Program (ALP) but when ALP finished in 2009 GoSI & AusAID decided to continue to support the cocoa sector: 2009- until June 2011; one more extension year was later added (2011-2012)

In the extension phase CLIP was placing a particular emphasis on “scaling up” its approach by intensifying what has worked well in the past.

expand the outreach of its partners (public and private) with improved and sustainable services, inputs;

facilitate copy-cat type of behaviour.

4

Substantial increase in

rural incomes for cocoa

farmers

Farmers increase in cocoa

production

Farmers improve

quality of cocoa

Farmers

Increase in

productivity

Increase in SI

exports

Increase use of

quality

planting

materials

Increase

application

of IPDM, rehabilitation

Upgrade

processing

facilities

Improve

marketing

activities

CLIP logic…

Southern Africa:

Seeds and Markets Project Project

The three year (2010-2013) $3.6m SDC funded project aims to improve availability and access to quality seeds across three countries in Southern Africa (Zimbabwe, Swaziland and Lesotho) through piloting a number of interventions in input and output markets and accelerate pro-poor growth: Community Seed Production , Seed Fairs, Agro-dealer strengthening and Contract Farming.

These interventions, once tested and proven successfully, will contribute to “improved seed security strategies and policies being adopted in the region”.

The project works with the private and public sector, especially government departments and International Agricultural Research centers involved in seed research and production and agricultural extension and the private sector players in the seed and agriculture crop commodity contract growing.

Through its activities SAMP intends to reach over 24,000 small farmers and SMEs by end of the project, June 2013.

What is the projects approach to

measuring results:

Both embarked on the use of DCED

Standard (early 2011 CLIP, mid 2011 SAMP)

Both followed the “Process” Standard in RM

Both had a pre-audit (on compliance with

the DCED Standard) conducted (March

2012 CLIP, May 2012 SAMP)

Steps in Measuring results – “the process”

1. Articulate Result chains for each

intervention

2. Define Indicators of change

3. Predict Change in indicators

4. Developing a Plan to MR

5. Collecting data and Estimating

Attributable Change

6. Analyze and Report Results

7. Learn, Use and Improve……. ( and

when needed back to 1.)

7

A Process

Standard

Results Measurement System in action

Event Process

External

8

The Results for each on…

The use of the DCED Standard

The impact benefits achieved

Cocoa Livelihood Improvement

Project (CLIP) RM System

highlights

CLIP had a logframe but also designed 7 RCs for

its interventions in input and outputs markets that

“mirror” , though in much more details, the

logframe.

The process to use the Standard started in 2009 –

2010.

The M&E System , based on the DCED Standard,

was finalised in early 2011

CLIP worked closely with the Ministry of Agriculture

and Livestock including involving them from the

very beginning in developing the project M&E

system

Key DCED element in CLIP: Predicting

changes

CLIP developed its predictions for the project key indicators in 2011 (once the system was put in place)

Staff was aware of what they had to achieve and what was their contribution to change

Through its activities, by June 2012 CLIP has contributed to an accumulated additional income increase of nearly $1.8 million (2011+2012) for over 2,800 farmers who sell wet beans, providing full time labour equivalents in employment (FTE) for over 370 people in 2011 and over 1,000 in 2012.

Additional production of wet beans (due to CLIP) will increase from over 1,200 tonnes in 2011 to over 2,700 tonnes in 2012. At the same time, additional production of dry beans (due to CLIP farmers buying and selling dry beans to exporters and traders) will increase from over 560 tonnes in 2011 to over 1,200 tonnes in 2012.

Identification of a seed company

interested in providing training to

retailers

Seed retailers who are more knowledgeable on benefits

and usage of quality seeds share this information with

their client farmers

Seed retailers trained on benefits and

usage of quality seeds

Seed company assisted in

preparing training module

Farmers get information from

trained retailers on benefits and

usage of quality seeds

Farmers use quality seeds appropriately

during cultivation

Increase in yields, production

Increase in income Increase in employment

Other Seed retailers seek

training on benefits and

usage of quality seeds

Other Farmers are influenced by

benefited farmers and use quality

seeds

12

Activities

Enterprise level (competitiveness)

Impact at Poverty

Support Market Outcome

Support Market Outputs

Key DCED element in CLIP: Clarifying what each intervention

wants to achieve from activities to impact : use of Result Chains

The Results in CLIP…

Has the approach worked?

Have the targets been achieved?

Results: but credible results

The use of DCED made CLIP offer credible results to donor

(AusAID) and other stakeholders:

CLIP would have needed more time to fully institutionalise the M&E System. Only one

year was not enough (2011 to 2012).

The team ( + 2 M&E advisers), have worked tirelessly to have a robust M&E system in

such a short time.

And the results are impressive:

By 2012 more than 7,845 farmers and other enterprises reached against target of 2,800

(+180% above the target)

More than half (+4,300) were copy-cat farmers

By 2012 $14.9 million of income increase achieved against target of $1.8 million

cumulatively (8 times the target).

By 2012, 3,493 full time equivalent new jobs per annum are estimated to be created

against target of 1,000 (3 times the target).

These results are expected to double by end of 2014. (CLIP reached the “tipping point”)

Results: involving MAL in M&E created the

first steps that lead to institutionalization of

measuring results in MAL

Steps:

1. Mentoring MAL during project implementation combined with more formal M&E trainings for MAL Officers in 2012.

2. A further training course (TOT) was conducted for the next line of extension officers and trainers in the last week of May 2012.

…The principles of M&E were much appreciated by the officers who indicated that they will use it as a tool for implementing their projects and programs.

…..CLIP Final report July 2012 states that “M&E is currently institutionalised in the extension service, not only for cocoa but for all other crops and activities”.

Auditing the system: pre- audit

A DCED pre audit was conducted in March 2012 looking at 8

compliance criteria from the DCED Standard

(www.enterprise–development.org)

“Overall, CLIP has a system in place that is partially

compliant with the DCED Standard for results

measurements.”

47% of the “Must” control points fully compliant;

47% partially compliant

and only 5% non-compliant”

CLIP project ended; so no full audit will take place, however

if MAL continues with using the system, then maybe an audit

for MAL might be conducted

Seeds and Markets Project

(SAMP) Southern Africa

SAMP (2010-2013) works with partners that provide inputs

and services to enterprises as their main activity, sector

associations, NGOs, input companies and wholesalers,

large companies, and government institutions.

SAMP had a logframe but needed to be re-designed to

better respond to the DCED approach.

SAMP has designed over 10 interventions so far in

Community Seed Production, Seed Fairs, Agro-dealer

strengthening and Contract Farming.

The SAMP embarked on the DCED approach in mid 2011

18

Key DCED element in SAMP: Clarifying the logic

Intervention result chain 1 2 …6 SAMP overall Logic

Key element of the DCED Standard in SAMP:

Aggregating results across interventions

Key DCED element : track and measure each

intervention…not just the portfolio

Key factor that made this possible? Use of DCED Standard

meant …measuring results in each intervention, report,

learn and taking corrective action..

Pilot intervention, if successful (results achieved..) scale it

up, if not, abandon

The process put in place using the DCED offered credible

results on time for staff to decide and take action

“…. If it is not producing (based on the measurement

system) what was planned do not invest anymore”

“Venture capital” approach

The Results in SAMP…

Has the approach worked?

Have the targets been achieved?

Results: but credible results

The use of DCED made SAMP offer credible results to

donor (SDC) and other stakeholders:

By end of 2012 over 10,000 farmers and other enterprises reached against

target of 12,000 (20% below the target)

By end of 2012, 4,400 farmers were involved in contract farming These farmers

planted nine different crops on over 2,000ha across the SAMP sites harvesting

a combined crop tonnage of over 390MT against a combined target of 774MT

(+100% above the target); $138 income per farmer (almost breakeven)

In Zim 454 farmers were involved in growing of various seeds crops , 50ha

(against a target of 65 ha) produced 27MT of seeds (200% below the target

75MT due to poor soil moisture during the growing season); $47 additional

income per farmer.

In Swaziland 19 farmers were involved in growing of various seeds crops ,

17ha produced 34MT of seeds (target reached); $826 additional income per

farmer

Over 5,000 farmers were involved in selling outputs through the dealers and

seed fairs, with an average additional income of $150.

Results: private sector, NGOs interested

in the DCED Standard for their internal

use

Results chains are a useful management

tools for both the private sector and NGO

sector

Auditing the system: pre- audit

A pre-audit was conducted in March 2012 looking at 8

compliance criteria from the DCED Standard (www.enterprise–development.org)

“Overall, SAMP has a system in place that is partially compliant with the DCED Standard for results measurements.”

25% of the “Must” control points are fully compliant,

65% partially compliant.

Only 10% (two control point 1.3 Staff familiarity and 4.2. Contribution of publicly funded programs) is non-compliant.

SAMP is currently addressing the issues and aims for a full audit in November 2013