1. Putting order into the scorecard landscape
Matching demand with supply
Trying to understand links between different initiatives
2. Addressing technical & coordination questions: improving indicator quality and the M&E governance system
What are the demands? Questions to be addressed Available Scorecards
1. Understanding country
performance and
country needs
Where do countries stand
relative to goals? (Baseline) ▪ MDG or SDG processes
▪ Strategic Objectives of development
agencies (bilateral/multilateral)
▪ Strategic Objectives of resource
partners
▪ Strategic Areas (FtF)
Where are the greatest
needs, regionally and
thematically?
FAO Food security scorecard
FAO SO Scorecards
IFAD ATI
USAID: FtF Progress
scorecard
2. Measuring complex
phenomena and
monitoring progress
How much progress has
been made relative to the
baseline?
At country level
At global level (MDG/SDG)
FAO Food security scorecard
FAO SO Scorecards
IFAD ATI
USAID: FtF Progress
scorecard
What are the demands? Questions to be addressed Available Scorecards
3. Understanding Country
Commitments and
Capacities
How much capacity is
available at country level?
Where can Doers start
implementing their
programs?
Country Uptake of Doer
activities
IDS: Hunger Reduction Commitment Index FAO: C&C scorecard for food security and malnutrition FAO: OO scorecards
What are the demands? Questions to be addressed Available Scorecards
4. Understanding gaps What are the key gaps in
meeting country needs and
development goals?
• At country level
• At the regional and global
level
Synthesis of Doer and
Donor performance
scorecards
Synthesis of activities and
comparison with country
needs
What are the demands? Questions to be addressed Available Scorecards
5. Benchmarking /Evaluation What Doer renders the highest
return pursuing what
development goal? (“biggest
bang for the development
buck”)
What Donor allocates
development dollars most
effectively?
What Country uses the
development dollars most
effectively?
Corporate scorecards
(IOs/bilaterals)
Donor scorecards (bilateral,
multilateral)
Business climate scorecards
1. Putting order into the scorecard landscape
Matching demand with supply
Trying to understand links between different initiatives
2. Addressing technical questions: improving indicator quality and the M&E governance system
The principal scorecards and some key links
2. Donors (funders) 1. Countries
3. Corporate (WB, FAO, FtF…)
The principal scorecards and some key links
2. Donors (funders) 1. Countries
Performance scoring
Identification of needs
Development goals
Strategic objectives
3. Corporate (WB, FAO, FtF…)
The principal scorecards and some key links
2. Donors (funders) 1. Countries
Performance scoring
•Capacity & commitment scoring
•Identification of Doer deliverables
and monitoring of Doer outcomes
Identification of needs
Development goals
Strategic objectives
3. Corporate (WB, FAO, FtF…)
The principal scorecards and some key links
2. Donors (funders) 1. Countries
Performance scoring
•Capacity & commitment scoring
•Identification of Doer deliverables
and monitoring of Doer outcomes
Identification of needs
Development goals
Strategic objectives
3. Corporate (WB, FAO, FtF…)
• SO (FAO), HLG (FtF), etc.
The principal scorecards and some key links
2. Donors (funders) 1. Countries
Performance scoring
•Capacity & commitment scoring
•Identification of Doer deliverables
and monitoring of Doer outcomes
• SO (FAO), HLG (FtF), etc.
• OO (FAO), 17 Goals FtF
Identification of needs
IDS: hunger reduction
commitment index
World Bank: Benchmarking
the Business of Agriculture
FAO: C&C FS scorecard
3. Corporate (WB, FAO, FtF…)
The principal scorecards and some key links
2. Donors (funders) 1. Countries
Performance scoring
•Capacity & commitment scoring
•Identification of Doer deliverables
and monitoring of Doer outcomes
• OO (FAO), 17 Goals FtF, etc.
Identification of needs
IDS: hunger reduction
commitment index
World Bank: Benchmarking
the Business of Agriculture
FAO: C&C FS scorecard
3. Corporate (WB, FAO, FtF…)
• SO (FAO), HLG (FtF), etc.
National: monitoring within-country
performance of bi-lateral funders
International: coordination of funder
activities, regional and thematic
The principal scorecards and some key links
2. Donors (funders) 1. Countries
Performance scoring
•Capacity & commitment scoring
•Identification of Doer deliverables
and monitoring of Doer outcomes
• FO (efficiency of internal enablers)
• OO (FAO), 17 Goals FtF
Tier 1
Tier 2
Tier 3
National: monitoring within-country
performance of bi-lateral funders
International: coordination of funder
activities, regional and thematic
Identification of needs
IDS: hunger reduction
commitment index
World Bank: Benchmarking
the Business of Agriculture
FAO: C&C FS scorecard
3. Corporate (WB, FAO, FtF…)
• SO (FAO), HLG (FtF), etc.
The principal scorecards and some key links
2. Donors (funders) 1. Countries
Performance scoring
•Capacity & commitment scoring
•Identification of Doer deliverables
and monitoring of Doer outcomes
• FO (efficiency of internal enablers)
• OO (FAO), 17 Goals FtF
Tier 1
Tier 2
Tier 3
National: monitoring within-country
performance of bi-lateral funders
International: coordination of funder
activities, regional and thematic
Donor evaluation of
Doers (RBAs, BWIs,
NGOs, etc.)
Feeds MOPAN,
MAR, CGD-ME, etc.
Evaluation and
auto-evaluation of
Funders
Identification of needs
Country evaluation
of Donors (RBAs,
BWIs, NGOs, etc.) IDS: hunger reduction
commitment index
World Bank: Benchmarking
the Business of Agriculture
FAO: C&C FS scorecard
3. Corporate (WB, FAO, FtF…)
• SO (FAO), HLG (FtF), etc.
1. Putting order into the scorecard landscape
Matching demand with supply
Trying to understand links between different initiatives
2. Addressing technical & coordination questions: improving indicator quality and the M&E governance system
Function/needs Questions to be addressed Possible solution
1. Coordinating a growing
number of scorecard
activities at national and
international level
How can existing scorecard activities be better coordinated? How can emerging needs be better planned? Is there a need for a “Masterplan”?
3. Collecting, compiling and
disseminating information
How can we M&E stakeholders
effectively share information
on initiatives, data and
indicators?
3. Facilitating technical
discussions, addressing
technical questions
How can technical questions be
better coordinated?
4. Peer review of indicators
and scorecard approaches
How can we provide quality
assurance for data, indicators,
scorecard approaches?
Inter-agency and expert group on agricultural statistics equipped with standards and norms setting - under UNSC (?)
Alliance for Harmonizing Monitoring & Evaluation (?)
Thank you
The big picture: Monitoring and evaluating a rapidly evolving
international development system
“Realizing the Future we Want for All”: MDG and SDG processes Global Goals
RBAs Doers BWIs/IFIs
Countries
UN CGIAR Regions others
MDG1 … 8 SDGs Rio+20
FAO: SO1-SO6 CGIAR: SRF Others …
Org Outcomes
Outputs
Products/Services
Actions
Impacts
But how do we measure our
performance, our accountability? Can
resources be coordinated and targeted
more effectively? Donor accountability?
Normalization
Defining and creating a scorecard
Suites of
indicators
Weights
Synthesis
Aggregation
Scores 1. Country scorecards • Measuring country performance
• food security
• gender biases
• agricultural productivity
• …
• Measuring country capacity and
commitment
• Measuring the business climate in
agriculture
• …
Dimension 1
Indicator 1
…
Indicator n
2. Donor scorecards • Measuring donor performance
• food security
• gender biases
• agricultural productivity
• …
• Coordinating donor efforts
3. Corporate “Doer”
scorecards • Measuring doer performance
• food security
• gender biases
• agricultural productivity
• …
• Coordinating Doer efforts
• …
Dimension 2
Indicator 1
…
Indicator n
Dimension 3
Indicator 1
…
Indicator n
Dimension n
Indicator 1
…
Indicator n
An FAO Corporate Scorecard in the context of its Results Chain Model
Elimination of poverty through economic and social progress
Global Goals
Reduction of hunger and malnutrition
Sustainable management and utilization of natural resources
SO1: Eradicate hunger, food
insecurity and malnutrition
SO 4: Enable
more inclusive and efficient
food systems at local, national, regional and
international levels
SO 3: Improve the livelihood
of rural populations, in particular women and
youth, through enhanced
employment opportunities and increased access to
production resources
SO 5: Increase
the resilience of rural
livelihoods to threats
and crises
SO 2: Increase
production inagriculture, fisheries
andforestry in an
economic,
social and environmentally
sustainable manner
Organizational Outcomes
Organizational Outcomes
Organizational Outcomes
Organizational
OutcomesOrganizational
Outcomes
Outputs Outputs Outputs Outputs Outputs Outputs Outputs Outputs Outputs Outputs
Development outcome
indicators for monitoring progress They measure the medium-term effects
(development outcomes) to which the
Organizational Outcomes contribute.)
Organizational Outcome
indicators for monitoring the result of uptake and use of FAO outputs. OOs are the change produced of use of FAO Outputs by clients
Output indicators for monitoring FAO deliverablesOutputs are the deliverables which result from a development intervention
Activities
PEMS Individual work plans
Individual work plans contribute to activities. Examples: Paper drafted on good practices in the area of capacity development programs on nutrition.
An activity or set of activities implemented by many staff members, and are relevant for achieving Outputs. Examples: A capacity development program developed on the impact of the changes to food systems on nutrition; Guidelines developed for implementation of Capacity Development Program on […]
Results Chain Model (OSP*)
SO s
core
card
sCC
sco
reca
rds
CORP
ORA
TE S
CORE
CARD
*Adapted from “Q:\CommArea\DDK\Scorecard Workshop\Presentations\ Silborn_OSP_Results model for scorecard group.ppt”
Top Related