Independent Evaluation ArrangementCRP evaluations: Intro and brief on scope, methodology, and team profiles

PIM, WHEAT, MAIZE, AAS

Rachel Bedouin

April 2015

IEA – Reviews & Evaluations2 reviews completed

CRP Governance & Management

Generation Challenge Program

5 CRP evaluations finalized

Forests, Trees & Agroforestry

Policies, Institutions & Markets

Aquatic Agriculture Systems

WHEAT

MAIZE

5 CRP evaluations ongoing

Climate Change, Agriculture & Food

Security

Global Rice Science Partnerships

Livestock & Fish

Roots, Tubers and Bananas

Water, Land and Ecosystems

5 CRP- commissioned

evaluations with IEA QA

support

Humidtropics

A4NH

Grainlegumes

Dryland Cereals

Dryland Systems

CRP Evaluations Current Status Final Evaluation Report

Responses

CRP Mgmt Consortium

PIM Finalized April 2015 April 2015 May 2015AAS Finalized April 2015 April 2015 May 2015Maize Finalized April 2015 April 2015 May 2015Wheat Finalized April 2015 April 2015 May 2015Synthesis of first 5 CRP evaluations July 2015CCAFS Inquiry phase Nov 2015 Dec 2015 Jan 2016 RTB Inquiry phase Dec 2015 Jan 2016 Feb 2016WLE Inquiry phase Dec 2015 Jan 2016 Feb 2016GRiSP Inquiry phase Oct 2015 Nov 2015 Dec 2015Livestock and Fish Inquiry phase Dec 2015 Jan 2016 Feb 2016CRP Commissioned Evaluations (IEA QA support) CRP Mgmt QA Review (IEA)A4NH Inquiry phase July 2015 Oct 2015 Feb 2016

Dryland Systems Start-up phase Oct 2015 Dec 2015 Feb 2016Dryland Cereals Start-up phase Dec 2015 Feb 2016 Feb 2016GrainLegumes Start-up phase Dec 2015 Feb 2016 Feb 2016Humidtropics Start-up phase Nov 2015 Dec 2015 Feb 2016Synthesis of all 15 CRP evaluations April 2016

For Whom/ What Purpose?

CRP Management • Learning for strategic management and

adaptations and adjustments of program

• Preparation: 2nd cycle of CRP proposals

System-wide• System wide strategic management

(MTR, SRF, 2nd call for funding) • Resource for system-wide evaluation

Donors• Accountability on program performance• Building trust and transparency• Strategic and informed decisions on

portfolio and funding allocations

Partners • Build trust and transparency • Accountability on partnership and

program performance• Refinement of partnership

Evaluation

Evaluation Criteria

Relevance

EfficiencyQuality of

Science

EffectivenessImpact and sustainability

Gender, Partnerships, and

Capacity Development

Special attention to:

Programmatic Aspects within evaluation criteria

• Research and development challenges• Coherence of design and portfolio alignment• Quality of Science• Comparative Advantage • Progress against commitments / likelihood of outcomes• Evidence of impacts from past research • Partnerships for effectiveness• Theory of Change

Methodology – common elementsUse of series of data collection and analysis, and the triangulation of evidence collected from different sources, including: • desk review of key program documents; • reviews of previous relevant evaluations/impact assessments; • interviews of CGIAR staff involved with the program, external

partners, and professional peers; • portfolio analysis of CRP-supported research activities; • electronic surveys of CGIAR staff and external partners; • Qualitative and quantitative methods for Quality of Science analysis• Bibliometric analysis of CRP publications• Case-studies = legacy projects/ hubs/ modeling • Site and center visits by core team members

Evaluation Team Leaders

- Selection of experts with extensive knowledge and background in agriculture (incl. CGIAR) and evaluation

- Senior evaluation expertise, including reviewing/ evaluating agricultural research

- Subject matter specialists in agricultural sciences and research, including: breeding, genetics, socio-economic issues in agricultural development, natural resources, agricultural policy and institutional reform, food and rural development

• Expertise in evaluation and research review

• Evaluation team members are selected to cover essential expertise in agricultural research and development, partnerships, research management, and governance relevant to each CRP.

Evaluation Team Members

• Expert evaluator including Global Programs Coordinator in the Independent Evaluation Group (IEG), World Bank.

• Prepared the IEG/DAC Sourcebook for Evaluating Global and Regional Partnership Programs (GRPPs), and led the preparation of in-depth reviews of 25 partnership programs, and evaluation team member of the meta-evaluation of the CGIAR.

• Led an external training program of the World Bank Institute on agricultural policy and institutional reform.

Christopher Gerrard

CRP PIM Evaluation

Team Leader

Main competencies of Evaluation Team: environmental policy issues,  agricultural supply chains, agricultural marketing and agricultural value chain management, gender, rural policy, commodity market analysis, and transition economics, research management and governance

• PhD in plant breeding and genetics• 10 years experience in reviews of research, including

CSIRO Flagship program reviews and 2007 mid-term review of the Generation Challenge Program.

• 10 years experience in the private seed sector, including positions as Head of Novartis Seed world-wide R&D, Head of Syngenta Plant Science and Vice President for Syngenta Biotechnology.

Wallace BeversdorfWHEAT

CRP WHEAT Evaluation

Main competencies of Evaluation Team: Plant breeding and genomics, natural resource management and agronomy, social science and impact, partnerships and delivery, research management and governance

• Economist and PhD agricultural sciences• Served as Deputy Executive Secretary of the CGIAR –TAC

(currently known as ISPC), and Executive Secretary of the CGIAR's Impact Assessment and Evaluation Group , and as Chairman of the Board of Trustees of ICARDA

• Director General of a major research institute on Africa in both the human and natural sciencesGuido Gryseels

MAIZE

CRP MAIZE Evaluation

Main competencies of Evaluation Team: Plant breeding and genomics, natural resource management and agronomy, social science and impact, partnerships and delivery, research management and governance

PhD Rural Development, Chair of Social and Institutional Change in Agricultural Development at the U. of Hohenheim

20 years of experience in development-oriented agricultural research, and core author team of the World Development Report on “Agriculture for Development”

Research focus: socio-economic issues in agricultural development, participatory research, institutions, knowledge and innovation, and gender

PhD, Cornell University on Plant Breeding and Animal Nutrition

Research Fellow, Knowledge, Technology and Society Team, Institute of Development Studies (IDS) at University of Sussex

Evaluation expertise of agriculture and natural resource management projects

Over 25 years of experience of research on small-scale agriculture, natural resource management, agricultural research policy, and food and rural development

Regina Birner

Jim Sumberg

CRP AAS Evaluation – Team Leaders

Main competencies of Evaluation Team: Farming systems, research and aquaculture, social science and innovation, gender, participatory action research, research management and governance

CRP AAS Evaluation – Team Members