Evaluation Community of Practice
3rd Annual Meeting 2015
Report from IEA
Independent Evaluation
Arrangement
IEA – Reviews & Evaluations
2reviews
completed
CRP Governance
& Management
Generation
Challenge
Program
5CRP evaluations
completed
Policies, Institutions
& Markets
Aquatic Agriculture
Systems
WHEAT
MAIZE
Forests Trees and
Agroforestry
5CRP evaluations
being finalized
Climate Change,
Agriculture & Food
Security
Global Rice Science
Partnerships
Livestock & Fish
Roots, Tubers
and Bananas
Water, Land &
Ecosystems
5CRP-
commissioned
evaluations with IEA
QA advice
Humidtropics
A4NH -
completed
Grainlegumes
Dryland
Cereals
Dryland
Systems
Other completed CGIAR Evaluations 2013-15
CRPs/Centers
• 1 CRP evaluation + quality assistance/validation
from IEA
• 3 CRPs commissioned CCEEs using IEA guidance
(1 with IEA QA advice and support)
• 2 Center commissioned CCERs
IEA
IEA CRP Evaluations completed
Full CRP
Evaluation
CCEE
For Whom/ What Purpose?
CRP Management
• Learning for strategic management and
adaptations and adjustments of
program
• Preparation: 2nd cycle of CRP proposals
System-wide
• System wide strategic management
(MTR, SRF, 2nd call for funding)
• Resource for system-wide evaluation
Donors
• Accountability on program performance
• Building trust and transparency
• Strategic and informed decisions on
portfolio and funding allocations
Partners
• Build trust and transparency
• Accountability on partnership and
program performance
• Refinement of partnership
Evaluation
Responses to IEA CRP evaluations
5 CRP evaluations finalized = 59 recommendations
Management response
– Overall comments on the evaluation and its utility
– 49 recommendations accepted fully, 9 partially accepted
– Of 8 M&G recommendations, 3 accepted fully, 1 rejected
– Response to individual recommendations, including action
proposed and responsibilities
Consortium response
– Accepting all 59 recommendations, including those relating to
Consortium and System
– Requests recommendations and changes be reflected in
CRPII stage
IEA
Preliminary
findings
Draft
report Final report
Circulated
for review
and
comments
FC
workshop
CO/CB
response
EIAC
discussion FC decision on
report and CB
commentary
Timeline
Shared with
CRP mgmt,
Reference
Group…
Analysis
CRP level
System
level
For ongoing
evaluations:
shared with
CO, ISPC, IAU
CRP mgmt
response to
evaluation
Interactions
with CRP
staff
Final
evaluation
package
(report +++)
Contribution of evaluations to CRPII
formulation and Review process
Synthesis of First Five completed Evaluations:
FTA, WHEAT, MAIZE, AAS and PIM
Purposes: Accountability and Learning
1. Results
- Patterns related to the results of the CRP evaluations;
- Draw lessons that can be useful for the CGIAR as a whole in view
of CRP II
2. Methodological aspects
- Lessons from processes and methodologies used in the
evaluation for the future (internal)
- First go in view of the synthesis of 15 evaluations planned in 2016
Other IEA Initiatives and Events
end of 2015
• Reflecting on accountability and learning
framework
– M,E, and IA framework
– Reviewing decentralized evaluation options
• Reflecting on experience so far on evaluating QoS
– Internal Workshop early December
• Reflecting on evaluability of Sustainable
Development Goals
– RBA SDG2 Seminar (17-18 November, Rome)
Looking beyond
- New SRF with an accountability and learning
framework
- New CGIAR governance
-New CRP proposal phase
-New Rolling Evaluation Work Plan and Strategy
Work plan 2016
Evaluations
Thematic evaluations
- Gender
- Partnerships
- Capacity development
CRP evaluation
- CRP Genebanks
Synthesis of 15 CRP evaluations
- Preparing for 2017
Other
- Coordinated plan for evaluation for CRPII
- Action plan for supporting decentralized evaluations and
strengthening evaluation across the CGIAR
- Mapping evaluation coverage in CGIAR
- Developing new Rolling Evaluation Work Plan 2017-2020
THANK YOU

Evaluation use, learning, and influence

  • 1.
    Evaluation Community ofPractice 3rd Annual Meeting 2015 Report from IEA Independent Evaluation Arrangement
  • 2.
    IEA – Reviews& Evaluations 2reviews completed CRP Governance & Management Generation Challenge Program 5CRP evaluations completed Policies, Institutions & Markets Aquatic Agriculture Systems WHEAT MAIZE Forests Trees and Agroforestry 5CRP evaluations being finalized Climate Change, Agriculture & Food Security Global Rice Science Partnerships Livestock & Fish Roots, Tubers and Bananas Water, Land & Ecosystems 5CRP- commissioned evaluations with IEA QA advice Humidtropics A4NH - completed Grainlegumes Dryland Cereals Dryland Systems
  • 3.
    Other completed CGIAREvaluations 2013-15 CRPs/Centers • 1 CRP evaluation + quality assistance/validation from IEA • 3 CRPs commissioned CCEEs using IEA guidance (1 with IEA QA advice and support) • 2 Center commissioned CCERs IEA
  • 4.
    IEA CRP Evaluationscompleted Full CRP Evaluation CCEE
  • 5.
    For Whom/ WhatPurpose? CRP Management • Learning for strategic management and adaptations and adjustments of program • Preparation: 2nd cycle of CRP proposals System-wide • System wide strategic management (MTR, SRF, 2nd call for funding) • Resource for system-wide evaluation Donors • Accountability on program performance • Building trust and transparency • Strategic and informed decisions on portfolio and funding allocations Partners • Build trust and transparency • Accountability on partnership and program performance • Refinement of partnership Evaluation
  • 6.
    Responses to IEACRP evaluations 5 CRP evaluations finalized = 59 recommendations Management response – Overall comments on the evaluation and its utility – 49 recommendations accepted fully, 9 partially accepted – Of 8 M&G recommendations, 3 accepted fully, 1 rejected – Response to individual recommendations, including action proposed and responsibilities Consortium response – Accepting all 59 recommendations, including those relating to Consortium and System – Requests recommendations and changes be reflected in CRPII stage IEA
  • 7.
    Preliminary findings Draft report Final report Circulated forreview and comments FC workshop CO/CB response EIAC discussion FC decision on report and CB commentary Timeline Shared with CRP mgmt, Reference Group… Analysis CRP level System level For ongoing evaluations: shared with CO, ISPC, IAU CRP mgmt response to evaluation Interactions with CRP staff Final evaluation package (report +++) Contribution of evaluations to CRPII formulation and Review process
  • 8.
    Synthesis of FirstFive completed Evaluations: FTA, WHEAT, MAIZE, AAS and PIM Purposes: Accountability and Learning 1. Results - Patterns related to the results of the CRP evaluations; - Draw lessons that can be useful for the CGIAR as a whole in view of CRP II 2. Methodological aspects - Lessons from processes and methodologies used in the evaluation for the future (internal) - First go in view of the synthesis of 15 evaluations planned in 2016
  • 9.
    Other IEA Initiativesand Events end of 2015 • Reflecting on accountability and learning framework – M,E, and IA framework – Reviewing decentralized evaluation options • Reflecting on experience so far on evaluating QoS – Internal Workshop early December • Reflecting on evaluability of Sustainable Development Goals – RBA SDG2 Seminar (17-18 November, Rome)
  • 10.
    Looking beyond - NewSRF with an accountability and learning framework - New CGIAR governance -New CRP proposal phase -New Rolling Evaluation Work Plan and Strategy
  • 11.
    Work plan 2016 Evaluations Thematicevaluations - Gender - Partnerships - Capacity development CRP evaluation - CRP Genebanks Synthesis of 15 CRP evaluations - Preparing for 2017 Other - Coordinated plan for evaluation for CRPII - Action plan for supporting decentralized evaluations and strengthening evaluation across the CGIAR - Mapping evaluation coverage in CGIAR - Developing new Rolling Evaluation Work Plan 2017-2020
  • 12.