Successfully reported this slideshow.
The World Bank’s Involvement in GRPPs: The Current State of GRPP Evaluation               PracticeChris GerrardEvaluation ...
What are GRPPs?►Programmatic partnerships in which:   • The partners dedicate resources     (financial, technical, staff, ...
The Bank Plays Multiple Roles . . .
. . . But Is Not a Major Source of Funding
Relationship Between GRPPs, TrustFunds, and the DGF  Global and Regional Partnership Programs (shared governance)  Develop...
What Are The Programs Doing?                                  Location of the Secretariat                          In the ...
How Much Money Are They Spending?(Millions of U.S. Dollars)                                   Location of Secretariat     ...
GRPPs Are Concentratedin a Few Sectors . . .
. . . And a Few Vice Presidencies
GRPPs Challenge the Bank’s Country-Based Model►They challenge the Bank’s traditional financial accoun- tability mechanisms...
GRPPs Present Challenges for Evaluation►Programs have shared governance and accountability for results – to achieve someth...
There Is a Clear Trend Toward StakeholderModels of Governance                       Inter-                                ...
Most Programs Have Been Evaluated, ButTransparency & Accessibility Have Been Weak►Of the 93 programs that are five years o...
Independence, Quality and Impacts –Based on 20 GRPPs Reviewed since 2006                                         Location ...
Evaluation Independence►14 of 20 evaluations were effectively independent throughout the evaluation process:   • Organizat...
Evaluation Quality►The quality of the evaluations was satisfactory in 8 of 20 cases in terms of evaluation scope, design, ...
Evaluation Impacts on the Programs►Evaluations have had notable impacts on the programs.►Most common impacts have been:   ...
Thank Youwww.globalevalutions.org
Upcoming SlideShare
Loading in …5
×

The World Bank’s Involvement in GRPPs: The Current State of GRPP Evaluation Practice (2011 Evaluation Week)

683 views

Published on

Presentation at the 2011 Evaluation Week

  • Be the first to comment

  • Be the first to like this

The World Bank’s Involvement in GRPPs: The Current State of GRPP Evaluation Practice (2011 Evaluation Week)

  1. 1. The World Bank’s Involvement in GRPPs: The Current State of GRPP Evaluation PracticeChris GerrardEvaluation WeekOctober 24, 2011
  2. 2. What are GRPPs?►Programmatic partnerships in which: • The partners dedicate resources (financial, technical, staff, reputational, etc.) toward achieving agreed objectives over time. • The activities of the program are global, regional, or multi- country (not single country) in scope. • The partners establish a new organization with shared governance and a management unit to deliver these activities.►40 percent are located in the Bank, 35 percent in other international/partner organizations, and 25 percent are free-standing independent legal entities.
  3. 3. The Bank Plays Multiple Roles . . .
  4. 4. . . . But Is Not a Major Source of Funding
  5. 5. Relationship Between GRPPs, TrustFunds, and the DGF Global and Regional Partnership Programs (shared governance) Development Grant Facility Bank-Administered Trust Funds
  6. 6. What Are The Programs Doing? Location of the Secretariat In the In Another Independent Principal Activities World Bank Partner Legal Entity Total Knowledge Networks 11 31 11 53 Technical Assistance For NPGs 20 4 6 30 For GPGs/RPGs 1 1 2 Financing Country-Level Investments For NPGs 3 3 For GPGs/RPGs 13 3 6 22 Financing Global 1 2 4 7 Investments for GPGs Total 48 41 28 117
  7. 7. How Much Money Are They Spending?(Millions of U.S. Dollars) Location of Secretariat In the In Another Independent Principal Activities World Bank Partner Legal Entity Total Knowledge Networks 52 68 52 171 Technical Assistance For NPGs 184 3 94 282 For GPGs/RPGs 14 241 255 Financing Country- Level Investments For NPGs 291 218 For GPGs/RPGs 970 124 4,045 5,139 Financing Global 580 66 180 826 Investments for GPGs Total 2,077 274 4,612 6,963
  8. 8. GRPPs Are Concentratedin a Few Sectors . . .
  9. 9. . . . And a Few Vice Presidencies
  10. 10. GRPPs Challenge the Bank’s Country-Based Model►They challenge the Bank’s traditional financial accoun- tability mechanisms. Their legal and governance arrange- ments do not always confer clarity on how collective responsibility for results is supposed to work in practice.►Bank is dedicating more and more senior management time to the governance of these programs.►Bank expects programs’ activities to be linked to the Bank’s country operations. But the way in which GRPPs plan their activities is different from the way in which country teams plan theirs.
  11. 11. GRPPs Present Challenges for Evaluation►Programs have shared governance and accountability for results – to achieve something collectively that individual partners could not achieve by acting alone.►Programs evolve over time – do not usually have a fixed end-point.►Programs operate at multiple levels – global, regional, national, and local.►Programs are diverse in size, age, sectoral focus, objectives, and activities (knowledge, technical assistance, investments).
  12. 12. There Is a Clear Trend Toward StakeholderModels of Governance Inter- Low- and Civil Commer- national/ Private No. of Donor middle- society cial regional foun- programs countries income organi- private organi- dations countries zations sector zations Share- 24 holder 24 17 5 2 1 models (WB 24) Stake- 72 holder 90 62 22 55 49 27 models (WB 60) 96 Total 114 79 27 55 51 29 (WB 84)
  13. 13. Most Programs Have Been Evaluated, ButTransparency & Accessibility Have Been Weak►Of the 93 programs that are five years older or more, 77 have had evaluations.►However, only 30 evaluation reports have been posted on the programs’ external Web sites and only 12 programs have posted a “management response” to the evaluation.►By way of comparison, 57 programs have posted their charters on their external Web sites.
  14. 14. Independence, Quality and Impacts –Based on 20 GRPPs Reviewed since 2006 Location of the Secretariat In the In Another Partner Independent LegalPrincipal Activities World Bank Organization EntityKnowledge, CGAP ADEA (AfDB) GDN (New Delhi)advocacy & IAASTD GISP (CABI-Nairobi) GFHR (Geneva)standard-setting MAPS ILC (IFAD) GWP (Stockholm)networks PARIS21 (OECD) ProVention (IFRC)Providing country- Cities Alliancelevel technical MDTF-EITIassistance PRHCBP TFSCBFinancing CEPF (CI) Development Gatewayinvestments Stop TB (WHO) (Washington, DC)(global or Global Fund (Geneva)country-level) MMV (Geneva)
  15. 15. Evaluation Independence►14 of 20 evaluations were effectively independent throughout the evaluation process: • Organizationally and behaviorally independent of program management • Protected from outside interference • Avoided conflicts of interests►Independence of 2 evaluations was compromised during one stage of the evaluation process: commissioning, team selection, oversight, or review►Independence of 4 evaluations was compromised at more than one stage
  16. 16. Evaluation Quality►The quality of the evaluations was satisfactory in 8 of 20 cases in terms of evaluation scope, design, methods, and feedback►The evaluations had moderate shortcomings in 9 cases, and significant shortcomings in 3 cases►Most common issues adversely affecting quality were: • An unclear terms of reference • Insufficient budget and time • Weak M&E frameworks for the program • Lax evaluation methodology and tools
  17. 17. Evaluation Impacts on the Programs►Evaluations have had notable impacts on the programs.►Most common impacts have been: • Half the programs modified their governance arrangements in some way, such as establishing an executive committee. • Almost half the programs revised their strategies. • About one-quarter improved their M&E systems.
  18. 18. Thank Youwww.globalevalutions.org

×