Preliminary Findings of the 2018
OECD Performance Budgeting
Survey in PEMPAL Countries
Public Expenditure Management Peer Assisted Learning (PEMPAL) Network
Budget Community of Practice (BCOP)
Program and Performance Budgeting Working Group (PPBWG)
Naida Carsimamovic, BCOP Resource Team, World Bank
Nikolay Begchin, PPBWG Lead, Ministry of Finance of the Russian Federation
November 2018 1
PRESENTATION OVERVIEW
1. ABOUT PEMPAL AND ITS BUDGET COMMUNITY OF
PRACTICE (BCOP)
2. PEMPAL-OECD COLLABORATION
3. PEMPAL COUNTRIES’ SURVEY RESULTS ON
PERFORMANCE BUDGETING (PB)
4. PEMPAL COUNTRIES’ SURVEY RESULTS ON
SPENDING REVIEWS
2
About PEMPAL
3
Aims to promote and facilitate
efficient and effective use of
public funds resulting from
applying good PFM practices
through supporting a peer
learning and knowledge exchange
platform for practitioners to
connect within three
‘Communities of Practice’ -
budget, treasury, and internal
audit.
PEMPAL’S Budget Community of Practice (BCOP)
4
Aims to strengthen budget methodology,
planning, and transparency in member
countries. 2017-2021 priorities:
1. sharpening tools for effective fiscal
management with primary focus on
performance and program budgeting
2. strengthening fiscal transparency and
accountability with focus on budget
literacy, transparency, and public
participation initiatives
3. expanding internationally available
data on PEMPAL countries through
identification and sharing of budget-
related good practices and
benchmarking within and outside of
the PEMPAL region
PEMPAL’S Collaboration with OECD
• A long-standing valuable relationship, primarily through BCOP’s participation
in the meetings of the OECD Senior Budget Officials’ Network for Central,
Eastern, and South-Eastern European countries (CESEE)
• Moreover, work of the OECD Performance and Results Network is an
important content source for the work of PPBWG
• PPBWG facilitated PEMPAL’s participation in the OECD Performance
Budgeting (PB) Survey in 2016 and 2018
• Participation in the Survey contributes to the WG’s objectives by:
 providing data on status of program and performance budgeting reforms
in PEMPAL countries
 providing opportunity for PEMPAL countries to benchmark their
progress against the OECD countries
 providing information on newest trends and best practices
5
Data on PEMPAL Countries in 2018 OECD
Performance Budgeting Survey
• 14 PEMPAL countries filled out the survey:
 Armenia, Belarus, Bosnia and
Herzegovina, Bulgaria, Croatia, Georgia,
Kazakhstan, Kosovo, Kyrgyz Republic,
Moldova, Russia, Serbia, Ukraine, and
Uzbekistan
• Same countries also filled out the 2016
survey, with the exception of Kazakhstan,
thus offering for the first time a possibility
of capturing trends over time in PEMPAL
countries
• Survey results are based on PEMPAL
countries’ own self-assessment, no data
cleaning/verification was conducted
6
• Compulsory frameworks for all in almost all PEMPAL countries
• Wider and more uniform coverage of frameworks in PEMPAL countries
compared to OECD countries, as in 2016
• Trend of increase in uniformity and coverage in OECD countries
Performance Budgeting Frameworks
7
• Various types in both PEMPAL and OECD, but
none with direct performance budgeting
• Most frequently PEMPAL countries describe
their practices as a presentational approach,
compared to performance-informed
approach in OECD countries
Regulatory Basis & Types of Performance Budgeting
• In organic budget law for
almost all PEMPAL countries
(2/3 in OECD)
• Also in
regulations/instructions for
budget preparation for most
• No separate law in any
PEMPAL country
8
• In both OECD and PEMPAL countries, targets most frequently set by the line
ministries/agencies
• More frequent role of Chief Executive and Ministry of Economy/Planning in
PEMPAL than in OECD countries and somewhat decreasing role of CBA in both
Responsibility for Setting Performance Targets
9
• Mixed trends on number of programs and indicators in both OECD and PEMPAL
countries, with somewhat more frequent trend on decrease in number of
indicators in PEMPAL countries
• Also mixed trends in usage of performance information, with somewhat more
frequent trend of increased usage by program managers, ministers/senior civil
servants, and especially parliament in OECD countries
Trends in Volume and Use of Performance Information
10
PEMPAL COUNTRIES
• In both OCED and PEMPAL
countries, operational data most
frequently used in budget
negotiations
• Notably less frequent use of
evaluations, spending reviews,
and independent performance
information in PEMPAL countries
• Trend in increase of use of
spending reviews in OECD
countries, less so in PEMPAL
countries
Information Used in Budget Negotiation and
Change in Budgetary Management
11
• Transparency of program
objectives is the most improved
aspect of budgetary management
resulting from performance
budgeting (PB) practices in both
PEMPAL and OECD
• Notably more positive impact in
legal and financial compliance
cited by PEMPAL countries
Accountability and transparency as the key motivation factors and key benefits, however
expectations were higher in PEMPAL countries for other factors
Factors Behind Introducing PB and Effectiveness
12
PEMPAL COUNTRIES
OECD COUNTRIES
• Consequences are not a norm
• Among different types of consequences,
management responses to poor
performance more likely than
budgetary consequences
• Some increase in frequency of negative
consequence on program leaders and
for making poor performance public
• Less than half estimate quantifiable
contribution of PB to improved quality
of public finances, but almost all cite
unquantifiable benefits (slight increase
since 2016)
Consequences of Missing Performance Targets
and PB’s Contribution to Quality of Public Finances
13
• Challenges overall perceived as greater in PEMPAL countries, in particular those
associated with the earlier stages of PB implementation
• Compared to 2016, PEMPAL countries more aware of challenges related to
leadership/commitment and formulation of indicators/targets
Main Challenges to Implementation of PB
14
• Cross-cutting indicators less
frequent in PEMPAL countries
• Gender not systematically integrated
in any PEMPAL country and trust in
government rarely measured
• As in OECD countries, in most
PEMPAL countries, responsibility for
SDGs is in President/PM Offices
• SDGs significantly less aligned with
national frameworks in PEMPAL
• In almost all PEMPAL countries, no
budget reporting related to SDGs
Cross-Cutting Indicators in Budget and SDGs
15
PEMPAL COUNTRIES
OECD COUNTRIES
• Spending reviews are expected to be in focus in the upcoming period
• Currently not as frequent compared to OECD, and criteria less rigorous
• Where exist, mostly no established guidelines and narrow
• The main result of spending reviews, where conducted, were spending
reallocation, more so than spending cuts
• All challenges greater in PEMPAL countries, especially capacity, political
support, and ICT challenges
Spending Reviews
16
Thank you for your attention!
For more information on PEMPAL,
see report PEMPAL IN 2012-2017
17

International trends in performance budgeting - Naida Carsimamovic, World Bank and Nikolay Begchin, Russian Federation

  • 1.
    Preliminary Findings ofthe 2018 OECD Performance Budgeting Survey in PEMPAL Countries Public Expenditure Management Peer Assisted Learning (PEMPAL) Network Budget Community of Practice (BCOP) Program and Performance Budgeting Working Group (PPBWG) Naida Carsimamovic, BCOP Resource Team, World Bank Nikolay Begchin, PPBWG Lead, Ministry of Finance of the Russian Federation November 2018 1
  • 2.
    PRESENTATION OVERVIEW 1. ABOUTPEMPAL AND ITS BUDGET COMMUNITY OF PRACTICE (BCOP) 2. PEMPAL-OECD COLLABORATION 3. PEMPAL COUNTRIES’ SURVEY RESULTS ON PERFORMANCE BUDGETING (PB) 4. PEMPAL COUNTRIES’ SURVEY RESULTS ON SPENDING REVIEWS 2
  • 3.
    About PEMPAL 3 Aims topromote and facilitate efficient and effective use of public funds resulting from applying good PFM practices through supporting a peer learning and knowledge exchange platform for practitioners to connect within three ‘Communities of Practice’ - budget, treasury, and internal audit.
  • 4.
    PEMPAL’S Budget Communityof Practice (BCOP) 4 Aims to strengthen budget methodology, planning, and transparency in member countries. 2017-2021 priorities: 1. sharpening tools for effective fiscal management with primary focus on performance and program budgeting 2. strengthening fiscal transparency and accountability with focus on budget literacy, transparency, and public participation initiatives 3. expanding internationally available data on PEMPAL countries through identification and sharing of budget- related good practices and benchmarking within and outside of the PEMPAL region
  • 5.
    PEMPAL’S Collaboration withOECD • A long-standing valuable relationship, primarily through BCOP’s participation in the meetings of the OECD Senior Budget Officials’ Network for Central, Eastern, and South-Eastern European countries (CESEE) • Moreover, work of the OECD Performance and Results Network is an important content source for the work of PPBWG • PPBWG facilitated PEMPAL’s participation in the OECD Performance Budgeting (PB) Survey in 2016 and 2018 • Participation in the Survey contributes to the WG’s objectives by:  providing data on status of program and performance budgeting reforms in PEMPAL countries  providing opportunity for PEMPAL countries to benchmark their progress against the OECD countries  providing information on newest trends and best practices 5
  • 6.
    Data on PEMPALCountries in 2018 OECD Performance Budgeting Survey • 14 PEMPAL countries filled out the survey:  Armenia, Belarus, Bosnia and Herzegovina, Bulgaria, Croatia, Georgia, Kazakhstan, Kosovo, Kyrgyz Republic, Moldova, Russia, Serbia, Ukraine, and Uzbekistan • Same countries also filled out the 2016 survey, with the exception of Kazakhstan, thus offering for the first time a possibility of capturing trends over time in PEMPAL countries • Survey results are based on PEMPAL countries’ own self-assessment, no data cleaning/verification was conducted 6
  • 7.
    • Compulsory frameworksfor all in almost all PEMPAL countries • Wider and more uniform coverage of frameworks in PEMPAL countries compared to OECD countries, as in 2016 • Trend of increase in uniformity and coverage in OECD countries Performance Budgeting Frameworks 7
  • 8.
    • Various typesin both PEMPAL and OECD, but none with direct performance budgeting • Most frequently PEMPAL countries describe their practices as a presentational approach, compared to performance-informed approach in OECD countries Regulatory Basis & Types of Performance Budgeting • In organic budget law for almost all PEMPAL countries (2/3 in OECD) • Also in regulations/instructions for budget preparation for most • No separate law in any PEMPAL country 8
  • 9.
    • In bothOECD and PEMPAL countries, targets most frequently set by the line ministries/agencies • More frequent role of Chief Executive and Ministry of Economy/Planning in PEMPAL than in OECD countries and somewhat decreasing role of CBA in both Responsibility for Setting Performance Targets 9
  • 10.
    • Mixed trendson number of programs and indicators in both OECD and PEMPAL countries, with somewhat more frequent trend on decrease in number of indicators in PEMPAL countries • Also mixed trends in usage of performance information, with somewhat more frequent trend of increased usage by program managers, ministers/senior civil servants, and especially parliament in OECD countries Trends in Volume and Use of Performance Information 10 PEMPAL COUNTRIES
  • 11.
    • In bothOCED and PEMPAL countries, operational data most frequently used in budget negotiations • Notably less frequent use of evaluations, spending reviews, and independent performance information in PEMPAL countries • Trend in increase of use of spending reviews in OECD countries, less so in PEMPAL countries Information Used in Budget Negotiation and Change in Budgetary Management 11 • Transparency of program objectives is the most improved aspect of budgetary management resulting from performance budgeting (PB) practices in both PEMPAL and OECD • Notably more positive impact in legal and financial compliance cited by PEMPAL countries
  • 12.
    Accountability and transparencyas the key motivation factors and key benefits, however expectations were higher in PEMPAL countries for other factors Factors Behind Introducing PB and Effectiveness 12 PEMPAL COUNTRIES OECD COUNTRIES
  • 13.
    • Consequences arenot a norm • Among different types of consequences, management responses to poor performance more likely than budgetary consequences • Some increase in frequency of negative consequence on program leaders and for making poor performance public • Less than half estimate quantifiable contribution of PB to improved quality of public finances, but almost all cite unquantifiable benefits (slight increase since 2016) Consequences of Missing Performance Targets and PB’s Contribution to Quality of Public Finances 13
  • 14.
    • Challenges overallperceived as greater in PEMPAL countries, in particular those associated with the earlier stages of PB implementation • Compared to 2016, PEMPAL countries more aware of challenges related to leadership/commitment and formulation of indicators/targets Main Challenges to Implementation of PB 14
  • 15.
    • Cross-cutting indicatorsless frequent in PEMPAL countries • Gender not systematically integrated in any PEMPAL country and trust in government rarely measured • As in OECD countries, in most PEMPAL countries, responsibility for SDGs is in President/PM Offices • SDGs significantly less aligned with national frameworks in PEMPAL • In almost all PEMPAL countries, no budget reporting related to SDGs Cross-Cutting Indicators in Budget and SDGs 15 PEMPAL COUNTRIES OECD COUNTRIES
  • 16.
    • Spending reviewsare expected to be in focus in the upcoming period • Currently not as frequent compared to OECD, and criteria less rigorous • Where exist, mostly no established guidelines and narrow • The main result of spending reviews, where conducted, were spending reallocation, more so than spending cuts • All challenges greater in PEMPAL countries, especially capacity, political support, and ICT challenges Spending Reviews 16
  • 17.
    Thank you foryour attention! For more information on PEMPAL, see report PEMPAL IN 2012-2017 17