SlideShare a Scribd company logo
1 of 31
Download to read offline
Evaluation of the Health
Pooled Fund
(HPF-III)
Asrade Abate, MD, MSc
September, 2016
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
2 | P a g e
Table of Contents
Executive Summary .............................................................................................................................4
Background ..............................................................................................................................................6
Objective s ................................................................................................................................................7
Methodo logy ...........................................................................................................................................8
Results .....................................................................................................................................................10
1.1. PARTICIPATION & DISBURSEMENT..................................................................................................10
1.2. DESIGN of HPF..................................................................................................................................12
1.3. PLAN, REQUEST & APPROVAL..........................................................................................................12
1.4. FUND UTILIZATION...........................................................................................................................13
1.4.1. System strengthening ...................................................................................................................14
1.4.2. Technical Assistance .....................................................................................................................14
1.4.3. Service Delivery.............................................................................................................................15
1.5. FUND ADMINISTRATION..................................................................................................................16
1.6. MONITORING AND EVALUATION.....................................................................................................17
Recommendations ..............................................................................................................................19
ANNEX I - References .......................................................................................................................21
ANNEX II – Que stionnaire-1 ..........................................................................................................22
ANNEX II – Que stionnaire-2 ..........................................................................................................24
ANNEX III – Memorandum of Understanding........................................................................25
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
3 | P a g e
Acronyms
ADC Austrian Development Cooperation
APR Annual Performance Report
ARM Annual Review Meeting
CSA Central Statistical Agency
DCI Development Cooperation of Ireland
DFID Department for International Development
DP Development Partner
EFY Ethiopian Fiscal Year
EPHI Ethiopian Public Health Institution
ETB Ethiopian Birr
FMHACA Food, Medicine and Healthcare Administration and Control Authority
FMOH Federal Ministry of Health
GTP Growth and Transformation Plan
HPF Health Pooled Fund
HPN Health, Population and Nutrition
HSDP Health Sector Development Program
HSTP Health Sector Transformation Plan
IC Italian Cooperation
IHP International Health Partnership
JCCC Joint Core Coordinating Committee
JRM Joint Review Mission
JSC Joint Steering Committee
M&E Monitoring and Evaluation
MCH Maternal and Child Health
MDG Millennium Development Goals
MDGPF Millennium Development Goals Pooled Fund
MNCH Maternal, Newborn and Child Health
MOU Memorandum of Understanding
MTR Mid-term Review
PFM Pooled Fund manager
PFSA Pharmaceutical Fund and Supply Agency
PPD Policy, Plan Directorate
RHB Regional Health Bureau
RNE Royal Netherlands Embassy
SDG Sustainable Development Goals
TAs Technical Assistants
TOR Terms of Reference
UN United Nations
UNICEF United Nations Children’s Education Fund
USD United States Dollar
WBP Woreda Based Planning
WHO World Health Organization
WrHO Woreda Health Office
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
4 | P a g e
Executive Summary
For about a decade, the Health Pooled Fund (HPF) had been supporting the implementation of HSDP II,
HSDP III, and HSDP IV HSDP in three consecutive cycles. At the outset, the Health Pooled Fund was
established to contribute to the fulfillment of the goals of the HSDP by supporting its implementation
process through flexible, time-sensitive and less cumbersome funding mechanisms. At the time of its
establishment, four development partners were involved namely: DFID, DCI, RNE, and UNICEF in July
2005 by contributing a total of 650,000 Euro.
This evaluation was carried out to assess the performance of the HPF III in supporting the
implementation of HSDP IV which lasted for four years, from 1st of July 2011 to 30th of June 2015. The
evaluation covered the period July 2011 to June 2016 and was executed in accordance with standards
and conformed to the guideline provided in the TOR. Initially, the consultant conducted desk review of
relevant documents; develop appropriate tools for key informant interviews; and also conducted field
visits relevant to the HPF-III. The data collected was analyzed using qualitative evaluation techniques
covering the Health Pooled Fund’s activities as a whole and its entire operations. In this regard, this
evaluation ascertained that design of the fund was fairly consistent with development strategy of
stakeholders; the fund was logically flexible to finance the implementation of complex tasks relevant to
HSDP; and representation by key DPs in the country was acceptable, but only a few members
participated: Department for International Development, Italian Co-operation, Austrian Development
Cooperation, and USAID.
During implementation period of HPF-III, the total amount of fund inducted by all partners was
$6,246,689.90. In comparison to the preceding round of HPF (HPF-II), a decline was observed in terms of
number of contributors; and also fund absorption capacity. The average amount of fund, computed
alongside the duration of the project, was roughly comparable with the preceding round. In fact, under
normal circumstances, the HPF-III was anticipated to attract more partners and raise additional fund, or
else stand no less. The decline in the number of DPs that subscribed to the fund was lesser due to a
withdrawal action taken by previous contributors of the fund: Royal Netherlands Embassy, Development
Cooperation of Ireland, as well as UNICEF. Conversely, a new partner, USAID, joined the scheme.
In general, the benefits of HPF did commensurate with the inputs and remarkable achievements were
observed. Through this fund, several important activities were supported including financing key events
which profoundly contributed to improved outcomes and also amplifying the sector's inputs towards the
GTP. In particular, the HPF-III was supporting the implementation of activities mainly focused on system
strengthening; technical assistance; and service delivery and provision of resources for commissioning
relevant studies on key health sector issues in Ethiopia. Among the core accomplishments of the HPF
were HSS, ME, Capacity building, Planning, ARM, JSC, TA, and Operational Research. In addition, it
helped to reduce regional inequalities of health; finance key policy dialogues to strengthen the health
system through policy revision and finalization of HSTP; and supporting the Emergency Referral
Initiative.
The fund administration was flexible, swift and less cumbersome despite some challenges that imposed
difficulty for flexibility. The fund administrator (UNICEF) had a close collaboration with the FMOH and
also advised by the JCCC. The procurement of goods and services, administration of the contracts of
consultants, rental of conference venues and transportation were carried out effectively. The
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
5 | P a g e
recruitment of TAs was, however, was not fully carried out by UNICEF due to challenges in rules and
regulations related to procurement.
With regard to challenges, this evaluation unveiled significant constraints in the course of unlocking the
full potential of the fund. First and foremost, participation was low and significant contraction was
noted in the number of prevailing contributing donors which eventually lead to shrinkage of finance
availed through HPF account ensuing substantial funding gaps. Here, underlying factors implicated were
retraction of previous HPF contributors; inadequate HPF relevant advocacy work; soft activism to
convene subscription by new members; mild effort applied to increase resource mobilization from
existing members; and irregularities as well delays in disbursement to the HPF account.
On the other hand, a peculiar challenge was identified linked to fund absorption. The fund absorption
capacity showed a declining trend along consecutive rounds of HPF implementations. Collectively, all
three rounds of HPF necessitated arrangements for cost extensions resulting in stretched project
periods. In fact, stumbling upon such occurrence didn’t improve over the years as was manifested by the
performance of the HPF-III which run through recurrent cost extension and consultations with various
HPF contributors. This declining trend, in turn, instigated holdup of scheduled disbursements, expiry of
disbursed grants, call for cost extensions and rescheduling of project lifespan. Conversely, in view of the
spirit and potential capacity of the fund, availed resources were only fairly adequate to sustain the
progress of potential HSDP targets and relevant activities.
Several recommendations have been presented in this evaluation so as to improve the performance of
the fund. Among the core recommendations were updating the fund’s framework and broaden the
scope of strategic areas; in-depth review of the MOU document with attention to its details by
eliminating vague descriptions, adding more clarity and incorporating additional procedures with
detailed criteria; improving the annual preparation of plans focusing on details of activities, precise
budget allocation; strengthen the effort to conduct advocacy work and increase resource mobilization to
pull additional funds; improve fund absorption by applying a strong effort during the planning process
by incorporating passionate and invaluable HSTP objectives; hire appropriate number of staffs who will
be exclusively assigned to facilitate fund’s operations; implement a tracking mechanism, using time-
stamps placed on documents, in order to trace the overall fund request, approval and release process;
share documentation of travel reports, relevant benefits and results timely; and in-depth discussion
needs to be held with all partners regarding participation and continuity of the fund.
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
6 | P a g e
Background
Within the framework of Ethiopia’s Action Plan of Harmonization and Alignment for Aid Effectiveness,
the FMOH and the HPN Development Partners developed a Health Sector Harmonization Action Plan
which was duly integrated into the successive Health Sector Development Program (HSDP III-IV). The
establishment of a Health Pool Fund (HPF), as a means of support to the implementation process of
HSDP, was agreed upon between the FMoH and development partners as part of the measures taken to
implement the Health Sector Harmonization Action Plan.
For about a decade, the Health Pooled Fund (HPF) had been supporting the implementation of HSDP in
three consecutive cycles: HPF I, HPF II, an HPF III including the periods of cost extension. At the outset,
the Health Pooled Fund was established by four development partners namely: Development
Cooperation of Ireland (DCI), Royal Netherlands Embassy (RNE), and Department for International
Development (DFID) and UNICEF in July 2005 by contributing a total of 650,000 Euro. The first round was
implemented for about 1.5 years, (between July 2005 and December 2006); and the second round was
implemented for 3 years (between July 2007 and June 2010). The third round of the HPF, for which this
evaluation was carried out, supported the implementation of HSDP IV for four years, from 1st of July
2011 to 30th of June 2015. A summary of the rounds of HPF, implementation periods and also
contributing partners and are depicted in the following sections.
An independent evaluation have been conducted for the first and second round HPF and concluded that
funds had been used for the purpose intended and that both FMOH and Development Partners had
benefited from reduced transaction costs, flexible and swift responses for urgent needs. Based on the
positive experiences with the two phases of the HPF and taking into account the recommendations of
the evaluation, The United Kingdom, AusAID, Italian cooperation agreed to support the extension of the
Health Pooled Fund (HPF-III) into a new phase of five years (2010/11 to 2014/15) in line with the HDSP-
IV period. USAID also supported the HPF III activities with a separate grant agreement through UNICEF.
The HPF III has been implemented since July 2011. The general objective of the HPF-III is to contribute to
the fulfillment of the goals of the HSDP IV by supporting its implementation process through flexible,
time-sensitive and less cumbersome funding mechanisms, in line with the Harmonization Action Plan of
HSDP-IV and Growth and Transformation Plan (GTP I). As per the memorandum of agreement signed
between the FMOH and contributing development partners, UNICEF administering health pool fund on
behalf of the FMOH.
To this end, the FMOH and the Joint Core Coordination Committee (JCCC) agreed to evaluate and
document lessons from HPF III implementation. The JCCC gave mandate to UNICEF for issuance of
contract for a consultant to conduct an independent evaluation on the benefit of the HPF-III, whether
implementation was in line with international health partnership (IHP+) compact for aid effectiveness
and as per agreed Memorandum of Understanding, and also to provide information for future policy
decision.
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
7 | P a g e
Objectives
The objective of the evaluation was to assess whether the Health Pooled Fund served its intended
purpose; and document performances of the fund, challenges and make recommendations. The specific
objectives of the evaluation included:
 To assess the effectiveness and efficiency of HPF III in strengthening the capacity of FMOH in
planning, budgeting, monitoring and evaluation of HSDP IV.
 To assess its contribution in provision of technical assistance.
 To evaluate its contribution in strengthening the service delivery.
 To assess whether the HPF III has been implemented in line with the IHP+ compact.
 To evaluate the governance mechanism of HPF III, the decision making process and “client”
satisfaction (FMOH, HPF III administrator and development partners).
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
8 | P a g e
Methodology
The evaluation covered the period July 2011 to June 2016. The evaluation was executed in accordance
with standards and conformed to the guideline as provided in the TOR. The consultant conducted desk
review of relevant documents; developed appropriate tools conducted key informant interview; and
conducted field visits. The data collected was analyzed using qualitative evaluation techniques and in
accordance with the objectives and targets specified in the TOR. The evaluation covered the Pooled
Fund’s activities as a whole and its entire operations.
Pre-evaluation steps:
As part of the pre-evaluation activities, the following documents were reviewed:
1) Terms of reference (TOR) for the Health Pool Fund III Evaluation.
2) The Memorandum of Understanding (MOU) between DPs and the FMOH.
3) Relevant documents from Health Sector Development Plan (HSDP III and IV).
4) Health Sector Pooled Fund I and II, Final Evaluation Reports.
5) Minutes of JCCC meetings.
6) International Health Partnership (IHP+) compact for aid effectiveness.
7) Financial Statements and reports of HPF-III produced by UNICEF.
8) Annual reports on Health Pooled Fund III activities, through to June 2016.
9) Proposals of fund requests submitted to JCCC.
10) Payments policy guidelines and procurement rules and procedures.
11) Other supporting documents relevant to HSDP IV and HPFIII.
Specific tasks in relation to the preparation for data collection and analysis consisted of developing tools
to capture key aspects and interview guides for respective key interviews. During this evaluation,
interviews were conducted with key informants from various stakeholders including government, HPF
contributors, HPF administrator, JCCC members and other relevant stakeholders. A total of about 20 key
informants were interviewed and the list of interviews conducted is provided in the table below.
SN Key Informants - Institutions/ Development Partners (total of #20) Number of KIs
1 Federal Democratic Republic of Ethiopia, Ministry of Health (FMOH)
2  State Minister 1
3  FRM Directorate 1
4  Policy, Plan Directorate 1
5  HSS Directorate 1
6 Department For International Development (DFID) 1
7 Italian Co-operation(IC) 1
8 Austrian Development Cooperation (ADC) 1
9 USAID 1
10 The United Nations Children’s Fund in Ethiopia (UNICEF Ethiopia)
11  UNICEF Ethiopia Health Section Chief, and Health Specialist 1
12  UNICEF Ethiopia Health Pool Fund Administrators 3
13  UNICEF Regional Office Somali, Beninshangul Gumuz 2
14 JCCC Members and Organizations other than the HPF Donors 5
16 Client/contractor 1
Table 01: List of key-informants interviewed for this evaluation
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
9 | P a g e
For this evaluation, structured questionnaires were developed with a purpose of collecting data from
FMOH, DPs, JCCC members, stakeholders and also consultants providing technical assistance for FMOH.
The questionnaires were discussed with technical experts of UNICEF and comments obtained were
incorporated. The questionnaires were prepared to reflect the performance of the fund using a standard
qualitative evaluation approach. In general, the questionnaires constitute various performance
indicators categorized under themes including overview, coherence, relevance, efficiency, sustainability,
ownership, and potential impact of the fund. Through this approach the various achievements of the
HPF; effectiveness and efficiency; fund administration (flexibility, speed, transparency, accountability,
cumbersomeness); level of advocacy; planning, monitoring and reporting were among the major
parameters that were taken up in the process. The questionnaires are annexed with this report. All of
the questionnaires were administered by the consultant through face to face in-depth interviews and
discussions.
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
10 | P a g e
Results
In summary, the three round of HPF were implemented for about 1.5 years, (between July 2005 and
December 2006); 3 years (between July 2007 and June 2010); and 4 years (1st of July 2011 to 30th of
June 2015) respectively. The summary of rounds, implementation periods and also contributing partners
are depicted in the table below.
1.1. PARTICIPATION & DISBURSEMENT
In HPF III, a total of four DPs were able to join at the onset and contribute to the fund: Department for
International Development, Italian Co-operation, Austrian Development Cooperation, and USAID. The
first three partners signed the MOU directly with the FMOH and disbursements by these partners were
merged, as unified contribution of the HPF-III, and availed through the Health Pooled Fund account.
However, the fourth partner (USAID) joined the fund by signing a bilateral agreement with UNICEF,
delegated by FMOH and in line with the spirit, framework and clauses of the Joint MOU. Thus,
disbursements from USAID were managed separately. AusAID was able to disburse only once.
HPF
(rounds)
Period
(start)
Period
(end)
Years
Partners
(count)
Utilization
(%)
Remarks
HPF I Jul 1, 2005 Dec 30, 2006 1.5 4 85.1% with cost extension
HPF II Jul 1, 2007 Jun 30, 2010 3 6 32.9% with cost extension
HPF III Jul 1, 2011 Jun 30, 2015 4 3 34.3% with cost extension
Table 02: Duration, performance & utilizationof rounds of HPFsover a decade of implementation.
The opening disbursements for HPF-III, sum of grant contribution that corresponds to an amount of USD
$1,337,458.00, were received by the 30th
of June 2012 from DFID, AusAID and IC. During implementation
period of HPF-III, the total amount of fund inducted by these three partners was $4,106,689.90. As of
15th
of December 2015, all funds inducted by these three partners have been utilized though full
exhaustion lingered behind the HPF-III schedule. The table below exhibits detailed information on
annual disbursements and fund utilization.
Development
Partners
2011/12
(EFY04)
2012/13
(EFY05)
2013/14
(EFY06)
2014/15
(EFY07)
2015/16
(EFY08)
Total
[per partner]
DFID 703,125.00 294,370.00 563,463.64 608,766.23 0.00 2,169,724.87
IC 133,333.00 0.00 375,469.34 0.00 0.00 508,802.34
AusAID 501,000.00 516,530.00 410,632.69 0.00 0.00 1,428,162.69
USAID 0.00 0.00 0.00 0.00 2,140,000.00 2,140,000.00
Total [per year] 1,337,458.00 810,900.00 1,349,565.67 608,766.23 2,140,000.00
Grand Total 6,246,689.90
Utilization (%) 34.3%
Table 03: The contributions by individual partners from July 2011 – December 2015
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
11 | P a g e
Unlike the grants received by aforementioned
partners, the USAID grant was managed
separately and also received late. In particular,
USAID disbursed a two series grant with
cumulative sum of USD $2,140,000.00. The
initial USAID grant was inducted on January 1,
2015 with an expiry date of grant set to end of
June 2016. Of which, the amount utilized by
29th of February 2016 was USD $857,253.57,
leaving the unspent balance of USD
$1,282,746.43. Obviously, utilization of this
particular grant was also behind the schedule
vis-à-vis the stipulated duration of the HPF-III.
In comparison to the preceding round of HPF (HPF-II), a decline was observed in terms of number of
contributors; and also fund absorption capacity. In contrast, the HPF II was able to draw in six partners
with a total disbursement of $3,769,368.08. The average amount of fund, computed alongside the
duration of the project, was roughly comparable with the preceding round. In fact, under normal
circumstances, the HPF-III was anticipated to attract more partners and raise additional fund, or else
stand no less. The decline in the number of DPs that subscribed to the fund was lesser due to a
withdrawal action taken by previous contributors of the fund: Royal Netherlands Embassy, Development
Cooperation of Ireland, as well as UNICEF. Conversely, a newer partner, USAID, joined the scheme in
HPF-III.
Nonetheless, this evaluation unveiled significant constraints in the course of unlocking the full potential
of the fund. First and foremost, participation was low and significant contraction was noted in the
number of prevailing contributing donors which eventually lead to shrinkage of finance availed through
HPF account ensuing substantial funding gaps. Here, underlying factors implicated were retraction of
previous HPF contributors; inadequate HPF relevant advocacy work; soft activism to convene
subscription by new members; mild effort applied to increase resource mobilization from existing
members; and irregularities as well delays in disbursement to the HPF account. In fact, the funding gaps
were filled up by donors as well as the fund manager (UNICEF), nonetheless, impacts from these gaps
were not negligible. Occasionally, donors were asked to step up disbursements in advance of the actual
schedule. In other instances, the fund administrator was urged to inject money in to the HPF account
which was reclaimed from disbursements made later in the course.
On the other hand, a peculiar challenge was identified linked to fund absorption. The fund absorption
capacity showed a declining trend along consecutive rounds of HPF implementations. Collectively, all
three rounds of HPF necessitated arrangements for cost extensions resulting in stretched project
periods. In fact, stumbling upon such occurrence didn’t improve over the years as was manifested by the
performance of the HPF-III which run through recurrent cost extension and consultations with various
HPF contributors. This declining trend, in turn, instigated holdup of scheduled disbursements, expiry of
disbursed grants, call for cost extensions and rescheduling of project lifespan. Conversely, in view of the
spirit and potential capacity of the fund, availed resources were only fairly adequate to sustain the
progress of potential HSDP targets and relevant activities.
Figure 1: HPF-III contribution by DPs between 2011 & 2015
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
12 | P a g e
Partners
•Disburse
FMOH
•Utilize
JCCC
•Monitor
UNICEF
•Admin
Partners
• Disbursement
• DFID
• USAID
• AusAID
• IC
FMOH
• Utilization
• Plan
• Review
• Approval
JCCC
• Monitoring
• Review planning
• Endorsement
UNICEF
• Administration
• Procurment
• Effect Payment
• Report utilization
1.2. DESIGN of HPF
In line with the purpose of the HPF-III, its design was crafted to allow partners to contribute to the
fulfillment of goals of the HSDP by supporting the implementation process through flexible, time-
sensitive and less cumbersome funding mechanisms that reduces transaction costs. In this regard, this
evaluation ascertained that design of the fund was fairly consistent with development strategy of
stakeholders; the fund was logically flexible to finance the implementation of complex tasks relevant to
HSDP; and representation by key DPs in the country was acceptable, but only a few members
participated. The funding scheme was praised by most respondents as the best approach for planned
targets with superior performance compared to other alternatives covering similar agendas. In
comparison, the HPF III had also learnt from previous rounds of the fund, applied the experiences and
progressed very well. Consequently, through the HPF III, several important activities relevant to HSDP
were accomplished and notable achievements were recorded. Yet, most respondents have foreseen a
higher performance capacity through the fund by unleashing its full potential.
The contracted span of HPF objectives and strategic areas; little dynamism of annual plans alongside
activities; elusiveness of MOU as well as openness for interpretation; insubstantial and unclear linkage
between activity plans and outputs; and strict requirements for tight financial audit by contributing
partners were some of the significant bottlenecks relevant to the design. These constraints were also
found to be among the prominent factors that slowed down potential partners so as to sign up and join
the HPF, as well, played essential role in relation to withdrawal action taken by previous key HPF
partners.
1.3. PLAN, REQUEST & APPROVAL
In accordance with the provisions of the HPF’s MOU, core duties and responsibilities were shared among
partners. In general, the core tasks were scheduled disbursements of grants; annual synthesis of activity
plans with commendation, submission, review and approval of funding requests; endorsement of
approvals for fund release; effecting fund release and procurement; and monitoring. Scheduled
disbursements to the HPF account were effected by Development Partners (DPs); the FMOH synthesized
annual plans, reviewed funding requests and made approvals; fund utilization was monitored by the
JCCC; and procurement was effected through UNICEF, to which fund administration was entrusted.
Figure 2: Activity Cycleof disbursing, utilization, monitoring, and administration process.
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
13 | P a g e
In detail, a series of steps and procedures were undertaken in the implementation process. The FMOH,
the owner of the fund, was responsible for synthesis of annual activity plans, particularly the PPD of the
FMOH was in charge of developing the annual activity and expenditure plans. In compliance, synthesis
of annual activity plans; request processing; and approval for fund release was carried out by FMOH. In
the beginning of each Ethiopian Fiscal Year, each annual activity plan was presented to the JCCC and
discussed. The JCCC scrutinized presented plans; ratified if expenditures were within the limits; and
finalize the documents to produce a jointly approved annual activity and expenditure plan. The plan was
fairly detailed, timely and most fund requests were in accordance with the objectives.
In the course of fund discharging, subsequent to endorsement of the annual plan, the fund request,
review and approval process comes in to view which requires a series of steps and clearances that need
to be undertaken. In brief, the process consists of preparation and /or receipt of various proposals for
funding; review of proposals and approval by the FMOH; presentation of approved requests to the JCCC
for endorsement. The JCCC was assigned to monitor the implementation of activities ensuring
appropriate and efficient use of the fund in the spirit of its purpose. In particular, JCCC’s
endorsement was required for a special set of funding requests: those beyond the annual plan or those
that exceed the agreed budget by more than 10%. In most instances, routine requests were processed in
accordance with the joint annual plan and on the fly approved by the FMOH itself. However,
expenditures that surpass the cost ceiling of 10% were reviewed by JCCC before execution. Fund
discharge was initiated upon submission of approved requests by FMOH. The submission should be
accompanied by a complete documentation including written authorization for payment by FMOH and
sometimes proof of endorsement by JCCC, particularly minute recordings, where applicable.
Commonly, the preparation of annual plan was customary and predictable. Mainly, this was due to lack
of flexibility to accommodate additional strategic areas, objectives and also initiatives. Compared to
potential activities that need to be invested on, the planning process was only fairly adequate, but not
passionate. Indeed, the plan didn't match up to the fund availed; thus, resulting in late and low fund
exhaustion. The review also unraveled that individual users were not well acquainted with the purpose
of the fund. For instance, TAs who were hired through the HPF were found to have scanty knowledge
about the fund; most HPF users at FMOH were not aware of steps and procedures for fund approval;
and frequent complaints were received by UNICEF regarding low DSA scales. These instances signify the
low level of advocacy conducted about purpose, features and values of the HPF.
1.4. FUND UTILIZATION
In general, the benefits of HPF did commensurate with the inputs and remarkable achievements were
observed. Through this fund, several activities were financed including important events which
profoundly contributed to improve outcomes and also amplify the sector's inputs towards the GTP. In
particular, the HPF-III was supporting the implementation of activities focused on system strengthening,
technical assistance and provision of resources for commissioning relevant studies on key health sector
issues in Ethiopia.
Among the core accomplishments of the HPF III were HSS, ME, Capacity building, Planning, ARM, JSC,
TA, Gap filling; HSDP priorities, and Operational Research. In addition, it helped to reduce regional
inequalities of health; finance key policy dialogues to strengthen the health system through policy
revision and finalization of HSTP; supporting Emergency Referral Initiative which facilitated inter-facility
referral for 6,188 laboring mothers, neonatal cases and other emergencies. The HPF was owned and
managed by the FMOH. Unlike other similar schemes, the HPF III maintains a unique advantage, offering
a great space for flexibility, to support enormous investments through HSDP and beyond.
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
14 | P a g e
1.4.1. System strengthening
In brief, core accomplishments in this category were: M&E activities including HSDP-IV reviews (Mid-
Term-Review), Joint Review Mission (JRM), and Policy Dialogue Workshops. The HPF III sponsored
several events and availed the platform for exchange of views among participants; enabled common
understanding on various agendas; in-depth analysis of performance reports, progress made and
constraints identified; and endorsement of upcoming plans and initiatives. Of which, the Health Sector
Annual Review Meeting (ARM), and Joint steering Committee (JSC) were events of prime significance
uninterruptedly funded through the HPF.
The ARM, a regular annual meeting, convened more than a thousand participants across-the-board
including health institutions and other relevant stakeholders (universities, partners, NGOs, civil societies,
associations). Similarly, the JSC, a performance monitoring and evaluation summit that summoned
managements of FMOH, Agencies and RHBs, had been financed through the HPF on a quarterly basis.
Particularly, the ARM session enabled participants grasp the opportunity to openly debate and
understand various agendas; conduct focused exchange of views on presentations; and forward inputs
for further improvement. Further, these events strengthened coordination and partnership among
government, donors and stakeholders; and help review individual performance level equated to national
average. Besides, Woreda-Based Planning (WBP) and supportive supervisions, mostly financed through
the HPF, had contributed to strengthening the capacity of Woreda health offices.
In addition, the fund was utilized to finance capacity building activities through provision of training and
also sponsoring policy makers and key implementers to obtain transnational exposure and sweeping
experiences in various areas including health policy. As such, the HPF financed participants on local and
international conferences to acquire updated information and evidence that could be adapted to local
context. Especially, the benefits of travel, mainly international travel, were multifold: experience
sharing, bringing innovations home, and country image building were among the core advantages.
Besides, Ethiopia was also able to contribute to key global debate and dialogue on contemporary health
related issues and to engage with international development partners.
1.4.2. Technical Assistance
One of the key objectives of the HPF III was the recruitment of Technical Assistants (TAs) with the aim to
provide support to the health system, particularly the implementation of HSDP IV at various levels.
These included capacity building of staff in various directorates at the FMOH, Agencies, and regional
bureaus; and also coordinate and assist regions that require specialized support. Indeed, the HPF had
been the principal fund that provided resources to finance salaries, top-ups and hardship allowance for
international and/or national consultants. In this regard, a total of about 77 consultants were hired. Of
the 77 technical assistants, about 25 (32.4%) technical assistants were working in different directorates
in FMOH and PFSA where specific needs for technical support had been identified, particularly IT, audit,
procurement, policy related research, and grant management. For instance, at the FMOH, the TAs
delivered specialty service by providing technical assistance to strengthen the audit and procurement
process at the Finance and Procurement Directorate, particularly the Grant Management Unit.
On the other hand, 34 (42.4%) of the TAs were deployed to four regions which required special support:
Somali (14), Afar (7), Gambella (6) and Beninshangul Gumuz (5). These TAs were placed in offices at
regional, zonal and Woredas level and delivered their support focusing on initiating equity responses
and also accelerating the performance of HSDP IV in those specified regions. By the end of 2015, about
32 technical assistants, assigned to regions, continued their service. As marked by various reports, the
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
15 | P a g e
principal areas of engagement of these TAs, particularly at regions included provision of training for
health workers; participation in design and development of documents and guidelines; support the
enhancement of service utilization; provision of system strengthening and M&E support; contributions
towards health facility infrastructure development and equipping; and also supporting the response to
emergencies in relation to the drought.
The deployment of TAs was effected as per the 2014 agreement between FMOH and UNICEF. In
compliance with the agreement, the TAs were recruited and deployed to regions by FMOH and UNICEF
payed their top-up and hardship allowance upon submission of payment request and performance
report. A few complaints were identified with regard to delayed payments of salaries, but the issue
required in-depth investigation in order to identify underlying causes.
1.4.3. Service Delivery
The fund was applied in the implementation of cutting-edge initiatives including the Emergency MNCH
Referral Initiative. Thus, several hospitals received the assistance targeted to improve referral and
provision of emergency medical service in Addis Ababa. FMOH deployed 13 (16.8%) health providers to
facilities handling emergency issues and referral services in public and private hospitals. Likewise, four
technical assistants, hired through the HPF, were deployed to Tikur Anbessa Specialized Hospital (TASH)
with the aim to support the human resource management and procurement service. In addition, the
fund was also utilized for development of standards, guidelines and manuals; and also assisted the
emergency response for draught management.
In terms of utilizations, core challenges were low fund absorption, late fund exhaustion and recurrent
cost extensions. Thus far, by the end of this evaluation, a significant amount of untapped money was
seen deposited in the HPF account. Possibly, underlying factors that contributed to inefficient fund
utilization were contraction of HPF III objectives, limited scope of funded HSDP IV targets, low-key
planning that didn’t conform to fund availed through the HPF III; underutilization of budget in some
proposed targets; and inadequate fund allocation to certain activities which were often overlooked. On
the contrary, over expenditures were noticed, in projects like ARM. Respondents compared the value-
for-money in such over expenditures weighed against other HSDP priorities.
The eligibility of travels was one of the most emphasized and heavily criticized agenda by respondents
during this assessment; consequently, several critiques were stipulated by respondents as equated to its
benefits. Along these lines, several challenges associated with expenditure, management and cost
control for international travel were identified. One of the major issues specified was in relation to the
measurability of outputs correlated with travels. Conceivably, the critiques were backed by citations of
shortcomings linked to outputs of travels. In most cases, travel narratives and relevant outcomes were
improvised or not shared by travelers upon return. Even for few reports collected from travelers, the
narratives were incomplete and unarticulated; and lack description on objectives and relevant details. In
a few cases, the purpose of travels was not credible to a certain extent whilst it could have been
financed by the FMOH itself. This specific challenge was cited as a key factor that attributed to the
withdrawal of DPs who question the eligibility of travels compared to other priorities.
In addition, other challenges include the utilization of HPF III funds as first hand option for overhead
expenditures; and also little activism to explore alternative sources of funding to cover administrative
costs where applicable. Implementation delays were also noticed mainly due to delayed disbursement
of contributions; lengthy process in the course of deployment of Technical Assistants (TAs); delayed
submission of expenditure requests; and also incomplete documentation resulting in delayed settlement
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
16 | P a g e
of payments. Challenges specified with regard to TAs include increased turnover, vague scope; outdated
guideline and absence of exit strategy despite the rising number of TAs.
1.5. FUND ADMINISTRATION
In terms of accountability, duties and responsibilities adopted by UNICEF during the implementation
period of the HPF were multifold: contributing partner; fund administrator; and also a delegate for
FMOH in various instances. Until the completion of this evaluation, UNICEF was assigned as the sole
administrative manager of the HPF on behalf of the FMOH for all the three rounds of the HPF. As such,
UNICEF was delegated to administer the HPF-III on behalf of the FMOH. The rationale for the fund’s
separate management was to facilitate a swift and flexible procurement; thereby remove administrative
burden of these tasks from FMOH and expedite the implementation of HSDP. An operational fee of 7%
was deducted, from each disbursement, for administration costs incurred by UNICEF. This review
observed that the charged fee was within acceptable limits. In fact, the fee was smaller when compared
to operational fee claimed by others for managing similar operations.
The fund operations were run in consultation with the JCCC’s instructions and in accordance with
UNICEF’s regulations, directives and procedures. Accordingly, UNICEF received disbursements from DPs
and stored the fund in a special account. Since grants were received in various currency formats (USD,
Euro, and Pound), the United Nations operational rate of exchange was applied to convert the grants
into United States Dollars based on exchange rates on the date of receipt.
Overall, the Fund administration was flexible, swift and less cumbersome despite some challenges that
imposed difficulty for flexibility. In this regard, all travel related requests were executed on time despite
the presence of several late hour requests. Besides, UNICEF waived the required procedures for travels
made by high-ranking officials and arranged “No Clearance” special travel plans that affirm with relevant
protocols of the officials. Procurements were effected upon receipt of official authorization signed by
PPD/FMOH; and accompanied by relevant supporting documents. The fund administrator had a close
collaboration with the PPD/FMOH and also advised by the JCCC. The procurement of goods and services,
administration of the contracts of consultants, rental of conference venues and transportation were
carried out effectively. The procurement process was fairly in line with the rules and regulations of
UNICEF; in compliance with the agreed terms of the MOU; and also consistent with internationally
accepted practices to ensure value for money.
UNICEF possesses a well-established and advanced fund management system used by various customers
worldwide and also earned a huge trust from several partners globally. UNICEF provided high caliber
staffs, adequate service and a reliable procurement system for the amount charged. Besides, several
urgent tasks presented to UNICEF on short-notice were handled well. The fund management by
UNICEF’s had recognizable benefits attributed to UNICEF's global collaboration as well as affiliation with
various businesses and services providers; acclaimed reputation for collaboration with various
development partners; and also the established technical capacity and input by the high caliber staff.
The financial administration process was subjected to auditing procedures, both internal and external,
by employing regulations, rules, directives and procedures applicable to UNICEF. As such, most partners
mentioned that they have full confidence and trust since the fund is administered by UNICEF.
During the implementation period of HPF III, UNICEF communicated and shared information with the
FMOH, JCCC and partners on several issues and also advised partners of the decision in that regard
including date of scheduled disbursements; status of expenditures; and inadequacy of funds in the HPF
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
17 | P a g e
account. In a few occasions, particularly when the balance in the HPF account was insufficient to make
scheduled disbursements, UNICEF filled the gaps and made disbursements in consultation with the JCCC.
In addition, UNICEF also presented valuable feedback to the FMOH including progress of activities and
cautionary notes on pending activities; alerts pertaining to grant expiry; and also encouraged on time
budget utilization.
In the procurement process, the fund administrator claimed several challenges, principally complexity of
assignments and increased workload. In this regard, several factors were identified that attributed to
challenges. Requests did not adhere to agreed conditions for fund administration or were not in
accordance with the HPF's procedures as stated in the MOU. The most frequent barriers in fulfilling the
required pre-requisites consisted: incomplete documents (Incorrect names, dates), 11th hour requests,
ineligible requests, unauthorized requests, and detoured requests. Urgency coupled with detoured
requests (bypassing the sequence of approval) was one of the most frequent challenges observed in
certain cases. Travel requests were mostly delivered to UNICEF shortly before due time, but achieved by
UNICEF's staff who committed after-hours work. Complaints were heard from staff due to after-hour
workloads and urgency of certain tasks which put the staff under pressure.
On the other hand, prominent communication gaps were identified between the record and registration
office and UNICEF causing delayed arrival of approved requests to UNICEF. The late arrival of requests
was mostly due to lags at record unit at FMOH while delivering the required documents. Sometimes,
UNICEF received employment and payment documents from TAs themselves by hand.
With regard to payment of TAs, challenges were due to submission of payment requests for cumulative
number of months allied with large number of newly hired consultants. In addition, unavailability of
standalone staff exclusively assigned for the task in FMOH was aggravating factor. Perhaps, JCCC
overlooked the idea of hiring adequate staffs exclusively for managing the fund despite requests were
presented to JCCC.
UNICEF undertakes various audits, both internal and external audits including those by MOFED. In this
regard, there were requests that did not comply with UNICEF's financial rules and procedures for fund
management. Similarly, some of these requests did not comply with financial rules and procedures of
MOFED. By the end of this evaluation, UNICEF's upgraded its financial regulations and a new procedure
called VISION is instigated which requires additional steps. Thus, fund release process is expected to
take additional steps.
1.6. MONITORING AND EVALUATION
The Joint Core Coordinating Committee (JCCC), composed of members from the Federal Ministry of
Health and HPN Partners, was chaired by the Head of the Policy, Planning Directorate of the Ministry of
Health. The Committee was delegated the responsibility to endorse annual HPF-III activity and
expenditure plans; monitor the fund's appropriate and efficient utilization; and also advise on the
procurement of goods and services. Exclusive of oversight by the UNICEF’s system itself, the fund
administration was observed through layers of monitoring schemes and robust monitoring activities
were performed. These include detailed reports of expenditures linked to themes were summited and
reviewed on regular basis; Value-For-Money (VFM) was scrutinized with in-depth inspection for
particular expenditures and items tagged under reservations; and also auditing was conducted by
MOFED and external auditors.
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
18 | P a g e
Furthermore, activity plan and achievements were tracked; details of all expenditures were monitored
regularly through presentation of reports by UNICEF; as well individual DPs were able to monitor
contributed grants with respective detailed expenditure statements for each projects effected.
Expenditures greater than 10% of the plan were discussed and fund release was granted as observed
from recorded minutes of the JCCC meeting. The contribution to draught management; the new
initiative of Emergency MNCH Referral; and ARM expenditures were among the biggest issues discussed
during the meetings.
In accordance with the MOU, the fund administrator submitted regular reports including brief summary
of the activities and narrative to the JCCC, individual donor reports, and also periodic financial utilization
progress update reports. As such, semi-annual/annual utilization and progress updates reports were
submitted by UNICEF. In addition, UNICEF submitted individual reports to partners on particular grant
utilizations, details of expenditures, and also exhaustion. The reports were reviewed and endorsed by
the JCCC and were circulated to the donors. By the end of each round of HPF, the JCCC coordinated an
independent final evaluation of the fund, contracted and executed by UNICEF. Information exchange
was fair among the partners; minutes of the JCCC were circulated, and progress updates were shared.
The monitoring activity by the JCCC was fairly challenged due to emergence last-minute consultations
for endorsement of expenditures for which FMOH had authorized execution. One such example,
intensely debated by the JCCC due to unusually high cost, was the cost allocated to preparation of the
ARM for the year 2015.
To this end, the governance procedures were fairly transparent; and HPF was modestly
representativeness and inclusive of key development partners. With regard to sustainability, outcome
linked to the planning and monitoring components of the HPF objectives have a tendency to endure.
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
19 | P a g e
Recommendations
Design and Framework of HPF
The fund’s framework should be updated to broaden the scope of strategic areas and enrich respective
activities in such a way that it keeps a room to accommodate more objective, themes and activities on
top of existing ones. Hence, it equates with development strategy of partners; enable FMOH to fast-
track important HSTP activities; and catches the attention of DPs and draws them to the partnership.
The fund’s design should also incorporate more transparency aimed at achieving Value-for-Money.
Memorandum of Understanding
The MOU document needs in-depth review with attention to its details by eliminating vague
descriptions and adding more clarity so that it evades potential ambiguities and interpretations. Further,
the MOU should be redecorated by incorporating additional procedures with detailed criteria in order to
classify expenditures in to groups. For instance, potential expenditure groups could consist of: allowed
expenditures; expenses not eligible to be funded through HPF; administrative expenses; and routine
expenses. As such, the procedure will help to regulate limits and cost thresholds of prospective
procurements in each of these identified groups. Boundaries should be made to control the number of
travels and also set eligibility criteria to varieties of travels allowed as could be grouped by classes of
travels (local/international) and respective themes and objectives. In addition, the MOU should create a
room to adjust and be inclusive of procedures of participating partners.
Annual Plan of HPF
Annual preparation of plans should focus on details of activities; precise budget allocation and
forecasting; inclusion of activities pertinent to HSTP targets; and inclusion of OR at the heart of the
design so that it informs and strengthens policy formulation and decision making. The synthesis of
proposals and activity plans should clearly show the linkage between objectives and anticipated results
asserting with the VFM.
Resource Mobilization
The FMOH should strengthen its effort to conduct additional resource mobilization and pull additional
funds, particularly from existing HPF partners. This could be accomplished by conducting robust
advocacy relevant to HPF and should be highly emphasized since the benefits are multifold. On one
hand, the promotion will attract additional contributing partners to the scheme which simultaneously
opens the door to pull resources; and boost number of grants and amount disbursed to the HPF
account, thereby it widens the potential to invest in more strategic areas. On the other hand, the
advocacy will help recruit more fund recipients, stakeholders including RHB and agencies, to utilize the
resource availed through the HPF. As such it minimizes the persisting challenge of low and late fund
absorption; as well help secure additional strength from the recipients to partake and push the HSTP
agenda further. The HPF should also consider contributions from partners not only in terms of finance
but also seek for technical and other kinds of supports.
Fund Utilization, Monitoring and Reporting
The fund should be utilized to support projects that couldn't be funded through other schemes.
Meaning, apply HPF as a primary source for financing cross-cutting issues and also monitor project
activities through operational researches. As such, the annual plans should allocate adequate funding
for operational researches; evidence-based implementation/monitoring; and also encourage submission
of such proposal. On the contrary, the HPF should be set as the last option to resort to when other
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
20 | P a g e
alternative funds are unavailable, particularly for administrative costs. As a substitute, the FMOH should
seek own and alternative resources instead of HPF as a firsthand pick.
The FMOH should discuss important matters with the JCCC before approval of requests, particularly in
relation to the VFM. The JCCC, in this respect should also closely monitor the VFM. Co-chairing by
partners should be considered to allow fair fund approval process. In addition, detailed documentation
of travel reports, relevant benefits and results should be timely shared by the travelers up on arrival. In
line with this, the HPF should be praised and promoted for its benefits, particularly in relation to travels.
Fund Administration
Improve fund absorption by applying a strong effort during the planning process by incorporating
passionate objectives; evaluating requests in accordance with the annual plan; executing proposed
projects promptly; and conforming to agreed terms and conditions for fund utilization. The plan should
also incorporate appropriate project milestones and/or log-frame that should be shared among
partners. The fund administrator has been regarded and also found highly valuable in the spirit of
managing the fund as per the agreed terms and condition. Further, UNICEF was found to have a credible
amount of trust from partners; and hence, played on as a check and balance party between partners
and FMOH.
Hire appropriate number of staffs who will be exclusively assigned to facilitate fund’s operations. In this
regard, the evaluation results suggested the deployment of three staffs that will be financed through the
HPF: Fund management consultant at the FMOH); and two Administrative Assistants who will work to
facilitate the fund request at the FMIOH and UNICEF. Besides, a tracking mechanism needs to be set
using document time-stamps so as to trace the overall fund request, approval and release process.
Continuity and Sustainability of HPF
In-depth discussion needs to be held with all partners regarding participation and continuity of the fund.
In addition, the discussion should also explore possible causes for partners’ withdrawal action from the
HPF; and consult with the partners to re-assess their status. Also, HPF needs to adapt to unanticipated
changes of funding by seeking interim solutions when partners face challenges, as in reduction of
funding level. Thus, the FMOH should establish a system to address funding fluctuations through
revision of plans, adjusting expenditure level and also try to find alternative approaches and sources.
In the end, some documents and procedures need to be updated. These include updating the HPF’s
design framework, MOU and objectives by incorporate additional strategic. In addition, standard
templates will be required for fund request process; log system to track document transmission and
submission; and also travel arrangement.
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
21 | P a g e
ANNEX I - References
1. Health Sector Development Plan and Performance Reports (HSDP III, HSDP IV). FMOH,
Addis Ababa.
2. Health Sector Pooled Fund Evaluation Report. HPF Evaluation Team, April 2007, Addis
Ababa.
3. Health Sector Pooled Fund Evaluation Report. Asrade Abate, Aug, 2010, Addis Ababa.
4. Annual Report of Performance of Health Pooled Fund III. UNICEF, Aug, 2012, Addis
Ababa.
5. Annual Report of Performance of Health Pooled Fund III. UNICEF, Oct, 2013, Addis Ababa.
6. Annual Report of Performance of Health Pooled Fund III. UNICEF, Aug, 2014, Addis
Ababa.
7. Annual Report of Performance of Health Pooled Fund III. UNICEF, Sep, 2015, Addis Ababa.
8. Annual Report of Performance of Health Pooled Fund III. UNICEF, Dec, 2015, Addis Ababa.
9. Mini Ethiopian Demographic Health Survey. Central Statistical Agency, 2014, Addis
Ababa.
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
22 | P a g e
ANNEX II – Questionnaire-1
Code#: ________________
Full Name: ______________________
Organization: _______________________
Position: _______________________
Involvement: _________________________
A. Partners’ Participation
1) Did your organization participate in the design and/or implementation of the HPF?
2) What was your organization’s financial contribution to the HPF?
3) Why didn’t your organization participate in HPF III?
4) Did your organization play any role in promoting HPF among stakeholders?
B. Scope, Objectives, & Design
5) What is your opinion on the scope of HPF? (Adequacy of fund, and Eligible areas of funding)
6) Were HPF’s time lines, milestones and targets appropriate?
7) Were there any shortfalls in the design of the HPF?
8) Was the work of HPF consistent with development strategy of its principal stakeholders?
9) Did members and donors in the HPF represent the key partners in the country?
10) Were all contributions DPs received on time and according to the disbursement schedule?
a) What were the causes for the delay?
b) What measures were taken by donors to manage the funding gap?
c) Were resources adequate to sustain progress?
11) Do you consider the JCCC to be inclusive in terms of members?
12) Were the structure, role, authority and interactions with governance bodies appropriate?
13) Were governance procedures of HPF adequate in terms of transparency and objectivity?
C. Plan, Use & Management
14) Did the FMOH has annual expenditure plan for appropriate and efficient utilization of HPF?
15) Did the FMOH follow standard procedures to authorize execution of plans?
16) Did the FMOH ensure appropriate and efficient use of the fund in the spirit of its purpose?
a) Value for money (VFM)?
b) Utilization within the limits of its budget?
c) Activities not being part of the Annual Plan/exceed the agreed budget?
17) Were all the required procedures adhere to upon request for spending?
18) Were all requests made, received and executed in line with HPF’s proposal?
19) How much time does UNICEF take, on average, to process an authorized spending?
20) What were contributions of UNICEF to the fund?
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
23 | P a g e
21) What’s your opinion about UNICEF to put charge on DPs for 7% operational fee?
22) What was the workload of the HPF on UNICEF?
23) Do you think human resource allocated by UNICEF is adequate for managing the fund?
24) Why JCCC did overlooked the idea of hiring staffs, exclusively for the purpose of managing the
fund?
25) Were there procedures against UNICEF’s regulation for procurement?
26) Do you think administration/management of HPF should be continued by UNICEF?
D. Outputs / Outcomes
1) Were benefits of HPF commensurate with inputs in terms of cost, time and effort?
2) Was HPF a viable option for strengthening implementation of HSDP IV?
3) What has been the value-added of the HPF to support implementation process of HSDP IV?
4) What was HPF’s comparative advantage relative to alternatives covering similar issues?
5) What were the major contributions of the HPF in the implementation of HSDP?
6) What distinguished outputs of HSDP could be attributed to the HPF?
7) What do you perceive as the greatest successes regarding HPF?
8) What do you perceive as the greatest challenges of HPF?
9) Were there inefficiencies in utilization? What were the main barriers to effective utilization?
10) Do you think that HPF achievements will endure?
11) Do you think the HPF should continue as it is? What improvements do you suggest?
12) What is your current stand, to join and contribute to the next round HPF?
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
24 | P a g e
5 Highly satisfactory 4 Satisfactory 3 Fairly satisfactory
2 Less satisfactory 1 Not satisfactory
ANNEX II – Questionnaire-2
Code#: _______________________
Please Rate the following by choosing values provided in the box below. (Mark boxes)
SN Rate 5 4 3 2 1
0 Do you like Ethiopia? (sample completed) X
1 Extent to which HPF design was appropriate to attain its objectives
2 Strength and weakness of the HPF in terms of:
Objectives
Design
Implementation
Monitoring
3 Responsibility of FMOH for receiving, processing & approving request
4 JCCC's meetings in terms of:
Regularity of the meetings
Effectiveness of the meetings
Attendance by all members
5 JCCC's approval process for the HPF as per the MOU in terms of:
Monitoring mechanisms
Transparency
Timeliness
6 JCCC's decision making process to allocate and utilize resources
7 Efficiency of the process of the procurement of service and goods
8 Administration of the HPF by UNICEF in terms of:
Less cumbersomeness
Flexibility
Transparency
Timeliness
9 Financial / progress reports submitted by UNICEF for JCCC in terms of
Timeliness
Accuracy
10 Selection of clients and contracting process in terms of
Transparency of selection
Clear TOR for assignment
11 Overall fund administration process by UNICEF
12 Effectiveness of HPF as a working-model for joint donor engagement
13 Overall rating of the extent of achievement HPF objectives
14 Degree of political commitment among key stakeholders
15 Improved efficiency of HPF-III as compared to HPF-II
16 Achievement of HPF relative to best practices in other countries
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
25 | P a g e
ANNEX III – Memorandum of Understanding
(Converted from Original PDF MOU document)
JOINT MEMORANDUM OF UNDERSTANDING BETWEEN THE GOVERNMENTS OF THE
UNITED KINGDOM,ITALY,AUSTRALIA,THE UNITED STATES, THE UNITED NATIONS
CHILDREN'S FUND AND THE FEDERAL MINISTRY OF HEALTH OF ETHIOPIA ON THE
MANAGEMENT OF THE HEALTH POOLED FUND FOR SUPPORT TO THE IMPLEMENTATI
PROCESS OF THE HEALTH SECTOR DEVELOPMENT PROGRAMME OF ETHIOPIA (HPF-IV)
1 July 2011- 30 June 2015
I.GENERAL
The Federal Democratic Republic of Ethiopia, Ministry of Health (FMOH) is committed to
ensuring the accessibility of effective health services at every level of the health system through
the implementation of the fourth Health Sector Development Programme (HSDP-IV). Within
this plan, the FMOH and Development Partners of the Health Population Nutrition (HPN)
have developed a Health Sector Harmonization and Alignment Action Plan that supports the
country's action plan of harmonization alignment for aid effectiveness.
The Ethiopia Country compact signed in Addis Ababa on 26th August 2008 sets out the
framework or increased and more effective aid, and accelerated actions toward the
achievement of the he lth Millennium Development Goals (MDGs). The Ethiopia Joint
Financing Agreement (JFA) was signed on 15 April 2009 between the FMoH and seven
development partners. The JFA sets out the jointly agreed terms and procedures for the
management of the MDG Performance Fund (MDG/PF), including planning financial
management, governance framework and decision-making, reporting, review and evaluation
audit and supply chain management.
The MDG/PF is a pooled funding mechanism managed by the FMOH using the Government of
Ethiopia procedures. In the framework of the Ethiopia IHP+ compact, it provides flexible
resources, consistent with the 'one plan, one budget and one report' concept, to secure
additional finance to the HSD-IV. It is the Government's preferred modality for scaling up
Development Partners assistance in support of HSDP- V.
The Health Pooled Fund {HPF) was first established in 2005 to support the implementation
process of HSDP and achievement of the MDGs in Ethiopia. The HPF is considered part and
parcel of the MDG/PF as it supports the same scope and similar activities as the MDG/PF; its
objectives, internal regulation funding and disbursement are fully controlled by the FMOH
according to the HSDP priorities. However, at the same time the HPF is quite distinct from the
MDG/PF in its administrative management - which is done by UNICEF in the role of Pool Fund
Administrative Manager on behalf of the Policy, Planning and Finance Department of the
Ministry of Health (PPFGD/ FMOH), and in its focus on technical support, coordination and
other services that need swift decision and funding. The rationale for its separate
management is related (i) to facilitate the swift and flexible response to procurement of
national and international technical assistance and international travel; and 2) to remove the
administrative burden of these tasks from FMOH.
The first phase of the HPF was implemented between 1 November 2005 and 31 March 2007
with joint funding from the Governments of Ireland, The Netherlands and The United Kingdom
as well as from UNICEF. The HPF-1 was managed by UNICEF Ethiopia. An independent
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
26 | P a g e
evaluation of the first HPF, conducted in March/April 2007, concluded that funds had been used
for the purposes intended and that both FMOH and Development Partners had benefited from
reduced transaction costs. Based on the positive experiences with the initial HPF and taking into
account the recommendations of the evaluation, a number of HPN Partners had agreed to support
the extension of the Fund into a new phase of 3 years: The HPF-11. The general objective of the
HPF-11 was to contribute to the fulfillment of the goals of the HSDP-111, by supporting its
implementation process through flexible, time-sensitive and less cumbersome funding
mechanisms, in line with the Harmonization Action Plan of HSDP-111. Development Partners'
contributions (DCI, RNE, DFID, IC, ADC) to the HPF-11 amounted to a total of US$ 4,152,985.34
million (US$ 4,152,985.34 programmable). Together with UNICEF contribution of US$ 539,928.43
the HPFII total programmable budget amounted to US$ 4,509,661.63. The second phase of the
HPF will end on
30 June 2011.
An independent evaluation of HPF-11 was conducted in August 2010. The objective of the
evaluation was to assess whether the fund has served its intended purpose. The
evaluation report provided views of the performance, effectiveness, efficiency and eligible
utilization of HPF-11 in accordance with its objectives, and drew lessons and made
recommendations.
In general, the evaluation revealed that HPF-11 is widely seen as an effective, timely,
responsive and demand-driven fund channeled towards the most urgent and critical
needs of HSDP by strengthening the planning and coordination and implementation
process. The establishment of the MDG/PF has drawn a lot of lessons from the HPF.
The evaluation team concluded that the HPF-11 has significant benefits in allowing funding to
respond to priority needs of the HSDP more efficiently. The involvement of donors has
been participatory. UNICEF, as a Pooled Fund Manager, provided substantial support in
managing the fund and also filled important funding gaps throughout the implementation
process.
II. THE FUNDING DEVELOPMENT PARTNERS
1. The Development Partners that have currently decided to participate in this pooling
arrangement a to contribute funds are: The United Kingdom, represented by the Department
For International Development (DFID),Australia, represented by AusAID, Italy, represented
by the Italian Co-operation (IC), The United State of America,represented by USAID, Spain,
represented by the Spanish Agency for Development Cooperation (AECID) and
UNICEF.
At any stage during its implementation, other Development Partners may join the HPF by
signing the Joint MOU as well as by signing a Bilateral Agreement with UNICEF (see Annex
I) which will trig the disbursement of the contribution into the Pool Fund managed by
UNICEF as the Pool F Administrative Manager on behalf of the FMOH/PPFD. All partners to
the HPF-111 and signatory to is Joint MOU acknowledge that its clauses and terms
provide the overall framework for the implementation and management of the HPF-111.
All signatories to this MOU acknowledge that the Joint MOU as well as its Annexes - the
signed complementing Bilateral Agreement (Annex 1), he HPF-111 Proposal (Annex II) and
the Reporting Templates (Annex Ill)- are binding. All funds received in the Special Account
will be recorded in United States dollars. The United Nations operational rates of
exchange shall be used to convert into United States dollars all funds received in other
currencies, based on the United Nations operationalrates of exchange in effect on the date
of receipt.
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
27 | P a g e
2. The HPF-III will be part of HSDP's wider pooled funding scheme and will support the
implementation on activities as specified in the Proposal for the HPF-111 (Annex ll) and will
not be used to meet the cost of import or customs duties (or any similar fees) imposed by the
Government of Ethiopia on the go ds imported or services provided. These activities will
include:
a) SYSTEMS STRENGTHENING- Support capacity of PPFDG/ FMOH in planning,
budgeting, monitoring and evaluation of HSDPIV:
• Strengthen the capacity of FMOH in co-ordination of activities in the health sector.
• Enable health policy makers and key implementers to participate in local and
international conferences, seminars, short study trips or visits that contribute to useful
gains of experiences and exposure in health policy development and implementation.
• Support the monitoring and evaluation programs of HSDP-IV (such as ARMs, JRMs,
HSDP Mid-Term Reviews and Final Evaluations) to improve its implementation and
to facilitate the sector's inputs towards the Growth Transformation Plan/ Millennium
Development Goals monitoring and reporting process as well as the tracking of
progress in terms of the relevant indicators and targets in the GTP/HSDP-IV policy
matrix.
• Build capacity and provide training at all levels of the health system (Federal,
Regions, Woredas) in planning, M&E,and Harmonization and Alignment.
• Sponsor meetings of the MOH and the private health sector and providing TA on
development of standards, guidelines and manuals on Public Private Partnerships.
b) TECHNICAL ASSISTANCE
• Provide resources for the recruitment of international and/or national consultants to
assist the Ministry in (i) policy related research, assessments and innovations
and (ii) providing Technical Assistance (TA) in areas where specific needs for
technical support have been identified (IT, Audit, Procurement and others).
c) SUPPORT SERVICE DELIVERY
• Provide resources for commissioning relevant studies on key health sector issues
(operational research) in Ethiopia.
• Provide resources for other relevant process activities in support of the
implementation of HSDP -IV priorities.
• Cover the cost of workshops for policy dialogue and formulation, and seminars on
important health issues in Ethiopia. HPF resources will be accessed via UNICEF for
the above-mentioned programme areas and activities in line with the HSDP-IV
priorities.
Ill.DELEGATION TO UNICEF TO MANAGE THE HPF-III
In line with the HPF-111 Proposal and in consultation with all the HPF-111 donors, the Federal
Ministry of Health has officially requested UNICEF to assist the implementation of the HPF-111
by holding and administratively managing the fund. The Development Partners contribution
will be charged a 7% fee for administration and operational incurred cost by UNICEF.
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
28 | P a g e
IV.THE FEDERAL MINISTRY OF HEALTH AND THE JCCC
As indicated in the Proposal for HPF-iii (Annex II):
1) The Joint Core Coordinating Committee (JCCC) of the Federal Ministry of Health and HPN
Partners, chaired by the Head of the Policy,Planning and Finance Department of the Ministry
(PPFGD-FMOH), has the delegated responsibility of endorsing the Annual HPF-111 Activity
and Expenditure Plan and controlling the Fund's appropriate and efficient utilization.
PPFGD/ FMOH is in charge of developing the draft Annual Activity and Expenditure Plans
and finalizing it with JCCC in July,at the beginning for each Ethiopian Financial Year -and
no later than 31 51
July.
2) The JCCC, the technical arm of PPFGD, will advise on the procurement of goods and services
needed to implement the HPF-111 effectively. Procurement itself will be carried out through
UNICEF Procurement Procedures in line with internationally accepted practices to ensure value
for money.
3) Based on the jointly approved Annual Activity and Expenditure Plan and within the limits of its
budget, the PPFGD-FMOH is responsible for receiving, processing and approving requests for
funding, and ensuring the appropriate and efficient use of the Fund in the spirit of its
purpose. The JCC's endorsement is needed for approval of activities not being part of the
Annual Plan or for activities which exceed the agreed budget (line) by more than 10%. This
approval needs to be recorded in the minutes of the JCCC meeting.
4) Upon approval for funding by JCCC, written authorization for payment together with the
relevant supporting documentation (including the JCCC minute recording the approval)will be
transmitted to UNICEF by the Head of the PPFGD-FMOH.
5) PPFGD-FMOH will inform the HPF-111 donors on progress of HPF-111 and on key relevant
decisions by timely circulating the Minutes of the JCCC meetings. Also, the PPFDG-FMOH will
inform the FMOH. HPN Partners Joint Consultative Forum, which meets every three months, on
progress of HPF-111 activities and expenditure.
6) Whereby donors to the HPF-111 were not members of the JCCC, the JCCC Secretariat and/ or
the PPFD-FMOH are responsible to keep them informed by way of sharing the relevant
minutes of the JCCC meetings and other form of communication. The HPF donors who are
member to the JCCC shall channel to the JCCC any comment/ concern/ suggestion raised by
HPF donors not included in the JCCC membership.
7) At the end of EFY 2007 (April-May 2015), the JCCC will coordinate an independent final evaluation
of HPF-III, by an external organization.
V. THE UNITED NATIONS CHILDREN'S FUND (UNICEF)
As aforementioned and also detailed in the Proposal for HPF-111 (Annex II), the JCCC and
PPFGD/FMOH have requested UNICEF Ethiopia to continue the role of Pool Fund Administrative
Manager (PFAM).
1. In its role of PFAM, UNICEF will administratively manage the HPF-111 on behalf of the FMOH
and in accordance with the provisions of this Joint MOU. The Donors acknowledge that
the Contribution will be co-mingled with other contributions to the HPF-111 and that it will
not be separately identified or administered.
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
29 | P a g e
2. The HPF-111 shall be administratively managed by UNICEF in accordance with its regulations,
rules, directives and procedures applicable to Special Accounts, including those relating to
interest. The HPF Ill shall be subject exclusively to the internal and external auditing procedures laid
down in the financial regulations, rules, directives and procedures applicable to UNICEF.
3. UNICEF will effect payments for activities financed by the HPF-111 upon receipt of official
authorization signed by the Head of the PPFGD/ MOH (and any relevant supporting document as
above specified). The procurement of goods and services, administration of the contracts of hired
consultants, payments for such services as in the rental of conference venues and facilities,
transportation and printing will follow the UNICEF rules and regulations.
4. UNICEF will, upon receipt of authorization from the PPFGD-FMOH, undertake the procurement of
goods and services, and administer the contracts of hired consultants. In close consultation a d
collaboration with the PPFGD-FMOH, effect payments for such services as the rental of
conference venues and facilities, transportation for such occasions as Joint Annual Review
Meetings (JARMs), Review Missions (RMs), printing of documents etc.
5. UNICEF will submit to the Donors of the HPF-111 regular reports. In particular:
 Six Monthly financial utilization progress update and a brief summary of the activities
undertaken by the fund recipients during the semester in question, to be submitted
within 1 month after the end of the reporting period - see template in Annex Ill.
 Overall annual progress (narrative and financial) reports for every Ethiopian fiscal
year, to be submitted 2 months after the end of the reporting period-see template
in AnnexIII.
 A finalnarrative and financial report six months after completion of the project, covering
the entire period of the project,
 A final certified financial statement of accounts within six months of financial closure
of the grant as per UNICEF rules and regulations.1
6. Reports will be based on the inputs provided by the PPFGD/ MOH and by the JCCC. Reports
shall be reviewed and endorsed by the JCCC prior to circulation to the HPF-111 Donors.
7. Donors to the HPF-111 acknowledge that all Progress and Final Reports (narrative and
financial, including the final certified statement of accounts) on the implementation of the
activities and the execution of the Fund will be drawn up in the spirit of One Plan, One Budget
and One Report, s avoiding accounting to individual donors.
8. Disbursements will be made to the extent that funds are available in the Ethiopia Health Pooled
Fund Account. Where the balance in the Ethiopia Health Pooled Fund on the date of a
scheduled disbursement is insufficient to make that disbursement, UNICEF shall consult with
the Joint Coordinating Committee and make a disbursement. if any, in accordance with the Joint
Core Coordinating Committee's instructions. UNICEF shall promptly notify the Donors in such
circumstances and shall advise the Donors of the Joint Core Coordinating Committee's decision
in that regard.
9. UNICEF will sign a bilateral Agreement (Annex I) with each of the contributing donors to the
HPF-III to trigger the disbursement of funds. The bilateral Agreement, as per template in Annex
in line with the spirit, framework and clauses of this Joint MOU.
10. Obligations assumed by the Donor and UNICEF under this Joint MOU shall survive the
expiration or termination of this Agreement to the extent necessary to permit the orderly
conclusion of activities, the withdrawal of personnel, funds and property, the settlement of
accounts between the Parties and the settlement of contractual liabilities required in respect of
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
30 | P a g e
any subcontractors, consultants or suppliers. Donors to the HPF-111 acknowledge that any
balance remaining in the HPF-111 account shall be used for a purpose mutually agreed upon by
UNICEF, the HPF- III Donors and the JCCC. If the decision if for unspent balances to be
returned upon completion of the programme, these will be on a pro-rata basis.
11. All financial accounts and statements shall be expressed in United States dollars.
VI. REPORTING
1. UNICEF will submit six monthly financial utilization progress reports and a brief summary
of the activities of the activities undertaken during the semester in question, to be
submitted one month after the end of the reporting period-see template in Annex Ill.
2. UNICEF will also provide Annual progress (narrative and financial- Annex Ill) reports for
every Ethiopian fiscal year. They are to be submitted within 2 months after the end of
the reporting period and in particular by 31st August 2012, 31st August 2013, 31st
August 2014-as per template in Annex Ill.
3. A final narrative and financial report no later than six months after completion of the
project, covering the entire period of the project -i.e. by 30th September 2015.
4. A joint final certified financial statement of accounts produced by 31 51
December 2016.
VII. SETTLEMENT OF DIFFERENCES
1. This MOU is neither a treaty nor an instrument of treaty status. Consequently, differences
which may arise concerning the interpretation or application of the MOU will not be subject
to adjudication or arbitration by any national or international court or tribunal but will
instead be dealt with in an amicable way as the appropriate method of achieving the
peaceful settlement of those differences.
2. The Parties will consult together at any time upon request of either Party regarding any
matter relating to the terms of this Memorandum and will endeavor jointly in a spirit of
cooperation, g faith and mutual trust to resolve expeditiously any difficulties or
misunderstandings that may arise.
VIII.COUNTER-TERRORISM PROVISIONS
1. Consistent with UN Security Council Resolutions relating to terrorism, including UNSC
Resolution 1373 (2001) and 1267 (1999) and related resolutions, both the UNICEF and
the Donors signatory to this agreement are firmly committed to the international fight
against terrorism, and in particular, against the financing of terrorism. It is the policy of
the Donors signatories to this agreement to seek to ensure that none of its funds are
used, directly or indirectly, to provide support to individuals or entities associated with
terrorism.
2. In accordance with its policy, UNICEF undertakes to use all reasonable efforts to ensure
that none of the Contribution is used to provide support to individuals or entities
associated with terrorism. If, during the course of this Agreement, UNICEF discovers a
link with any organization or individual associated with terrorism, UNICEF will inform
immediately the Donors to the HPF- II who are signatories to this MoU.
IX. AMENDMENT TO THE PRESENT MOU
1. This MOU may be amended at any time or extended upon consensus of all signatory
parties. If and when a new Development Partner wished to join the HPF-111 during its
implementation, it can do so by signing the present MOU and a bilateral agreement (as
per Annex I) with UNICEF which triggers the disbursement of the contribution into the
Fund managed by UNICEF on behalf of FMOH.
Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia
31 | P a g e

More Related Content

Viewers also liked

Uso didáctico de los blogs
Uso didáctico de los blogsUso didáctico de los blogs
Uso didáctico de los blogsMiguel Tzec
 
SilkRoad and Employment Today: Set for Success
SilkRoad and Employment Today: Set for SuccessSilkRoad and Employment Today: Set for Success
SilkRoad and Employment Today: Set for SuccessWinny Tang
 
Agility Beyond the Development Team
Agility Beyond the Development TeamAgility Beyond the Development Team
Agility Beyond the Development TeamEndava
 
Рафаэль Усманов в защиту Селютиной О.И. Жалоба № 2808 от 23.01.2016 г.
Рафаэль Усманов в защиту Селютиной О.И. Жалоба № 2808 от 23.01.2016 г.Рафаэль Усманов в защиту Селютиной О.И. Жалоба № 2808 от 23.01.2016 г.
Рафаэль Усманов в защиту Селютиной О.И. Жалоба № 2808 от 23.01.2016 г.Irina Wickholm
 
И. Викхольм. Сообщения о преступлениях в отношении Р. Усманова и других 25.04...
И. Викхольм. Сообщения о преступлениях в отношении Р. Усманова и других 25.04...И. Викхольм. Сообщения о преступлениях в отношении Р. Усманова и других 25.04...
И. Викхольм. Сообщения о преступлениях в отношении Р. Усманова и других 25.04...Irina Wickholm
 
Adeeba_Field Report
Adeeba_Field ReportAdeeba_Field Report
Adeeba_Field ReportAdeeba Rao
 
Psych 1101 final project
Psych 1101 final projectPsych 1101 final project
Psych 1101 final projectAnna Blake
 
Métodos anticonceptivos
Métodos anticonceptivosMétodos anticonceptivos
Métodos anticonceptivosRicardoBA18
 
SEAGULL BAKERY PHOTOESSAY
SEAGULL BAKERY PHOTOESSAYSEAGULL BAKERY PHOTOESSAY
SEAGULL BAKERY PHOTOESSAYSarah Dennison
 
Prokochuk_Irina_Design-S
Prokochuk_Irina_Design-SProkochuk_Irina_Design-S
Prokochuk_Irina_Design-SIra Prokopchuk
 
Prokochuk_Irina_BINARY-CODE
Prokochuk_Irina_BINARY-CODEProkochuk_Irina_BINARY-CODE
Prokochuk_Irina_BINARY-CODEIra Prokopchuk
 
Benemérita universidad autónoma de puebla
Benemérita universidad autónoma de pueblaBenemérita universidad autónoma de puebla
Benemérita universidad autónoma de pueblamario reyes
 
cultural understanding - Copy
cultural understanding - Copycultural understanding - Copy
cultural understanding - CopyMark Leslie
 
Sex ratio and mortality rate2
Sex ratio and mortality rate2Sex ratio and mortality rate2
Sex ratio and mortality rate2Nurulain siddiqui
 
W. Trevor Smith Resume 2017
W. Trevor Smith Resume 2017W. Trevor Smith Resume 2017
W. Trevor Smith Resume 2017W. Trevor Smith
 

Viewers also liked (20)

Uso didáctico de los blogs
Uso didáctico de los blogsUso didáctico de los blogs
Uso didáctico de los blogs
 
Introdução ao SciLab
Introdução ao SciLabIntrodução ao SciLab
Introdução ao SciLab
 
SilkRoad and Employment Today: Set for Success
SilkRoad and Employment Today: Set for SuccessSilkRoad and Employment Today: Set for Success
SilkRoad and Employment Today: Set for Success
 
Agility Beyond the Development Team
Agility Beyond the Development TeamAgility Beyond the Development Team
Agility Beyond the Development Team
 
Рафаэль Усманов в защиту Селютиной О.И. Жалоба № 2808 от 23.01.2016 г.
Рафаэль Усманов в защиту Селютиной О.И. Жалоба № 2808 от 23.01.2016 г.Рафаэль Усманов в защиту Селютиной О.И. Жалоба № 2808 от 23.01.2016 г.
Рафаэль Усманов в защиту Селютиной О.И. Жалоба № 2808 от 23.01.2016 г.
 
И. Викхольм. Сообщения о преступлениях в отношении Р. Усманова и других 25.04...
И. Викхольм. Сообщения о преступлениях в отношении Р. Усманова и других 25.04...И. Викхольм. Сообщения о преступлениях в отношении Р. Усманова и других 25.04...
И. Викхольм. Сообщения о преступлениях в отношении Р. Усманова и других 25.04...
 
Tema 5 copia
Tema 5   copiaTema 5   copia
Tema 5 copia
 
Adeeba_Field Report
Adeeba_Field ReportAdeeba_Field Report
Adeeba_Field Report
 
Psych 1101 final project
Psych 1101 final projectPsych 1101 final project
Psych 1101 final project
 
Métodos anticonceptivos
Métodos anticonceptivosMétodos anticonceptivos
Métodos anticonceptivos
 
certificates
certificatescertificates
certificates
 
Computacionnnnnn
ComputacionnnnnnComputacionnnnnn
Computacionnnnnn
 
SEAGULL BAKERY PHOTOESSAY
SEAGULL BAKERY PHOTOESSAYSEAGULL BAKERY PHOTOESSAY
SEAGULL BAKERY PHOTOESSAY
 
Prokochuk_Irina_Design-S
Prokochuk_Irina_Design-SProkochuk_Irina_Design-S
Prokochuk_Irina_Design-S
 
Prokochuk_Irina_BINARY-CODE
Prokochuk_Irina_BINARY-CODEProkochuk_Irina_BINARY-CODE
Prokochuk_Irina_BINARY-CODE
 
Informe técnico
Informe técnicoInforme técnico
Informe técnico
 
Benemérita universidad autónoma de puebla
Benemérita universidad autónoma de pueblaBenemérita universidad autónoma de puebla
Benemérita universidad autónoma de puebla
 
cultural understanding - Copy
cultural understanding - Copycultural understanding - Copy
cultural understanding - Copy
 
Sex ratio and mortality rate2
Sex ratio and mortality rate2Sex ratio and mortality rate2
Sex ratio and mortality rate2
 
W. Trevor Smith Resume 2017
W. Trevor Smith Resume 2017W. Trevor Smith Resume 2017
W. Trevor Smith Resume 2017
 

Similar to HPF_III_Evaluation_Report_Final_2016

Ethiopia Health Sector Financing Reform/HFG: End-of-Project Report
Ethiopia Health Sector Financing Reform/HFG: End-of-Project ReportEthiopia Health Sector Financing Reform/HFG: End-of-Project Report
Ethiopia Health Sector Financing Reform/HFG: End-of-Project ReportHFG Project
 
Working paper-insights-from-the-south-african-experience-nov-2012 0
Working paper-insights-from-the-south-african-experience-nov-2012 0Working paper-insights-from-the-south-african-experience-nov-2012 0
Working paper-insights-from-the-south-african-experience-nov-2012 0Dr Lendy Spires
 
Working Paper Insights from the South African Experience
Working Paper Insights from the South African ExperienceWorking Paper Insights from the South African Experience
Working Paper Insights from the South African ExperienceDr Lendy Spires
 
Working paper-insights-from-the-south-african-experience-nov-2012 0(1)
Working paper-insights-from-the-south-african-experience-nov-2012 0(1)Working paper-insights-from-the-south-african-experience-nov-2012 0(1)
Working paper-insights-from-the-south-african-experience-nov-2012 0(1)Dr Lendy Spires
 
Marshalling the Evidence of Governance Contributions to Health System Perform...
Marshalling the Evidence of Governance Contributions to Health System Perform...Marshalling the Evidence of Governance Contributions to Health System Perform...
Marshalling the Evidence of Governance Contributions to Health System Perform...HFG Project
 
Building the Organizational Capacity of Health Systems Global: From Start-Up ...
Building the Organizational Capacity of Health Systems Global: From Start-Up ...Building the Organizational Capacity of Health Systems Global: From Start-Up ...
Building the Organizational Capacity of Health Systems Global: From Start-Up ...HFG Project
 
Capital Investment in Health Systems: What is the latest thinking?
Capital Investment in Health Systems: What is the latest thinking?Capital Investment in Health Systems: What is the latest thinking?
Capital Investment in Health Systems: What is the latest thinking?HFG Project
 
Transforming Health Systems Midterm Evaluation Report
Transforming Health Systems Midterm Evaluation ReportTransforming Health Systems Midterm Evaluation Report
Transforming Health Systems Midterm Evaluation ReportThe Rockefeller Foundation
 
Namibia 2012-13 Health Accounts: Statistical Report
Namibia 2012-13 Health Accounts: Statistical ReportNamibia 2012-13 Health Accounts: Statistical Report
Namibia 2012-13 Health Accounts: Statistical ReportHFG Project
 
Tech note belarus-fcp-dept-final
Tech note belarus-fcp-dept-finalTech note belarus-fcp-dept-final
Tech note belarus-fcp-dept-finalDr Lendy Spires
 
Desk Review- FCT Towards Attaining the Universal Health Coverage(UHC).pdf
Desk Review- FCT Towards Attaining the Universal Health Coverage(UHC).pdfDesk Review- FCT Towards Attaining the Universal Health Coverage(UHC).pdf
Desk Review- FCT Towards Attaining the Universal Health Coverage(UHC).pdfYouthHubAfrica
 
Public Financial Management, Health Governance, and Health Systems
Public Financial Management, Health Governance, and Health SystemsPublic Financial Management, Health Governance, and Health Systems
Public Financial Management, Health Governance, and Health SystemsHFG Project
 
HFG Rapid Assessment of TB Payment and PFM Systems in the Philippines: Lesson...
HFG Rapid Assessment of TB Payment and PFM Systems in the Philippines: Lesson...HFG Rapid Assessment of TB Payment and PFM Systems in the Philippines: Lesson...
HFG Rapid Assessment of TB Payment and PFM Systems in the Philippines: Lesson...HFG Project
 
Community-based Health Insurance Program in Ethiopia: Assessing Institutional...
Community-based Health Insurance Program in Ethiopia: Assessing Institutional...Community-based Health Insurance Program in Ethiopia: Assessing Institutional...
Community-based Health Insurance Program in Ethiopia: Assessing Institutional...HFG Project
 
A Rapid Assessment of Key Areas of the NHSSP for Timor-Leste: Strengths, Chal...
A Rapid Assessment of Key Areas of the NHSSP for Timor-Leste: Strengths, Chal...A Rapid Assessment of Key Areas of the NHSSP for Timor-Leste: Strengths, Chal...
A Rapid Assessment of Key Areas of the NHSSP for Timor-Leste: Strengths, Chal...HFG Project
 
HFG leaves a legacy of strengthened health systems management and oversight i...
HFG leaves a legacy of strengthened health systems management and oversight i...HFG leaves a legacy of strengthened health systems management and oversight i...
HFG leaves a legacy of strengthened health systems management and oversight i...HFG Project
 
Budget Tracking IsodecLearningSessionICCO15okt
Budget Tracking IsodecLearningSessionICCO15oktBudget Tracking IsodecLearningSessionICCO15okt
Budget Tracking IsodecLearningSessionICCO15oktICCO Cooperation
 

Similar to HPF_III_Evaluation_Report_Final_2016 (20)

Newsletter July 2015
Newsletter July 2015Newsletter July 2015
Newsletter July 2015
 
Ethiopia Health Sector Financing Reform/HFG: End-of-Project Report
Ethiopia Health Sector Financing Reform/HFG: End-of-Project ReportEthiopia Health Sector Financing Reform/HFG: End-of-Project Report
Ethiopia Health Sector Financing Reform/HFG: End-of-Project Report
 
Working paper-insights-from-the-south-african-experience-nov-2012 0
Working paper-insights-from-the-south-african-experience-nov-2012 0Working paper-insights-from-the-south-african-experience-nov-2012 0
Working paper-insights-from-the-south-african-experience-nov-2012 0
 
Working Paper Insights from the South African Experience
Working Paper Insights from the South African ExperienceWorking Paper Insights from the South African Experience
Working Paper Insights from the South African Experience
 
Working paper-insights-from-the-south-african-experience-nov-2012 0(1)
Working paper-insights-from-the-south-african-experience-nov-2012 0(1)Working paper-insights-from-the-south-african-experience-nov-2012 0(1)
Working paper-insights-from-the-south-african-experience-nov-2012 0(1)
 
Marshalling the Evidence of Governance Contributions to Health System Perform...
Marshalling the Evidence of Governance Contributions to Health System Perform...Marshalling the Evidence of Governance Contributions to Health System Perform...
Marshalling the Evidence of Governance Contributions to Health System Perform...
 
Building the Organizational Capacity of Health Systems Global: From Start-Up ...
Building the Organizational Capacity of Health Systems Global: From Start-Up ...Building the Organizational Capacity of Health Systems Global: From Start-Up ...
Building the Organizational Capacity of Health Systems Global: From Start-Up ...
 
Capital Investment in Health Systems: What is the latest thinking?
Capital Investment in Health Systems: What is the latest thinking?Capital Investment in Health Systems: What is the latest thinking?
Capital Investment in Health Systems: What is the latest thinking?
 
Transforming Health Systems Midterm Evaluation Report
Transforming Health Systems Midterm Evaluation ReportTransforming Health Systems Midterm Evaluation Report
Transforming Health Systems Midterm Evaluation Report
 
Namibia 2012-13 Health Accounts: Statistical Report
Namibia 2012-13 Health Accounts: Statistical ReportNamibia 2012-13 Health Accounts: Statistical Report
Namibia 2012-13 Health Accounts: Statistical Report
 
Tech note belarus-fcp-dept-final
Tech note belarus-fcp-dept-finalTech note belarus-fcp-dept-final
Tech note belarus-fcp-dept-final
 
Desk Review- FCT Towards Attaining the Universal Health Coverage(UHC).pdf
Desk Review- FCT Towards Attaining the Universal Health Coverage(UHC).pdfDesk Review- FCT Towards Attaining the Universal Health Coverage(UHC).pdf
Desk Review- FCT Towards Attaining the Universal Health Coverage(UHC).pdf
 
Public Financial Management, Health Governance, and Health Systems
Public Financial Management, Health Governance, and Health SystemsPublic Financial Management, Health Governance, and Health Systems
Public Financial Management, Health Governance, and Health Systems
 
HFG Rapid Assessment of TB Payment and PFM Systems in the Philippines: Lesson...
HFG Rapid Assessment of TB Payment and PFM Systems in the Philippines: Lesson...HFG Rapid Assessment of TB Payment and PFM Systems in the Philippines: Lesson...
HFG Rapid Assessment of TB Payment and PFM Systems in the Philippines: Lesson...
 
Community-based Health Insurance Program in Ethiopia: Assessing Institutional...
Community-based Health Insurance Program in Ethiopia: Assessing Institutional...Community-based Health Insurance Program in Ethiopia: Assessing Institutional...
Community-based Health Insurance Program in Ethiopia: Assessing Institutional...
 
9 core global-fund_strategy_en1
9 core global-fund_strategy_en19 core global-fund_strategy_en1
9 core global-fund_strategy_en1
 
9 core global-fund_strategy_en1
9 core global-fund_strategy_en19 core global-fund_strategy_en1
9 core global-fund_strategy_en1
 
A Rapid Assessment of Key Areas of the NHSSP for Timor-Leste: Strengths, Chal...
A Rapid Assessment of Key Areas of the NHSSP for Timor-Leste: Strengths, Chal...A Rapid Assessment of Key Areas of the NHSSP for Timor-Leste: Strengths, Chal...
A Rapid Assessment of Key Areas of the NHSSP for Timor-Leste: Strengths, Chal...
 
HFG leaves a legacy of strengthened health systems management and oversight i...
HFG leaves a legacy of strengthened health systems management and oversight i...HFG leaves a legacy of strengthened health systems management and oversight i...
HFG leaves a legacy of strengthened health systems management and oversight i...
 
Budget Tracking IsodecLearningSessionICCO15okt
Budget Tracking IsodecLearningSessionICCO15oktBudget Tracking IsodecLearningSessionICCO15okt
Budget Tracking IsodecLearningSessionICCO15okt
 

More from Asrade Abate

MTR 2013 Final Report
MTR 2013 Final ReportMTR 2013 Final Report
MTR 2013 Final ReportAsrade Abate
 
CMAM_Documentation_Report
CMAM_Documentation_ReportCMAM_Documentation_Report
CMAM_Documentation_ReportAsrade Abate
 
JRM_2014_Report_Final
JRM_2014_Report_FinalJRM_2014_Report_Final
JRM_2014_Report_FinalAsrade Abate
 
HPF_II_Evaluation_Report_of_the_Health_Pooled_Fund
HPF_II_Evaluation_Report_of_the_Health_Pooled_FundHPF_II_Evaluation_Report_of_the_Health_Pooled_Fund
HPF_II_Evaluation_Report_of_the_Health_Pooled_FundAsrade Abate
 
ConcernWorldwide_Endline_HEWs_Capacity_Assessment_RCT_Study_Final
ConcernWorldwide_Endline_HEWs_Capacity_Assessment_RCT_Study_FinalConcernWorldwide_Endline_HEWs_Capacity_Assessment_RCT_Study_Final
ConcernWorldwide_Endline_HEWs_Capacity_Assessment_RCT_Study_FinalAsrade Abate
 
HPF_II_Evaluation_Report_of_the_Health_Pooled_Fund
HPF_II_Evaluation_Report_of_the_Health_Pooled_FundHPF_II_Evaluation_Report_of_the_Health_Pooled_Fund
HPF_II_Evaluation_Report_of_the_Health_Pooled_FundAsrade Abate
 

More from Asrade Abate (6)

MTR 2013 Final Report
MTR 2013 Final ReportMTR 2013 Final Report
MTR 2013 Final Report
 
CMAM_Documentation_Report
CMAM_Documentation_ReportCMAM_Documentation_Report
CMAM_Documentation_Report
 
JRM_2014_Report_Final
JRM_2014_Report_FinalJRM_2014_Report_Final
JRM_2014_Report_Final
 
HPF_II_Evaluation_Report_of_the_Health_Pooled_Fund
HPF_II_Evaluation_Report_of_the_Health_Pooled_FundHPF_II_Evaluation_Report_of_the_Health_Pooled_Fund
HPF_II_Evaluation_Report_of_the_Health_Pooled_Fund
 
ConcernWorldwide_Endline_HEWs_Capacity_Assessment_RCT_Study_Final
ConcernWorldwide_Endline_HEWs_Capacity_Assessment_RCT_Study_FinalConcernWorldwide_Endline_HEWs_Capacity_Assessment_RCT_Study_Final
ConcernWorldwide_Endline_HEWs_Capacity_Assessment_RCT_Study_Final
 
HPF_II_Evaluation_Report_of_the_Health_Pooled_Fund
HPF_II_Evaluation_Report_of_the_Health_Pooled_FundHPF_II_Evaluation_Report_of_the_Health_Pooled_Fund
HPF_II_Evaluation_Report_of_the_Health_Pooled_Fund
 

HPF_III_Evaluation_Report_Final_2016

  • 1. Evaluation of the Health Pooled Fund (HPF-III) Asrade Abate, MD, MSc September, 2016
  • 2. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 2 | P a g e Table of Contents Executive Summary .............................................................................................................................4 Background ..............................................................................................................................................6 Objective s ................................................................................................................................................7 Methodo logy ...........................................................................................................................................8 Results .....................................................................................................................................................10 1.1. PARTICIPATION & DISBURSEMENT..................................................................................................10 1.2. DESIGN of HPF..................................................................................................................................12 1.3. PLAN, REQUEST & APPROVAL..........................................................................................................12 1.4. FUND UTILIZATION...........................................................................................................................13 1.4.1. System strengthening ...................................................................................................................14 1.4.2. Technical Assistance .....................................................................................................................14 1.4.3. Service Delivery.............................................................................................................................15 1.5. FUND ADMINISTRATION..................................................................................................................16 1.6. MONITORING AND EVALUATION.....................................................................................................17 Recommendations ..............................................................................................................................19 ANNEX I - References .......................................................................................................................21 ANNEX II – Que stionnaire-1 ..........................................................................................................22 ANNEX II – Que stionnaire-2 ..........................................................................................................24 ANNEX III – Memorandum of Understanding........................................................................25
  • 3. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 3 | P a g e Acronyms ADC Austrian Development Cooperation APR Annual Performance Report ARM Annual Review Meeting CSA Central Statistical Agency DCI Development Cooperation of Ireland DFID Department for International Development DP Development Partner EFY Ethiopian Fiscal Year EPHI Ethiopian Public Health Institution ETB Ethiopian Birr FMHACA Food, Medicine and Healthcare Administration and Control Authority FMOH Federal Ministry of Health GTP Growth and Transformation Plan HPF Health Pooled Fund HPN Health, Population and Nutrition HSDP Health Sector Development Program HSTP Health Sector Transformation Plan IC Italian Cooperation IHP International Health Partnership JCCC Joint Core Coordinating Committee JRM Joint Review Mission JSC Joint Steering Committee M&E Monitoring and Evaluation MCH Maternal and Child Health MDG Millennium Development Goals MDGPF Millennium Development Goals Pooled Fund MNCH Maternal, Newborn and Child Health MOU Memorandum of Understanding MTR Mid-term Review PFM Pooled Fund manager PFSA Pharmaceutical Fund and Supply Agency PPD Policy, Plan Directorate RHB Regional Health Bureau RNE Royal Netherlands Embassy SDG Sustainable Development Goals TAs Technical Assistants TOR Terms of Reference UN United Nations UNICEF United Nations Children’s Education Fund USD United States Dollar WBP Woreda Based Planning WHO World Health Organization WrHO Woreda Health Office
  • 4. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 4 | P a g e Executive Summary For about a decade, the Health Pooled Fund (HPF) had been supporting the implementation of HSDP II, HSDP III, and HSDP IV HSDP in three consecutive cycles. At the outset, the Health Pooled Fund was established to contribute to the fulfillment of the goals of the HSDP by supporting its implementation process through flexible, time-sensitive and less cumbersome funding mechanisms. At the time of its establishment, four development partners were involved namely: DFID, DCI, RNE, and UNICEF in July 2005 by contributing a total of 650,000 Euro. This evaluation was carried out to assess the performance of the HPF III in supporting the implementation of HSDP IV which lasted for four years, from 1st of July 2011 to 30th of June 2015. The evaluation covered the period July 2011 to June 2016 and was executed in accordance with standards and conformed to the guideline provided in the TOR. Initially, the consultant conducted desk review of relevant documents; develop appropriate tools for key informant interviews; and also conducted field visits relevant to the HPF-III. The data collected was analyzed using qualitative evaluation techniques covering the Health Pooled Fund’s activities as a whole and its entire operations. In this regard, this evaluation ascertained that design of the fund was fairly consistent with development strategy of stakeholders; the fund was logically flexible to finance the implementation of complex tasks relevant to HSDP; and representation by key DPs in the country was acceptable, but only a few members participated: Department for International Development, Italian Co-operation, Austrian Development Cooperation, and USAID. During implementation period of HPF-III, the total amount of fund inducted by all partners was $6,246,689.90. In comparison to the preceding round of HPF (HPF-II), a decline was observed in terms of number of contributors; and also fund absorption capacity. The average amount of fund, computed alongside the duration of the project, was roughly comparable with the preceding round. In fact, under normal circumstances, the HPF-III was anticipated to attract more partners and raise additional fund, or else stand no less. The decline in the number of DPs that subscribed to the fund was lesser due to a withdrawal action taken by previous contributors of the fund: Royal Netherlands Embassy, Development Cooperation of Ireland, as well as UNICEF. Conversely, a new partner, USAID, joined the scheme. In general, the benefits of HPF did commensurate with the inputs and remarkable achievements were observed. Through this fund, several important activities were supported including financing key events which profoundly contributed to improved outcomes and also amplifying the sector's inputs towards the GTP. In particular, the HPF-III was supporting the implementation of activities mainly focused on system strengthening; technical assistance; and service delivery and provision of resources for commissioning relevant studies on key health sector issues in Ethiopia. Among the core accomplishments of the HPF were HSS, ME, Capacity building, Planning, ARM, JSC, TA, and Operational Research. In addition, it helped to reduce regional inequalities of health; finance key policy dialogues to strengthen the health system through policy revision and finalization of HSTP; and supporting the Emergency Referral Initiative. The fund administration was flexible, swift and less cumbersome despite some challenges that imposed difficulty for flexibility. The fund administrator (UNICEF) had a close collaboration with the FMOH and also advised by the JCCC. The procurement of goods and services, administration of the contracts of consultants, rental of conference venues and transportation were carried out effectively. The
  • 5. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 5 | P a g e recruitment of TAs was, however, was not fully carried out by UNICEF due to challenges in rules and regulations related to procurement. With regard to challenges, this evaluation unveiled significant constraints in the course of unlocking the full potential of the fund. First and foremost, participation was low and significant contraction was noted in the number of prevailing contributing donors which eventually lead to shrinkage of finance availed through HPF account ensuing substantial funding gaps. Here, underlying factors implicated were retraction of previous HPF contributors; inadequate HPF relevant advocacy work; soft activism to convene subscription by new members; mild effort applied to increase resource mobilization from existing members; and irregularities as well delays in disbursement to the HPF account. On the other hand, a peculiar challenge was identified linked to fund absorption. The fund absorption capacity showed a declining trend along consecutive rounds of HPF implementations. Collectively, all three rounds of HPF necessitated arrangements for cost extensions resulting in stretched project periods. In fact, stumbling upon such occurrence didn’t improve over the years as was manifested by the performance of the HPF-III which run through recurrent cost extension and consultations with various HPF contributors. This declining trend, in turn, instigated holdup of scheduled disbursements, expiry of disbursed grants, call for cost extensions and rescheduling of project lifespan. Conversely, in view of the spirit and potential capacity of the fund, availed resources were only fairly adequate to sustain the progress of potential HSDP targets and relevant activities. Several recommendations have been presented in this evaluation so as to improve the performance of the fund. Among the core recommendations were updating the fund’s framework and broaden the scope of strategic areas; in-depth review of the MOU document with attention to its details by eliminating vague descriptions, adding more clarity and incorporating additional procedures with detailed criteria; improving the annual preparation of plans focusing on details of activities, precise budget allocation; strengthen the effort to conduct advocacy work and increase resource mobilization to pull additional funds; improve fund absorption by applying a strong effort during the planning process by incorporating passionate and invaluable HSTP objectives; hire appropriate number of staffs who will be exclusively assigned to facilitate fund’s operations; implement a tracking mechanism, using time- stamps placed on documents, in order to trace the overall fund request, approval and release process; share documentation of travel reports, relevant benefits and results timely; and in-depth discussion needs to be held with all partners regarding participation and continuity of the fund.
  • 6. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 6 | P a g e Background Within the framework of Ethiopia’s Action Plan of Harmonization and Alignment for Aid Effectiveness, the FMOH and the HPN Development Partners developed a Health Sector Harmonization Action Plan which was duly integrated into the successive Health Sector Development Program (HSDP III-IV). The establishment of a Health Pool Fund (HPF), as a means of support to the implementation process of HSDP, was agreed upon between the FMoH and development partners as part of the measures taken to implement the Health Sector Harmonization Action Plan. For about a decade, the Health Pooled Fund (HPF) had been supporting the implementation of HSDP in three consecutive cycles: HPF I, HPF II, an HPF III including the periods of cost extension. At the outset, the Health Pooled Fund was established by four development partners namely: Development Cooperation of Ireland (DCI), Royal Netherlands Embassy (RNE), and Department for International Development (DFID) and UNICEF in July 2005 by contributing a total of 650,000 Euro. The first round was implemented for about 1.5 years, (between July 2005 and December 2006); and the second round was implemented for 3 years (between July 2007 and June 2010). The third round of the HPF, for which this evaluation was carried out, supported the implementation of HSDP IV for four years, from 1st of July 2011 to 30th of June 2015. A summary of the rounds of HPF, implementation periods and also contributing partners and are depicted in the following sections. An independent evaluation have been conducted for the first and second round HPF and concluded that funds had been used for the purpose intended and that both FMOH and Development Partners had benefited from reduced transaction costs, flexible and swift responses for urgent needs. Based on the positive experiences with the two phases of the HPF and taking into account the recommendations of the evaluation, The United Kingdom, AusAID, Italian cooperation agreed to support the extension of the Health Pooled Fund (HPF-III) into a new phase of five years (2010/11 to 2014/15) in line with the HDSP- IV period. USAID also supported the HPF III activities with a separate grant agreement through UNICEF. The HPF III has been implemented since July 2011. The general objective of the HPF-III is to contribute to the fulfillment of the goals of the HSDP IV by supporting its implementation process through flexible, time-sensitive and less cumbersome funding mechanisms, in line with the Harmonization Action Plan of HSDP-IV and Growth and Transformation Plan (GTP I). As per the memorandum of agreement signed between the FMOH and contributing development partners, UNICEF administering health pool fund on behalf of the FMOH. To this end, the FMOH and the Joint Core Coordination Committee (JCCC) agreed to evaluate and document lessons from HPF III implementation. The JCCC gave mandate to UNICEF for issuance of contract for a consultant to conduct an independent evaluation on the benefit of the HPF-III, whether implementation was in line with international health partnership (IHP+) compact for aid effectiveness and as per agreed Memorandum of Understanding, and also to provide information for future policy decision.
  • 7. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 7 | P a g e Objectives The objective of the evaluation was to assess whether the Health Pooled Fund served its intended purpose; and document performances of the fund, challenges and make recommendations. The specific objectives of the evaluation included:  To assess the effectiveness and efficiency of HPF III in strengthening the capacity of FMOH in planning, budgeting, monitoring and evaluation of HSDP IV.  To assess its contribution in provision of technical assistance.  To evaluate its contribution in strengthening the service delivery.  To assess whether the HPF III has been implemented in line with the IHP+ compact.  To evaluate the governance mechanism of HPF III, the decision making process and “client” satisfaction (FMOH, HPF III administrator and development partners).
  • 8. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 8 | P a g e Methodology The evaluation covered the period July 2011 to June 2016. The evaluation was executed in accordance with standards and conformed to the guideline as provided in the TOR. The consultant conducted desk review of relevant documents; developed appropriate tools conducted key informant interview; and conducted field visits. The data collected was analyzed using qualitative evaluation techniques and in accordance with the objectives and targets specified in the TOR. The evaluation covered the Pooled Fund’s activities as a whole and its entire operations. Pre-evaluation steps: As part of the pre-evaluation activities, the following documents were reviewed: 1) Terms of reference (TOR) for the Health Pool Fund III Evaluation. 2) The Memorandum of Understanding (MOU) between DPs and the FMOH. 3) Relevant documents from Health Sector Development Plan (HSDP III and IV). 4) Health Sector Pooled Fund I and II, Final Evaluation Reports. 5) Minutes of JCCC meetings. 6) International Health Partnership (IHP+) compact for aid effectiveness. 7) Financial Statements and reports of HPF-III produced by UNICEF. 8) Annual reports on Health Pooled Fund III activities, through to June 2016. 9) Proposals of fund requests submitted to JCCC. 10) Payments policy guidelines and procurement rules and procedures. 11) Other supporting documents relevant to HSDP IV and HPFIII. Specific tasks in relation to the preparation for data collection and analysis consisted of developing tools to capture key aspects and interview guides for respective key interviews. During this evaluation, interviews were conducted with key informants from various stakeholders including government, HPF contributors, HPF administrator, JCCC members and other relevant stakeholders. A total of about 20 key informants were interviewed and the list of interviews conducted is provided in the table below. SN Key Informants - Institutions/ Development Partners (total of #20) Number of KIs 1 Federal Democratic Republic of Ethiopia, Ministry of Health (FMOH) 2  State Minister 1 3  FRM Directorate 1 4  Policy, Plan Directorate 1 5  HSS Directorate 1 6 Department For International Development (DFID) 1 7 Italian Co-operation(IC) 1 8 Austrian Development Cooperation (ADC) 1 9 USAID 1 10 The United Nations Children’s Fund in Ethiopia (UNICEF Ethiopia) 11  UNICEF Ethiopia Health Section Chief, and Health Specialist 1 12  UNICEF Ethiopia Health Pool Fund Administrators 3 13  UNICEF Regional Office Somali, Beninshangul Gumuz 2 14 JCCC Members and Organizations other than the HPF Donors 5 16 Client/contractor 1 Table 01: List of key-informants interviewed for this evaluation
  • 9. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 9 | P a g e For this evaluation, structured questionnaires were developed with a purpose of collecting data from FMOH, DPs, JCCC members, stakeholders and also consultants providing technical assistance for FMOH. The questionnaires were discussed with technical experts of UNICEF and comments obtained were incorporated. The questionnaires were prepared to reflect the performance of the fund using a standard qualitative evaluation approach. In general, the questionnaires constitute various performance indicators categorized under themes including overview, coherence, relevance, efficiency, sustainability, ownership, and potential impact of the fund. Through this approach the various achievements of the HPF; effectiveness and efficiency; fund administration (flexibility, speed, transparency, accountability, cumbersomeness); level of advocacy; planning, monitoring and reporting were among the major parameters that were taken up in the process. The questionnaires are annexed with this report. All of the questionnaires were administered by the consultant through face to face in-depth interviews and discussions.
  • 10. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 10 | P a g e Results In summary, the three round of HPF were implemented for about 1.5 years, (between July 2005 and December 2006); 3 years (between July 2007 and June 2010); and 4 years (1st of July 2011 to 30th of June 2015) respectively. The summary of rounds, implementation periods and also contributing partners are depicted in the table below. 1.1. PARTICIPATION & DISBURSEMENT In HPF III, a total of four DPs were able to join at the onset and contribute to the fund: Department for International Development, Italian Co-operation, Austrian Development Cooperation, and USAID. The first three partners signed the MOU directly with the FMOH and disbursements by these partners were merged, as unified contribution of the HPF-III, and availed through the Health Pooled Fund account. However, the fourth partner (USAID) joined the fund by signing a bilateral agreement with UNICEF, delegated by FMOH and in line with the spirit, framework and clauses of the Joint MOU. Thus, disbursements from USAID were managed separately. AusAID was able to disburse only once. HPF (rounds) Period (start) Period (end) Years Partners (count) Utilization (%) Remarks HPF I Jul 1, 2005 Dec 30, 2006 1.5 4 85.1% with cost extension HPF II Jul 1, 2007 Jun 30, 2010 3 6 32.9% with cost extension HPF III Jul 1, 2011 Jun 30, 2015 4 3 34.3% with cost extension Table 02: Duration, performance & utilizationof rounds of HPFsover a decade of implementation. The opening disbursements for HPF-III, sum of grant contribution that corresponds to an amount of USD $1,337,458.00, were received by the 30th of June 2012 from DFID, AusAID and IC. During implementation period of HPF-III, the total amount of fund inducted by these three partners was $4,106,689.90. As of 15th of December 2015, all funds inducted by these three partners have been utilized though full exhaustion lingered behind the HPF-III schedule. The table below exhibits detailed information on annual disbursements and fund utilization. Development Partners 2011/12 (EFY04) 2012/13 (EFY05) 2013/14 (EFY06) 2014/15 (EFY07) 2015/16 (EFY08) Total [per partner] DFID 703,125.00 294,370.00 563,463.64 608,766.23 0.00 2,169,724.87 IC 133,333.00 0.00 375,469.34 0.00 0.00 508,802.34 AusAID 501,000.00 516,530.00 410,632.69 0.00 0.00 1,428,162.69 USAID 0.00 0.00 0.00 0.00 2,140,000.00 2,140,000.00 Total [per year] 1,337,458.00 810,900.00 1,349,565.67 608,766.23 2,140,000.00 Grand Total 6,246,689.90 Utilization (%) 34.3% Table 03: The contributions by individual partners from July 2011 – December 2015
  • 11. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 11 | P a g e Unlike the grants received by aforementioned partners, the USAID grant was managed separately and also received late. In particular, USAID disbursed a two series grant with cumulative sum of USD $2,140,000.00. The initial USAID grant was inducted on January 1, 2015 with an expiry date of grant set to end of June 2016. Of which, the amount utilized by 29th of February 2016 was USD $857,253.57, leaving the unspent balance of USD $1,282,746.43. Obviously, utilization of this particular grant was also behind the schedule vis-à-vis the stipulated duration of the HPF-III. In comparison to the preceding round of HPF (HPF-II), a decline was observed in terms of number of contributors; and also fund absorption capacity. In contrast, the HPF II was able to draw in six partners with a total disbursement of $3,769,368.08. The average amount of fund, computed alongside the duration of the project, was roughly comparable with the preceding round. In fact, under normal circumstances, the HPF-III was anticipated to attract more partners and raise additional fund, or else stand no less. The decline in the number of DPs that subscribed to the fund was lesser due to a withdrawal action taken by previous contributors of the fund: Royal Netherlands Embassy, Development Cooperation of Ireland, as well as UNICEF. Conversely, a newer partner, USAID, joined the scheme in HPF-III. Nonetheless, this evaluation unveiled significant constraints in the course of unlocking the full potential of the fund. First and foremost, participation was low and significant contraction was noted in the number of prevailing contributing donors which eventually lead to shrinkage of finance availed through HPF account ensuing substantial funding gaps. Here, underlying factors implicated were retraction of previous HPF contributors; inadequate HPF relevant advocacy work; soft activism to convene subscription by new members; mild effort applied to increase resource mobilization from existing members; and irregularities as well delays in disbursement to the HPF account. In fact, the funding gaps were filled up by donors as well as the fund manager (UNICEF), nonetheless, impacts from these gaps were not negligible. Occasionally, donors were asked to step up disbursements in advance of the actual schedule. In other instances, the fund administrator was urged to inject money in to the HPF account which was reclaimed from disbursements made later in the course. On the other hand, a peculiar challenge was identified linked to fund absorption. The fund absorption capacity showed a declining trend along consecutive rounds of HPF implementations. Collectively, all three rounds of HPF necessitated arrangements for cost extensions resulting in stretched project periods. In fact, stumbling upon such occurrence didn’t improve over the years as was manifested by the performance of the HPF-III which run through recurrent cost extension and consultations with various HPF contributors. This declining trend, in turn, instigated holdup of scheduled disbursements, expiry of disbursed grants, call for cost extensions and rescheduling of project lifespan. Conversely, in view of the spirit and potential capacity of the fund, availed resources were only fairly adequate to sustain the progress of potential HSDP targets and relevant activities. Figure 1: HPF-III contribution by DPs between 2011 & 2015
  • 12. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 12 | P a g e Partners •Disburse FMOH •Utilize JCCC •Monitor UNICEF •Admin Partners • Disbursement • DFID • USAID • AusAID • IC FMOH • Utilization • Plan • Review • Approval JCCC • Monitoring • Review planning • Endorsement UNICEF • Administration • Procurment • Effect Payment • Report utilization 1.2. DESIGN of HPF In line with the purpose of the HPF-III, its design was crafted to allow partners to contribute to the fulfillment of goals of the HSDP by supporting the implementation process through flexible, time- sensitive and less cumbersome funding mechanisms that reduces transaction costs. In this regard, this evaluation ascertained that design of the fund was fairly consistent with development strategy of stakeholders; the fund was logically flexible to finance the implementation of complex tasks relevant to HSDP; and representation by key DPs in the country was acceptable, but only a few members participated. The funding scheme was praised by most respondents as the best approach for planned targets with superior performance compared to other alternatives covering similar agendas. In comparison, the HPF III had also learnt from previous rounds of the fund, applied the experiences and progressed very well. Consequently, through the HPF III, several important activities relevant to HSDP were accomplished and notable achievements were recorded. Yet, most respondents have foreseen a higher performance capacity through the fund by unleashing its full potential. The contracted span of HPF objectives and strategic areas; little dynamism of annual plans alongside activities; elusiveness of MOU as well as openness for interpretation; insubstantial and unclear linkage between activity plans and outputs; and strict requirements for tight financial audit by contributing partners were some of the significant bottlenecks relevant to the design. These constraints were also found to be among the prominent factors that slowed down potential partners so as to sign up and join the HPF, as well, played essential role in relation to withdrawal action taken by previous key HPF partners. 1.3. PLAN, REQUEST & APPROVAL In accordance with the provisions of the HPF’s MOU, core duties and responsibilities were shared among partners. In general, the core tasks were scheduled disbursements of grants; annual synthesis of activity plans with commendation, submission, review and approval of funding requests; endorsement of approvals for fund release; effecting fund release and procurement; and monitoring. Scheduled disbursements to the HPF account were effected by Development Partners (DPs); the FMOH synthesized annual plans, reviewed funding requests and made approvals; fund utilization was monitored by the JCCC; and procurement was effected through UNICEF, to which fund administration was entrusted. Figure 2: Activity Cycleof disbursing, utilization, monitoring, and administration process.
  • 13. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 13 | P a g e In detail, a series of steps and procedures were undertaken in the implementation process. The FMOH, the owner of the fund, was responsible for synthesis of annual activity plans, particularly the PPD of the FMOH was in charge of developing the annual activity and expenditure plans. In compliance, synthesis of annual activity plans; request processing; and approval for fund release was carried out by FMOH. In the beginning of each Ethiopian Fiscal Year, each annual activity plan was presented to the JCCC and discussed. The JCCC scrutinized presented plans; ratified if expenditures were within the limits; and finalize the documents to produce a jointly approved annual activity and expenditure plan. The plan was fairly detailed, timely and most fund requests were in accordance with the objectives. In the course of fund discharging, subsequent to endorsement of the annual plan, the fund request, review and approval process comes in to view which requires a series of steps and clearances that need to be undertaken. In brief, the process consists of preparation and /or receipt of various proposals for funding; review of proposals and approval by the FMOH; presentation of approved requests to the JCCC for endorsement. The JCCC was assigned to monitor the implementation of activities ensuring appropriate and efficient use of the fund in the spirit of its purpose. In particular, JCCC’s endorsement was required for a special set of funding requests: those beyond the annual plan or those that exceed the agreed budget by more than 10%. In most instances, routine requests were processed in accordance with the joint annual plan and on the fly approved by the FMOH itself. However, expenditures that surpass the cost ceiling of 10% were reviewed by JCCC before execution. Fund discharge was initiated upon submission of approved requests by FMOH. The submission should be accompanied by a complete documentation including written authorization for payment by FMOH and sometimes proof of endorsement by JCCC, particularly minute recordings, where applicable. Commonly, the preparation of annual plan was customary and predictable. Mainly, this was due to lack of flexibility to accommodate additional strategic areas, objectives and also initiatives. Compared to potential activities that need to be invested on, the planning process was only fairly adequate, but not passionate. Indeed, the plan didn't match up to the fund availed; thus, resulting in late and low fund exhaustion. The review also unraveled that individual users were not well acquainted with the purpose of the fund. For instance, TAs who were hired through the HPF were found to have scanty knowledge about the fund; most HPF users at FMOH were not aware of steps and procedures for fund approval; and frequent complaints were received by UNICEF regarding low DSA scales. These instances signify the low level of advocacy conducted about purpose, features and values of the HPF. 1.4. FUND UTILIZATION In general, the benefits of HPF did commensurate with the inputs and remarkable achievements were observed. Through this fund, several activities were financed including important events which profoundly contributed to improve outcomes and also amplify the sector's inputs towards the GTP. In particular, the HPF-III was supporting the implementation of activities focused on system strengthening, technical assistance and provision of resources for commissioning relevant studies on key health sector issues in Ethiopia. Among the core accomplishments of the HPF III were HSS, ME, Capacity building, Planning, ARM, JSC, TA, Gap filling; HSDP priorities, and Operational Research. In addition, it helped to reduce regional inequalities of health; finance key policy dialogues to strengthen the health system through policy revision and finalization of HSTP; supporting Emergency Referral Initiative which facilitated inter-facility referral for 6,188 laboring mothers, neonatal cases and other emergencies. The HPF was owned and managed by the FMOH. Unlike other similar schemes, the HPF III maintains a unique advantage, offering a great space for flexibility, to support enormous investments through HSDP and beyond.
  • 14. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 14 | P a g e 1.4.1. System strengthening In brief, core accomplishments in this category were: M&E activities including HSDP-IV reviews (Mid- Term-Review), Joint Review Mission (JRM), and Policy Dialogue Workshops. The HPF III sponsored several events and availed the platform for exchange of views among participants; enabled common understanding on various agendas; in-depth analysis of performance reports, progress made and constraints identified; and endorsement of upcoming plans and initiatives. Of which, the Health Sector Annual Review Meeting (ARM), and Joint steering Committee (JSC) were events of prime significance uninterruptedly funded through the HPF. The ARM, a regular annual meeting, convened more than a thousand participants across-the-board including health institutions and other relevant stakeholders (universities, partners, NGOs, civil societies, associations). Similarly, the JSC, a performance monitoring and evaluation summit that summoned managements of FMOH, Agencies and RHBs, had been financed through the HPF on a quarterly basis. Particularly, the ARM session enabled participants grasp the opportunity to openly debate and understand various agendas; conduct focused exchange of views on presentations; and forward inputs for further improvement. Further, these events strengthened coordination and partnership among government, donors and stakeholders; and help review individual performance level equated to national average. Besides, Woreda-Based Planning (WBP) and supportive supervisions, mostly financed through the HPF, had contributed to strengthening the capacity of Woreda health offices. In addition, the fund was utilized to finance capacity building activities through provision of training and also sponsoring policy makers and key implementers to obtain transnational exposure and sweeping experiences in various areas including health policy. As such, the HPF financed participants on local and international conferences to acquire updated information and evidence that could be adapted to local context. Especially, the benefits of travel, mainly international travel, were multifold: experience sharing, bringing innovations home, and country image building were among the core advantages. Besides, Ethiopia was also able to contribute to key global debate and dialogue on contemporary health related issues and to engage with international development partners. 1.4.2. Technical Assistance One of the key objectives of the HPF III was the recruitment of Technical Assistants (TAs) with the aim to provide support to the health system, particularly the implementation of HSDP IV at various levels. These included capacity building of staff in various directorates at the FMOH, Agencies, and regional bureaus; and also coordinate and assist regions that require specialized support. Indeed, the HPF had been the principal fund that provided resources to finance salaries, top-ups and hardship allowance for international and/or national consultants. In this regard, a total of about 77 consultants were hired. Of the 77 technical assistants, about 25 (32.4%) technical assistants were working in different directorates in FMOH and PFSA where specific needs for technical support had been identified, particularly IT, audit, procurement, policy related research, and grant management. For instance, at the FMOH, the TAs delivered specialty service by providing technical assistance to strengthen the audit and procurement process at the Finance and Procurement Directorate, particularly the Grant Management Unit. On the other hand, 34 (42.4%) of the TAs were deployed to four regions which required special support: Somali (14), Afar (7), Gambella (6) and Beninshangul Gumuz (5). These TAs were placed in offices at regional, zonal and Woredas level and delivered their support focusing on initiating equity responses and also accelerating the performance of HSDP IV in those specified regions. By the end of 2015, about 32 technical assistants, assigned to regions, continued their service. As marked by various reports, the
  • 15. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 15 | P a g e principal areas of engagement of these TAs, particularly at regions included provision of training for health workers; participation in design and development of documents and guidelines; support the enhancement of service utilization; provision of system strengthening and M&E support; contributions towards health facility infrastructure development and equipping; and also supporting the response to emergencies in relation to the drought. The deployment of TAs was effected as per the 2014 agreement between FMOH and UNICEF. In compliance with the agreement, the TAs were recruited and deployed to regions by FMOH and UNICEF payed their top-up and hardship allowance upon submission of payment request and performance report. A few complaints were identified with regard to delayed payments of salaries, but the issue required in-depth investigation in order to identify underlying causes. 1.4.3. Service Delivery The fund was applied in the implementation of cutting-edge initiatives including the Emergency MNCH Referral Initiative. Thus, several hospitals received the assistance targeted to improve referral and provision of emergency medical service in Addis Ababa. FMOH deployed 13 (16.8%) health providers to facilities handling emergency issues and referral services in public and private hospitals. Likewise, four technical assistants, hired through the HPF, were deployed to Tikur Anbessa Specialized Hospital (TASH) with the aim to support the human resource management and procurement service. In addition, the fund was also utilized for development of standards, guidelines and manuals; and also assisted the emergency response for draught management. In terms of utilizations, core challenges were low fund absorption, late fund exhaustion and recurrent cost extensions. Thus far, by the end of this evaluation, a significant amount of untapped money was seen deposited in the HPF account. Possibly, underlying factors that contributed to inefficient fund utilization were contraction of HPF III objectives, limited scope of funded HSDP IV targets, low-key planning that didn’t conform to fund availed through the HPF III; underutilization of budget in some proposed targets; and inadequate fund allocation to certain activities which were often overlooked. On the contrary, over expenditures were noticed, in projects like ARM. Respondents compared the value- for-money in such over expenditures weighed against other HSDP priorities. The eligibility of travels was one of the most emphasized and heavily criticized agenda by respondents during this assessment; consequently, several critiques were stipulated by respondents as equated to its benefits. Along these lines, several challenges associated with expenditure, management and cost control for international travel were identified. One of the major issues specified was in relation to the measurability of outputs correlated with travels. Conceivably, the critiques were backed by citations of shortcomings linked to outputs of travels. In most cases, travel narratives and relevant outcomes were improvised or not shared by travelers upon return. Even for few reports collected from travelers, the narratives were incomplete and unarticulated; and lack description on objectives and relevant details. In a few cases, the purpose of travels was not credible to a certain extent whilst it could have been financed by the FMOH itself. This specific challenge was cited as a key factor that attributed to the withdrawal of DPs who question the eligibility of travels compared to other priorities. In addition, other challenges include the utilization of HPF III funds as first hand option for overhead expenditures; and also little activism to explore alternative sources of funding to cover administrative costs where applicable. Implementation delays were also noticed mainly due to delayed disbursement of contributions; lengthy process in the course of deployment of Technical Assistants (TAs); delayed submission of expenditure requests; and also incomplete documentation resulting in delayed settlement
  • 16. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 16 | P a g e of payments. Challenges specified with regard to TAs include increased turnover, vague scope; outdated guideline and absence of exit strategy despite the rising number of TAs. 1.5. FUND ADMINISTRATION In terms of accountability, duties and responsibilities adopted by UNICEF during the implementation period of the HPF were multifold: contributing partner; fund administrator; and also a delegate for FMOH in various instances. Until the completion of this evaluation, UNICEF was assigned as the sole administrative manager of the HPF on behalf of the FMOH for all the three rounds of the HPF. As such, UNICEF was delegated to administer the HPF-III on behalf of the FMOH. The rationale for the fund’s separate management was to facilitate a swift and flexible procurement; thereby remove administrative burden of these tasks from FMOH and expedite the implementation of HSDP. An operational fee of 7% was deducted, from each disbursement, for administration costs incurred by UNICEF. This review observed that the charged fee was within acceptable limits. In fact, the fee was smaller when compared to operational fee claimed by others for managing similar operations. The fund operations were run in consultation with the JCCC’s instructions and in accordance with UNICEF’s regulations, directives and procedures. Accordingly, UNICEF received disbursements from DPs and stored the fund in a special account. Since grants were received in various currency formats (USD, Euro, and Pound), the United Nations operational rate of exchange was applied to convert the grants into United States Dollars based on exchange rates on the date of receipt. Overall, the Fund administration was flexible, swift and less cumbersome despite some challenges that imposed difficulty for flexibility. In this regard, all travel related requests were executed on time despite the presence of several late hour requests. Besides, UNICEF waived the required procedures for travels made by high-ranking officials and arranged “No Clearance” special travel plans that affirm with relevant protocols of the officials. Procurements were effected upon receipt of official authorization signed by PPD/FMOH; and accompanied by relevant supporting documents. The fund administrator had a close collaboration with the PPD/FMOH and also advised by the JCCC. The procurement of goods and services, administration of the contracts of consultants, rental of conference venues and transportation were carried out effectively. The procurement process was fairly in line with the rules and regulations of UNICEF; in compliance with the agreed terms of the MOU; and also consistent with internationally accepted practices to ensure value for money. UNICEF possesses a well-established and advanced fund management system used by various customers worldwide and also earned a huge trust from several partners globally. UNICEF provided high caliber staffs, adequate service and a reliable procurement system for the amount charged. Besides, several urgent tasks presented to UNICEF on short-notice were handled well. The fund management by UNICEF’s had recognizable benefits attributed to UNICEF's global collaboration as well as affiliation with various businesses and services providers; acclaimed reputation for collaboration with various development partners; and also the established technical capacity and input by the high caliber staff. The financial administration process was subjected to auditing procedures, both internal and external, by employing regulations, rules, directives and procedures applicable to UNICEF. As such, most partners mentioned that they have full confidence and trust since the fund is administered by UNICEF. During the implementation period of HPF III, UNICEF communicated and shared information with the FMOH, JCCC and partners on several issues and also advised partners of the decision in that regard including date of scheduled disbursements; status of expenditures; and inadequacy of funds in the HPF
  • 17. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 17 | P a g e account. In a few occasions, particularly when the balance in the HPF account was insufficient to make scheduled disbursements, UNICEF filled the gaps and made disbursements in consultation with the JCCC. In addition, UNICEF also presented valuable feedback to the FMOH including progress of activities and cautionary notes on pending activities; alerts pertaining to grant expiry; and also encouraged on time budget utilization. In the procurement process, the fund administrator claimed several challenges, principally complexity of assignments and increased workload. In this regard, several factors were identified that attributed to challenges. Requests did not adhere to agreed conditions for fund administration or were not in accordance with the HPF's procedures as stated in the MOU. The most frequent barriers in fulfilling the required pre-requisites consisted: incomplete documents (Incorrect names, dates), 11th hour requests, ineligible requests, unauthorized requests, and detoured requests. Urgency coupled with detoured requests (bypassing the sequence of approval) was one of the most frequent challenges observed in certain cases. Travel requests were mostly delivered to UNICEF shortly before due time, but achieved by UNICEF's staff who committed after-hours work. Complaints were heard from staff due to after-hour workloads and urgency of certain tasks which put the staff under pressure. On the other hand, prominent communication gaps were identified between the record and registration office and UNICEF causing delayed arrival of approved requests to UNICEF. The late arrival of requests was mostly due to lags at record unit at FMOH while delivering the required documents. Sometimes, UNICEF received employment and payment documents from TAs themselves by hand. With regard to payment of TAs, challenges were due to submission of payment requests for cumulative number of months allied with large number of newly hired consultants. In addition, unavailability of standalone staff exclusively assigned for the task in FMOH was aggravating factor. Perhaps, JCCC overlooked the idea of hiring adequate staffs exclusively for managing the fund despite requests were presented to JCCC. UNICEF undertakes various audits, both internal and external audits including those by MOFED. In this regard, there were requests that did not comply with UNICEF's financial rules and procedures for fund management. Similarly, some of these requests did not comply with financial rules and procedures of MOFED. By the end of this evaluation, UNICEF's upgraded its financial regulations and a new procedure called VISION is instigated which requires additional steps. Thus, fund release process is expected to take additional steps. 1.6. MONITORING AND EVALUATION The Joint Core Coordinating Committee (JCCC), composed of members from the Federal Ministry of Health and HPN Partners, was chaired by the Head of the Policy, Planning Directorate of the Ministry of Health. The Committee was delegated the responsibility to endorse annual HPF-III activity and expenditure plans; monitor the fund's appropriate and efficient utilization; and also advise on the procurement of goods and services. Exclusive of oversight by the UNICEF’s system itself, the fund administration was observed through layers of monitoring schemes and robust monitoring activities were performed. These include detailed reports of expenditures linked to themes were summited and reviewed on regular basis; Value-For-Money (VFM) was scrutinized with in-depth inspection for particular expenditures and items tagged under reservations; and also auditing was conducted by MOFED and external auditors.
  • 18. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 18 | P a g e Furthermore, activity plan and achievements were tracked; details of all expenditures were monitored regularly through presentation of reports by UNICEF; as well individual DPs were able to monitor contributed grants with respective detailed expenditure statements for each projects effected. Expenditures greater than 10% of the plan were discussed and fund release was granted as observed from recorded minutes of the JCCC meeting. The contribution to draught management; the new initiative of Emergency MNCH Referral; and ARM expenditures were among the biggest issues discussed during the meetings. In accordance with the MOU, the fund administrator submitted regular reports including brief summary of the activities and narrative to the JCCC, individual donor reports, and also periodic financial utilization progress update reports. As such, semi-annual/annual utilization and progress updates reports were submitted by UNICEF. In addition, UNICEF submitted individual reports to partners on particular grant utilizations, details of expenditures, and also exhaustion. The reports were reviewed and endorsed by the JCCC and were circulated to the donors. By the end of each round of HPF, the JCCC coordinated an independent final evaluation of the fund, contracted and executed by UNICEF. Information exchange was fair among the partners; minutes of the JCCC were circulated, and progress updates were shared. The monitoring activity by the JCCC was fairly challenged due to emergence last-minute consultations for endorsement of expenditures for which FMOH had authorized execution. One such example, intensely debated by the JCCC due to unusually high cost, was the cost allocated to preparation of the ARM for the year 2015. To this end, the governance procedures were fairly transparent; and HPF was modestly representativeness and inclusive of key development partners. With regard to sustainability, outcome linked to the planning and monitoring components of the HPF objectives have a tendency to endure.
  • 19. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 19 | P a g e Recommendations Design and Framework of HPF The fund’s framework should be updated to broaden the scope of strategic areas and enrich respective activities in such a way that it keeps a room to accommodate more objective, themes and activities on top of existing ones. Hence, it equates with development strategy of partners; enable FMOH to fast- track important HSTP activities; and catches the attention of DPs and draws them to the partnership. The fund’s design should also incorporate more transparency aimed at achieving Value-for-Money. Memorandum of Understanding The MOU document needs in-depth review with attention to its details by eliminating vague descriptions and adding more clarity so that it evades potential ambiguities and interpretations. Further, the MOU should be redecorated by incorporating additional procedures with detailed criteria in order to classify expenditures in to groups. For instance, potential expenditure groups could consist of: allowed expenditures; expenses not eligible to be funded through HPF; administrative expenses; and routine expenses. As such, the procedure will help to regulate limits and cost thresholds of prospective procurements in each of these identified groups. Boundaries should be made to control the number of travels and also set eligibility criteria to varieties of travels allowed as could be grouped by classes of travels (local/international) and respective themes and objectives. In addition, the MOU should create a room to adjust and be inclusive of procedures of participating partners. Annual Plan of HPF Annual preparation of plans should focus on details of activities; precise budget allocation and forecasting; inclusion of activities pertinent to HSTP targets; and inclusion of OR at the heart of the design so that it informs and strengthens policy formulation and decision making. The synthesis of proposals and activity plans should clearly show the linkage between objectives and anticipated results asserting with the VFM. Resource Mobilization The FMOH should strengthen its effort to conduct additional resource mobilization and pull additional funds, particularly from existing HPF partners. This could be accomplished by conducting robust advocacy relevant to HPF and should be highly emphasized since the benefits are multifold. On one hand, the promotion will attract additional contributing partners to the scheme which simultaneously opens the door to pull resources; and boost number of grants and amount disbursed to the HPF account, thereby it widens the potential to invest in more strategic areas. On the other hand, the advocacy will help recruit more fund recipients, stakeholders including RHB and agencies, to utilize the resource availed through the HPF. As such it minimizes the persisting challenge of low and late fund absorption; as well help secure additional strength from the recipients to partake and push the HSTP agenda further. The HPF should also consider contributions from partners not only in terms of finance but also seek for technical and other kinds of supports. Fund Utilization, Monitoring and Reporting The fund should be utilized to support projects that couldn't be funded through other schemes. Meaning, apply HPF as a primary source for financing cross-cutting issues and also monitor project activities through operational researches. As such, the annual plans should allocate adequate funding for operational researches; evidence-based implementation/monitoring; and also encourage submission of such proposal. On the contrary, the HPF should be set as the last option to resort to when other
  • 20. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 20 | P a g e alternative funds are unavailable, particularly for administrative costs. As a substitute, the FMOH should seek own and alternative resources instead of HPF as a firsthand pick. The FMOH should discuss important matters with the JCCC before approval of requests, particularly in relation to the VFM. The JCCC, in this respect should also closely monitor the VFM. Co-chairing by partners should be considered to allow fair fund approval process. In addition, detailed documentation of travel reports, relevant benefits and results should be timely shared by the travelers up on arrival. In line with this, the HPF should be praised and promoted for its benefits, particularly in relation to travels. Fund Administration Improve fund absorption by applying a strong effort during the planning process by incorporating passionate objectives; evaluating requests in accordance with the annual plan; executing proposed projects promptly; and conforming to agreed terms and conditions for fund utilization. The plan should also incorporate appropriate project milestones and/or log-frame that should be shared among partners. The fund administrator has been regarded and also found highly valuable in the spirit of managing the fund as per the agreed terms and condition. Further, UNICEF was found to have a credible amount of trust from partners; and hence, played on as a check and balance party between partners and FMOH. Hire appropriate number of staffs who will be exclusively assigned to facilitate fund’s operations. In this regard, the evaluation results suggested the deployment of three staffs that will be financed through the HPF: Fund management consultant at the FMOH); and two Administrative Assistants who will work to facilitate the fund request at the FMIOH and UNICEF. Besides, a tracking mechanism needs to be set using document time-stamps so as to trace the overall fund request, approval and release process. Continuity and Sustainability of HPF In-depth discussion needs to be held with all partners regarding participation and continuity of the fund. In addition, the discussion should also explore possible causes for partners’ withdrawal action from the HPF; and consult with the partners to re-assess their status. Also, HPF needs to adapt to unanticipated changes of funding by seeking interim solutions when partners face challenges, as in reduction of funding level. Thus, the FMOH should establish a system to address funding fluctuations through revision of plans, adjusting expenditure level and also try to find alternative approaches and sources. In the end, some documents and procedures need to be updated. These include updating the HPF’s design framework, MOU and objectives by incorporate additional strategic. In addition, standard templates will be required for fund request process; log system to track document transmission and submission; and also travel arrangement.
  • 21. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 21 | P a g e ANNEX I - References 1. Health Sector Development Plan and Performance Reports (HSDP III, HSDP IV). FMOH, Addis Ababa. 2. Health Sector Pooled Fund Evaluation Report. HPF Evaluation Team, April 2007, Addis Ababa. 3. Health Sector Pooled Fund Evaluation Report. Asrade Abate, Aug, 2010, Addis Ababa. 4. Annual Report of Performance of Health Pooled Fund III. UNICEF, Aug, 2012, Addis Ababa. 5. Annual Report of Performance of Health Pooled Fund III. UNICEF, Oct, 2013, Addis Ababa. 6. Annual Report of Performance of Health Pooled Fund III. UNICEF, Aug, 2014, Addis Ababa. 7. Annual Report of Performance of Health Pooled Fund III. UNICEF, Sep, 2015, Addis Ababa. 8. Annual Report of Performance of Health Pooled Fund III. UNICEF, Dec, 2015, Addis Ababa. 9. Mini Ethiopian Demographic Health Survey. Central Statistical Agency, 2014, Addis Ababa.
  • 22. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 22 | P a g e ANNEX II – Questionnaire-1 Code#: ________________ Full Name: ______________________ Organization: _______________________ Position: _______________________ Involvement: _________________________ A. Partners’ Participation 1) Did your organization participate in the design and/or implementation of the HPF? 2) What was your organization’s financial contribution to the HPF? 3) Why didn’t your organization participate in HPF III? 4) Did your organization play any role in promoting HPF among stakeholders? B. Scope, Objectives, & Design 5) What is your opinion on the scope of HPF? (Adequacy of fund, and Eligible areas of funding) 6) Were HPF’s time lines, milestones and targets appropriate? 7) Were there any shortfalls in the design of the HPF? 8) Was the work of HPF consistent with development strategy of its principal stakeholders? 9) Did members and donors in the HPF represent the key partners in the country? 10) Were all contributions DPs received on time and according to the disbursement schedule? a) What were the causes for the delay? b) What measures were taken by donors to manage the funding gap? c) Were resources adequate to sustain progress? 11) Do you consider the JCCC to be inclusive in terms of members? 12) Were the structure, role, authority and interactions with governance bodies appropriate? 13) Were governance procedures of HPF adequate in terms of transparency and objectivity? C. Plan, Use & Management 14) Did the FMOH has annual expenditure plan for appropriate and efficient utilization of HPF? 15) Did the FMOH follow standard procedures to authorize execution of plans? 16) Did the FMOH ensure appropriate and efficient use of the fund in the spirit of its purpose? a) Value for money (VFM)? b) Utilization within the limits of its budget? c) Activities not being part of the Annual Plan/exceed the agreed budget? 17) Were all the required procedures adhere to upon request for spending? 18) Were all requests made, received and executed in line with HPF’s proposal? 19) How much time does UNICEF take, on average, to process an authorized spending? 20) What were contributions of UNICEF to the fund?
  • 23. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 23 | P a g e 21) What’s your opinion about UNICEF to put charge on DPs for 7% operational fee? 22) What was the workload of the HPF on UNICEF? 23) Do you think human resource allocated by UNICEF is adequate for managing the fund? 24) Why JCCC did overlooked the idea of hiring staffs, exclusively for the purpose of managing the fund? 25) Were there procedures against UNICEF’s regulation for procurement? 26) Do you think administration/management of HPF should be continued by UNICEF? D. Outputs / Outcomes 1) Were benefits of HPF commensurate with inputs in terms of cost, time and effort? 2) Was HPF a viable option for strengthening implementation of HSDP IV? 3) What has been the value-added of the HPF to support implementation process of HSDP IV? 4) What was HPF’s comparative advantage relative to alternatives covering similar issues? 5) What were the major contributions of the HPF in the implementation of HSDP? 6) What distinguished outputs of HSDP could be attributed to the HPF? 7) What do you perceive as the greatest successes regarding HPF? 8) What do you perceive as the greatest challenges of HPF? 9) Were there inefficiencies in utilization? What were the main barriers to effective utilization? 10) Do you think that HPF achievements will endure? 11) Do you think the HPF should continue as it is? What improvements do you suggest? 12) What is your current stand, to join and contribute to the next round HPF?
  • 24. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 24 | P a g e 5 Highly satisfactory 4 Satisfactory 3 Fairly satisfactory 2 Less satisfactory 1 Not satisfactory ANNEX II – Questionnaire-2 Code#: _______________________ Please Rate the following by choosing values provided in the box below. (Mark boxes) SN Rate 5 4 3 2 1 0 Do you like Ethiopia? (sample completed) X 1 Extent to which HPF design was appropriate to attain its objectives 2 Strength and weakness of the HPF in terms of: Objectives Design Implementation Monitoring 3 Responsibility of FMOH for receiving, processing & approving request 4 JCCC's meetings in terms of: Regularity of the meetings Effectiveness of the meetings Attendance by all members 5 JCCC's approval process for the HPF as per the MOU in terms of: Monitoring mechanisms Transparency Timeliness 6 JCCC's decision making process to allocate and utilize resources 7 Efficiency of the process of the procurement of service and goods 8 Administration of the HPF by UNICEF in terms of: Less cumbersomeness Flexibility Transparency Timeliness 9 Financial / progress reports submitted by UNICEF for JCCC in terms of Timeliness Accuracy 10 Selection of clients and contracting process in terms of Transparency of selection Clear TOR for assignment 11 Overall fund administration process by UNICEF 12 Effectiveness of HPF as a working-model for joint donor engagement 13 Overall rating of the extent of achievement HPF objectives 14 Degree of political commitment among key stakeholders 15 Improved efficiency of HPF-III as compared to HPF-II 16 Achievement of HPF relative to best practices in other countries
  • 25. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 25 | P a g e ANNEX III – Memorandum of Understanding (Converted from Original PDF MOU document) JOINT MEMORANDUM OF UNDERSTANDING BETWEEN THE GOVERNMENTS OF THE UNITED KINGDOM,ITALY,AUSTRALIA,THE UNITED STATES, THE UNITED NATIONS CHILDREN'S FUND AND THE FEDERAL MINISTRY OF HEALTH OF ETHIOPIA ON THE MANAGEMENT OF THE HEALTH POOLED FUND FOR SUPPORT TO THE IMPLEMENTATI PROCESS OF THE HEALTH SECTOR DEVELOPMENT PROGRAMME OF ETHIOPIA (HPF-IV) 1 July 2011- 30 June 2015 I.GENERAL The Federal Democratic Republic of Ethiopia, Ministry of Health (FMOH) is committed to ensuring the accessibility of effective health services at every level of the health system through the implementation of the fourth Health Sector Development Programme (HSDP-IV). Within this plan, the FMOH and Development Partners of the Health Population Nutrition (HPN) have developed a Health Sector Harmonization and Alignment Action Plan that supports the country's action plan of harmonization alignment for aid effectiveness. The Ethiopia Country compact signed in Addis Ababa on 26th August 2008 sets out the framework or increased and more effective aid, and accelerated actions toward the achievement of the he lth Millennium Development Goals (MDGs). The Ethiopia Joint Financing Agreement (JFA) was signed on 15 April 2009 between the FMoH and seven development partners. The JFA sets out the jointly agreed terms and procedures for the management of the MDG Performance Fund (MDG/PF), including planning financial management, governance framework and decision-making, reporting, review and evaluation audit and supply chain management. The MDG/PF is a pooled funding mechanism managed by the FMOH using the Government of Ethiopia procedures. In the framework of the Ethiopia IHP+ compact, it provides flexible resources, consistent with the 'one plan, one budget and one report' concept, to secure additional finance to the HSD-IV. It is the Government's preferred modality for scaling up Development Partners assistance in support of HSDP- V. The Health Pooled Fund {HPF) was first established in 2005 to support the implementation process of HSDP and achievement of the MDGs in Ethiopia. The HPF is considered part and parcel of the MDG/PF as it supports the same scope and similar activities as the MDG/PF; its objectives, internal regulation funding and disbursement are fully controlled by the FMOH according to the HSDP priorities. However, at the same time the HPF is quite distinct from the MDG/PF in its administrative management - which is done by UNICEF in the role of Pool Fund Administrative Manager on behalf of the Policy, Planning and Finance Department of the Ministry of Health (PPFGD/ FMOH), and in its focus on technical support, coordination and other services that need swift decision and funding. The rationale for its separate management is related (i) to facilitate the swift and flexible response to procurement of national and international technical assistance and international travel; and 2) to remove the administrative burden of these tasks from FMOH. The first phase of the HPF was implemented between 1 November 2005 and 31 March 2007 with joint funding from the Governments of Ireland, The Netherlands and The United Kingdom as well as from UNICEF. The HPF-1 was managed by UNICEF Ethiopia. An independent
  • 26. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 26 | P a g e evaluation of the first HPF, conducted in March/April 2007, concluded that funds had been used for the purposes intended and that both FMOH and Development Partners had benefited from reduced transaction costs. Based on the positive experiences with the initial HPF and taking into account the recommendations of the evaluation, a number of HPN Partners had agreed to support the extension of the Fund into a new phase of 3 years: The HPF-11. The general objective of the HPF-11 was to contribute to the fulfillment of the goals of the HSDP-111, by supporting its implementation process through flexible, time-sensitive and less cumbersome funding mechanisms, in line with the Harmonization Action Plan of HSDP-111. Development Partners' contributions (DCI, RNE, DFID, IC, ADC) to the HPF-11 amounted to a total of US$ 4,152,985.34 million (US$ 4,152,985.34 programmable). Together with UNICEF contribution of US$ 539,928.43 the HPFII total programmable budget amounted to US$ 4,509,661.63. The second phase of the HPF will end on 30 June 2011. An independent evaluation of HPF-11 was conducted in August 2010. The objective of the evaluation was to assess whether the fund has served its intended purpose. The evaluation report provided views of the performance, effectiveness, efficiency and eligible utilization of HPF-11 in accordance with its objectives, and drew lessons and made recommendations. In general, the evaluation revealed that HPF-11 is widely seen as an effective, timely, responsive and demand-driven fund channeled towards the most urgent and critical needs of HSDP by strengthening the planning and coordination and implementation process. The establishment of the MDG/PF has drawn a lot of lessons from the HPF. The evaluation team concluded that the HPF-11 has significant benefits in allowing funding to respond to priority needs of the HSDP more efficiently. The involvement of donors has been participatory. UNICEF, as a Pooled Fund Manager, provided substantial support in managing the fund and also filled important funding gaps throughout the implementation process. II. THE FUNDING DEVELOPMENT PARTNERS 1. The Development Partners that have currently decided to participate in this pooling arrangement a to contribute funds are: The United Kingdom, represented by the Department For International Development (DFID),Australia, represented by AusAID, Italy, represented by the Italian Co-operation (IC), The United State of America,represented by USAID, Spain, represented by the Spanish Agency for Development Cooperation (AECID) and UNICEF. At any stage during its implementation, other Development Partners may join the HPF by signing the Joint MOU as well as by signing a Bilateral Agreement with UNICEF (see Annex I) which will trig the disbursement of the contribution into the Pool Fund managed by UNICEF as the Pool F Administrative Manager on behalf of the FMOH/PPFD. All partners to the HPF-111 and signatory to is Joint MOU acknowledge that its clauses and terms provide the overall framework for the implementation and management of the HPF-111. All signatories to this MOU acknowledge that the Joint MOU as well as its Annexes - the signed complementing Bilateral Agreement (Annex 1), he HPF-111 Proposal (Annex II) and the Reporting Templates (Annex Ill)- are binding. All funds received in the Special Account will be recorded in United States dollars. The United Nations operational rates of exchange shall be used to convert into United States dollars all funds received in other currencies, based on the United Nations operationalrates of exchange in effect on the date of receipt.
  • 27. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 27 | P a g e 2. The HPF-III will be part of HSDP's wider pooled funding scheme and will support the implementation on activities as specified in the Proposal for the HPF-111 (Annex ll) and will not be used to meet the cost of import or customs duties (or any similar fees) imposed by the Government of Ethiopia on the go ds imported or services provided. These activities will include: a) SYSTEMS STRENGTHENING- Support capacity of PPFDG/ FMOH in planning, budgeting, monitoring and evaluation of HSDPIV: • Strengthen the capacity of FMOH in co-ordination of activities in the health sector. • Enable health policy makers and key implementers to participate in local and international conferences, seminars, short study trips or visits that contribute to useful gains of experiences and exposure in health policy development and implementation. • Support the monitoring and evaluation programs of HSDP-IV (such as ARMs, JRMs, HSDP Mid-Term Reviews and Final Evaluations) to improve its implementation and to facilitate the sector's inputs towards the Growth Transformation Plan/ Millennium Development Goals monitoring and reporting process as well as the tracking of progress in terms of the relevant indicators and targets in the GTP/HSDP-IV policy matrix. • Build capacity and provide training at all levels of the health system (Federal, Regions, Woredas) in planning, M&E,and Harmonization and Alignment. • Sponsor meetings of the MOH and the private health sector and providing TA on development of standards, guidelines and manuals on Public Private Partnerships. b) TECHNICAL ASSISTANCE • Provide resources for the recruitment of international and/or national consultants to assist the Ministry in (i) policy related research, assessments and innovations and (ii) providing Technical Assistance (TA) in areas where specific needs for technical support have been identified (IT, Audit, Procurement and others). c) SUPPORT SERVICE DELIVERY • Provide resources for commissioning relevant studies on key health sector issues (operational research) in Ethiopia. • Provide resources for other relevant process activities in support of the implementation of HSDP -IV priorities. • Cover the cost of workshops for policy dialogue and formulation, and seminars on important health issues in Ethiopia. HPF resources will be accessed via UNICEF for the above-mentioned programme areas and activities in line with the HSDP-IV priorities. Ill.DELEGATION TO UNICEF TO MANAGE THE HPF-III In line with the HPF-111 Proposal and in consultation with all the HPF-111 donors, the Federal Ministry of Health has officially requested UNICEF to assist the implementation of the HPF-111 by holding and administratively managing the fund. The Development Partners contribution will be charged a 7% fee for administration and operational incurred cost by UNICEF.
  • 28. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 28 | P a g e IV.THE FEDERAL MINISTRY OF HEALTH AND THE JCCC As indicated in the Proposal for HPF-iii (Annex II): 1) The Joint Core Coordinating Committee (JCCC) of the Federal Ministry of Health and HPN Partners, chaired by the Head of the Policy,Planning and Finance Department of the Ministry (PPFGD-FMOH), has the delegated responsibility of endorsing the Annual HPF-111 Activity and Expenditure Plan and controlling the Fund's appropriate and efficient utilization. PPFGD/ FMOH is in charge of developing the draft Annual Activity and Expenditure Plans and finalizing it with JCCC in July,at the beginning for each Ethiopian Financial Year -and no later than 31 51 July. 2) The JCCC, the technical arm of PPFGD, will advise on the procurement of goods and services needed to implement the HPF-111 effectively. Procurement itself will be carried out through UNICEF Procurement Procedures in line with internationally accepted practices to ensure value for money. 3) Based on the jointly approved Annual Activity and Expenditure Plan and within the limits of its budget, the PPFGD-FMOH is responsible for receiving, processing and approving requests for funding, and ensuring the appropriate and efficient use of the Fund in the spirit of its purpose. The JCC's endorsement is needed for approval of activities not being part of the Annual Plan or for activities which exceed the agreed budget (line) by more than 10%. This approval needs to be recorded in the minutes of the JCCC meeting. 4) Upon approval for funding by JCCC, written authorization for payment together with the relevant supporting documentation (including the JCCC minute recording the approval)will be transmitted to UNICEF by the Head of the PPFGD-FMOH. 5) PPFGD-FMOH will inform the HPF-111 donors on progress of HPF-111 and on key relevant decisions by timely circulating the Minutes of the JCCC meetings. Also, the PPFDG-FMOH will inform the FMOH. HPN Partners Joint Consultative Forum, which meets every three months, on progress of HPF-111 activities and expenditure. 6) Whereby donors to the HPF-111 were not members of the JCCC, the JCCC Secretariat and/ or the PPFD-FMOH are responsible to keep them informed by way of sharing the relevant minutes of the JCCC meetings and other form of communication. The HPF donors who are member to the JCCC shall channel to the JCCC any comment/ concern/ suggestion raised by HPF donors not included in the JCCC membership. 7) At the end of EFY 2007 (April-May 2015), the JCCC will coordinate an independent final evaluation of HPF-III, by an external organization. V. THE UNITED NATIONS CHILDREN'S FUND (UNICEF) As aforementioned and also detailed in the Proposal for HPF-111 (Annex II), the JCCC and PPFGD/FMOH have requested UNICEF Ethiopia to continue the role of Pool Fund Administrative Manager (PFAM). 1. In its role of PFAM, UNICEF will administratively manage the HPF-111 on behalf of the FMOH and in accordance with the provisions of this Joint MOU. The Donors acknowledge that the Contribution will be co-mingled with other contributions to the HPF-111 and that it will not be separately identified or administered.
  • 29. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 29 | P a g e 2. The HPF-111 shall be administratively managed by UNICEF in accordance with its regulations, rules, directives and procedures applicable to Special Accounts, including those relating to interest. The HPF Ill shall be subject exclusively to the internal and external auditing procedures laid down in the financial regulations, rules, directives and procedures applicable to UNICEF. 3. UNICEF will effect payments for activities financed by the HPF-111 upon receipt of official authorization signed by the Head of the PPFGD/ MOH (and any relevant supporting document as above specified). The procurement of goods and services, administration of the contracts of hired consultants, payments for such services as in the rental of conference venues and facilities, transportation and printing will follow the UNICEF rules and regulations. 4. UNICEF will, upon receipt of authorization from the PPFGD-FMOH, undertake the procurement of goods and services, and administer the contracts of hired consultants. In close consultation a d collaboration with the PPFGD-FMOH, effect payments for such services as the rental of conference venues and facilities, transportation for such occasions as Joint Annual Review Meetings (JARMs), Review Missions (RMs), printing of documents etc. 5. UNICEF will submit to the Donors of the HPF-111 regular reports. In particular:  Six Monthly financial utilization progress update and a brief summary of the activities undertaken by the fund recipients during the semester in question, to be submitted within 1 month after the end of the reporting period - see template in Annex Ill.  Overall annual progress (narrative and financial) reports for every Ethiopian fiscal year, to be submitted 2 months after the end of the reporting period-see template in AnnexIII.  A finalnarrative and financial report six months after completion of the project, covering the entire period of the project,  A final certified financial statement of accounts within six months of financial closure of the grant as per UNICEF rules and regulations.1 6. Reports will be based on the inputs provided by the PPFGD/ MOH and by the JCCC. Reports shall be reviewed and endorsed by the JCCC prior to circulation to the HPF-111 Donors. 7. Donors to the HPF-111 acknowledge that all Progress and Final Reports (narrative and financial, including the final certified statement of accounts) on the implementation of the activities and the execution of the Fund will be drawn up in the spirit of One Plan, One Budget and One Report, s avoiding accounting to individual donors. 8. Disbursements will be made to the extent that funds are available in the Ethiopia Health Pooled Fund Account. Where the balance in the Ethiopia Health Pooled Fund on the date of a scheduled disbursement is insufficient to make that disbursement, UNICEF shall consult with the Joint Coordinating Committee and make a disbursement. if any, in accordance with the Joint Core Coordinating Committee's instructions. UNICEF shall promptly notify the Donors in such circumstances and shall advise the Donors of the Joint Core Coordinating Committee's decision in that regard. 9. UNICEF will sign a bilateral Agreement (Annex I) with each of the contributing donors to the HPF-III to trigger the disbursement of funds. The bilateral Agreement, as per template in Annex in line with the spirit, framework and clauses of this Joint MOU. 10. Obligations assumed by the Donor and UNICEF under this Joint MOU shall survive the expiration or termination of this Agreement to the extent necessary to permit the orderly conclusion of activities, the withdrawal of personnel, funds and property, the settlement of accounts between the Parties and the settlement of contractual liabilities required in respect of
  • 30. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 30 | P a g e any subcontractors, consultants or suppliers. Donors to the HPF-111 acknowledge that any balance remaining in the HPF-111 account shall be used for a purpose mutually agreed upon by UNICEF, the HPF- III Donors and the JCCC. If the decision if for unspent balances to be returned upon completion of the programme, these will be on a pro-rata basis. 11. All financial accounts and statements shall be expressed in United States dollars. VI. REPORTING 1. UNICEF will submit six monthly financial utilization progress reports and a brief summary of the activities of the activities undertaken during the semester in question, to be submitted one month after the end of the reporting period-see template in Annex Ill. 2. UNICEF will also provide Annual progress (narrative and financial- Annex Ill) reports for every Ethiopian fiscal year. They are to be submitted within 2 months after the end of the reporting period and in particular by 31st August 2012, 31st August 2013, 31st August 2014-as per template in Annex Ill. 3. A final narrative and financial report no later than six months after completion of the project, covering the entire period of the project -i.e. by 30th September 2015. 4. A joint final certified financial statement of accounts produced by 31 51 December 2016. VII. SETTLEMENT OF DIFFERENCES 1. This MOU is neither a treaty nor an instrument of treaty status. Consequently, differences which may arise concerning the interpretation or application of the MOU will not be subject to adjudication or arbitration by any national or international court or tribunal but will instead be dealt with in an amicable way as the appropriate method of achieving the peaceful settlement of those differences. 2. The Parties will consult together at any time upon request of either Party regarding any matter relating to the terms of this Memorandum and will endeavor jointly in a spirit of cooperation, g faith and mutual trust to resolve expeditiously any difficulties or misunderstandings that may arise. VIII.COUNTER-TERRORISM PROVISIONS 1. Consistent with UN Security Council Resolutions relating to terrorism, including UNSC Resolution 1373 (2001) and 1267 (1999) and related resolutions, both the UNICEF and the Donors signatory to this agreement are firmly committed to the international fight against terrorism, and in particular, against the financing of terrorism. It is the policy of the Donors signatories to this agreement to seek to ensure that none of its funds are used, directly or indirectly, to provide support to individuals or entities associated with terrorism. 2. In accordance with its policy, UNICEF undertakes to use all reasonable efforts to ensure that none of the Contribution is used to provide support to individuals or entities associated with terrorism. If, during the course of this Agreement, UNICEF discovers a link with any organization or individual associated with terrorism, UNICEF will inform immediately the Donors to the HPF- II who are signatories to this MoU. IX. AMENDMENT TO THE PRESENT MOU 1. This MOU may be amended at any time or extended upon consensus of all signatory parties. If and when a new Development Partner wished to join the HPF-111 during its implementation, it can do so by signing the present MOU and a bilateral agreement (as per Annex I) with UNICEF which triggers the disbursement of the contribution into the Fund managed by UNICEF on behalf of FMOH.
  • 31. Evaluation of the Health Pooled Fund (HPF III) Federal Ministry of Health, Ethiopia 31 | P a g e