Performance Audit  The GAVI Alliance Data Quality Audit experience   May 2008 ICGFM conference  Dr. Mercy Ahun GAVI Alli...
Performance Audit <ul><li>DQA history and rationale </li></ul><ul><li>DQA overview </li></ul><ul><li>Requirements </li></u...
History and rationale for DQA <ul><li>History:   DQA emerged as an assessment tool to accompany the investment component o...
Overview of Data Quality Audit <ul><li>Goal :  assure that management of  immunisation services are based on sound and acc...
Requirements <ul><li>Countries receiving Immunisation Services Support are required to conduct DQA during 2 nd  year of su...
DQA report content <ul><li>Performance indicators  (DTP drop out rate, wastage, coverage, Verification factor) </li></ul><...
DQA reporting process <ul><li>In-country presentation </li></ul><ul><li>Draft report with electronic copy </li></ul><ul><l...
GAVI DQA experience Of the 52* GAVI-eligible countries that applied for ISS funding 2000-2007: Number of Countries Present...
Innovative:  improving MIS 7 8 11 5 4 15 11 15 8 4 3 0 0 1 1 2
DQA strengths <ul><li>Innovative Management, diagnostic and capacity building tool  </li></ul><ul><ul><li>DQS – self asses...
Limitations of DQA <ul><li>Expensive & labour intensive </li></ul><ul><li>Imprecision of verification factor </li></ul><ul...
Future opportunities for DQA <ul><li>Major evaluation underway to examine methods, sources scope </li></ul><ul><li>Will re...
Upcoming SlideShare
Loading in …5
×

Performance audit gavi alliance data quality

1,169 views

Published on

From May 2008 ICGFM Conference, Dr. Mercy Ahun, GAVI Alliance Secretariat, Geneva

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,169
On SlideShare
0
From Embeds
0
Number of Embeds
81
Actions
Shares
0
Downloads
11
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Performance audit gavi alliance data quality

  1. 1. Performance Audit The GAVI Alliance Data Quality Audit experience May 2008 ICGFM conference Dr. Mercy Ahun GAVI Alliance Secretariat, Geneva
  2. 2. Performance Audit <ul><li>DQA history and rationale </li></ul><ul><li>DQA overview </li></ul><ul><li>Requirements </li></ul><ul><li>Report Content </li></ul><ul><li>GAVI DQA Experience </li></ul><ul><li>Strengths of DQA </li></ul><ul><li>Limitations of DQA </li></ul><ul><li>Future Opportunities </li></ul>
  3. 3. History and rationale for DQA <ul><li>History: DQA emerged as an assessment tool to accompany the investment component of GAVI’s Immunization System Support (ISS) window </li></ul><ul><li>Rationale: DQA aims to provide GAVI with assurance that the level of reward payable through ISS is based on a data validation process </li></ul>
  4. 4. Overview of Data Quality Audit <ul><li>Goal : assure that management of immunisation services are based on sound and accurate data </li></ul><ul><li>Operational objectives: </li></ul><ul><li>1. assess the quality, accuracy, timeliness and completeness of immunisation reporting systems </li></ul><ul><li>2. audit the reported DTP3 coverage in infants in a specific calendar year and then estimate the National verification factor to use in reward allocations </li></ul>
  5. 5. Requirements <ul><li>Countries receiving Immunisation Services Support are required to conduct DQA during 2 nd year of support </li></ul><ul><li>External audit team engaged to review records & reports </li></ul><ul><li>4 districts randomly selected & data for previous year reviewed </li></ul><ul><li>6 Health facilities visited per district </li></ul><ul><li>Number of vaccinations checked at facility, district & national levels </li></ul>
  6. 6. DQA report content <ul><li>Performance indicators (DTP drop out rate, wastage, coverage, Verification factor) </li></ul><ul><li>Verification factor </li></ul><ul><ul><li>Estimation based on all DTP3 records and reports audited at facility & district level </li></ul></ul><ul><ul><li>Based on ratio of recounted DTP3 and reported DTP3 (consistency ) </li></ul></ul><ul><ul><li>Successful DQAs – VF of at least 0.80 </li></ul></ul><ul><li>Quality of the system index: Composite index based on the recording, reporting, storage, M&E and system design for data </li></ul>
  7. 7. DQA reporting process <ul><li>In-country presentation </li></ul><ul><li>Draft report with electronic copy </li></ul><ul><li>Opportunities for feedback </li></ul><ul><li>Confidentiality </li></ul><ul><li>Monitoring of plan of action to address weaknesses in GAVI Annual Progress Report </li></ul>
  8. 8. GAVI DQA experience Of the 52* GAVI-eligible countries that applied for ISS funding 2000-2007: Number of Countries Presented for review 43 Passed Under review * 9 countries did not require a DQA as ISS expenditure was below the minimum needed for review 39 4
  9. 9. Innovative: improving MIS 7 8 11 5 4 15 11 15 8 4 3 0 0 1 1 2
  10. 10. DQA strengths <ul><li>Innovative Management, diagnostic and capacity building tool </li></ul><ul><ul><li>DQS – self assessment tool developed to help countries diagnose and address data weaknesses </li></ul></ul><ul><li>Exposed need to improve skills in management of health data </li></ul><ul><li>Induced improvements in repeat DQA countries </li></ul><ul><li>Enhances donor confidence and contributes to transparency and accountability </li></ul>
  11. 11. Limitations of DQA <ul><li>Expensive & labour intensive </li></ul><ul><li>Imprecision of verification factor </li></ul><ul><ul><li>Wide confidence intervals </li></ul></ul><ul><li>Unable to capture verification of vaccination at point of delivery </li></ul>
  12. 12. Future opportunities for DQA <ul><li>Major evaluation underway to examine methods, sources scope </li></ul><ul><li>Will review best practice and decision model </li></ul><ul><li>Opportunities for expanding DQA to include other health system metrics </li></ul><ul><li>Capacity building to enable local DQA or peer review process </li></ul>

×