Visionbi Quality Gates


Published on

automation Data verification tool for BI and DWH. for more info contact:

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Visionbi Quality Gates

  1. 1. Your Data Quality Solution By &1 4/6/2011
  2. 2. Meeting Agenda  Quality Gates – A Brief Overview  BI Data quality  Demo2 4/6/2011
  3. 3. Quality Gates - overview Quality Gates ™ is a centralized solution for data quality. The solutions helps organizations to constantly and efficiently improve the quality of information and trust in organizational information systems by defining various types of quality gates. Quality gates can be used for integration and BI projects (QA) or for monitoring data quality in production (On going…)3 4/6/2011
  4. 4. – Quality Gates4 4/6/2011
  5. 5. QA in BI Environment Quality Gates OLAP Front SCD On Going QA RISource Changes ColumnsTable Mapping Quality GatesUndated sources Data Loaded Centralize managementBugs in the sources Calculations Auto execution RolesReferential Integrity Cubes History Create Reports *Regression tests Various sources MethodologyLoad Metadata Design Your Model Create DWH Create ETL QA
  6. 6. Centered ManagementManage QA organization tree Cartelize Solution  Unique QA dashboard  Intuitive drill to the tests result6 4/6/2011
  7. 7. Various test typesQA best practices Unique test types for BI and integration User friendly definition Best practices  Check sum - Compare between source  Compare tables – Detailed compare  Execution flow – Tests parallelism and dependencies  Referential integrity – Complete dimension missing value  Free SQL – Custom tests 7 4/6/2011
  8. 8. #1 – Data consistencyTest goal Identify changes in data trend Identify missing sourcesHow Compare amount between current period to previous Compare to average Test type: Check SumWhen End of the ETL cycle Before cube process 8 4/6/2011
  9. 9. #2 – Data AvailabilityTest goal Verify updated data availability Inform users for updated dataHow Query for rows on the last period If missing inform the IT team else inform the user Test type: Custom testWhen End of the ETL cycle Every hour 9 4/6/2011
  10. 10. #3 – RI CompletenessTest goal Check and complete dimension missing keys with default values Insure data integrity for join between fact tables and dimensionsHow Find distinct values from fact where not exists in the dimension Test type: Referential integrityWhen After loading fact tables 10 4/6/2011
  11. 11. #4 – Cube correctnessTest goal Verify cube data Vs. Data warehouseHow Compare last period in cube Vs Dwhsources queries Test type: Check SumWhen End of the ETL cycle 11 4/6/2011
  12. 12. #5 – Execution FlowTest goal Tests dependencies Execute in parallel Drill to the row levelHow Add your tests to the execution flow test and define the dependencies Test type: Execution flow and all other objectsWhen End of the ETL cycle 12 4/6/2011
  13. 13. And more… Compare values – changes over time Tests history & versions Advanced mail alerts Environments (Test -> Production)… 13 4/6/2011
  14. 14. BI clients (Partial List) A global company (NYSE: DOX) with revenue of $3.0 billion in fiscal 2010, Amdocs is the market leader in customer experience systems innovation with over 19,000 employees delivering the most advanced business support systems (BSS), operational support systems (OSS) and service delivery to innovative service providers in more than 60 countries around the world. NICE Systems (NASDAQ: NICE), is the worldwide leader of intent-based solutions that capture and analyze interactions and transactions, realize intent, and extract and leverage insights to deliver impact in real time. Harel Group is the third largest insurance group in Israel. It is the second largest in general insurance; the market leader in health insurance, and from the perspective of premium volume, it is the third largest in life insurance. Eden Springs Ltd is the IL market leader in the Water Cooler Industry and forms part of Eden Springs Europe, which has a presence in 13 other European countries. 013 NetVision is the leading company in the Israeli communication sector with a market share of 36% in International Telephony services. In addition, the company offers its customers a domestic calls service (VOIP).14
  15. 15. SummaryStart using Quality gates and get Business alerts Data integrity Inform on data inconsistency Cube validation 15 4/6/2011
  16. 16. Thank You! For demo please contact Ram Yonish Yifat Vector M - M - P – 052-2424314 P – 052-8651729 &16 4/7/2011