Your Data Quality Solution
               By


             &
1                                4/6/2011
Meeting Agenda


     Quality Gates – A Brief Overview

     BI Data quality

     Demo




2                                        4/6/2011
Vision.bi Quality Gates - overview
   Vision.bi Quality Gates ™ is a centralized solution for data quality.

 The solutions helps organizations to constantly and efficiently improve
    the quality of information and trust in organizational information systems
    by defining various types of quality gates.

 Quality gates can be used for integration and BI projects (QA) or for
    monitoring data quality in production (On going…)




3                                                                           4/6/2011
Vision.bi – Quality Gates




4                               4/6/2011
QA in BI Environment
                                               Quality Gates
                                                                                          OLAP
                                                                                          Front




                                                                                           SCD


         On Going                                                                QA         RI
Source Changes                                                    ColumnsTable Mapping
                                         Quality Gates
Undated sources                                                   Data Loaded
                                     Centralize management
Bugs in the sources                                               Calculations
                                     Auto execution                                        Roles
Referential Integrity                                             Cubes
                                     History      Vision.bi Create Reports *
Regression tests
                                     Various sources
                                      Methodology
Load Metadata         Design Your Model     Create DWH          Create ETL            QA
Centered Management
Manage QA organization tree

                              Cartelize Solution
                               Unique QA dashboard
                               Intuitive drill to the tests result




6                                                                     4/6/2011
Various test types

QA best practices
 Unique test types for BI and integration
 User friendly definition

                                             Best practices
                                              Check sum - Compare between source
                                              Compare tables – Detailed compare
                                              Execution flow – Tests parallelism and
                                             dependencies

                                              Referential integrity – Complete dimension
                                             missing value

                                              Free SQL – Custom tests
 7                                                                                 4/6/2011
#1 – Data consistency

Test goal
 Identify changes in data trend
 Identify missing sources


How
 Compare amount between current period to previous
 Compare to average
 Test type: Check Sum
When
 End of the ETL cycle
 Before cube process
 8                                                    4/6/2011
#2 – Data Availability

Test goal
 Verify updated data availability
 Inform users for updated data


How
 Query for rows on the last period
 If missing inform the IT team else inform the user
 Test type: Custom test
When
 End of the ETL cycle
 Every hour
 9                                                     4/6/2011
#3 – RI Completeness

Test goal
 Check and complete dimension missing keys with default values
 Insure data integrity for join between fact tables and dimensions


How
 Find distinct values from fact where not exists in the dimension
 Test type: Referential integrity

When
 After loading fact tables



 10                                                                   4/6/2011
#4 – Cube correctness

Test goal
 Verify cube data Vs. Data warehouse



How
 Compare last period in cube Vs Dwhsources queries
 Test type: Check Sum

When
 End of the ETL cycle



 11                                                    4/6/2011
#5 – Execution Flow

Test goal
 Tests dependencies
 Execute in parallel
 Drill to the row level
How
 Add your tests to the execution flow test and define the dependencies
 Test type: Execution flow and all other objects

When
 End of the ETL cycle



 12                                                                       4/6/2011
And more…

 Compare values – changes over time

 Tests history & versions

 Advanced mail alerts

 Environments (Test -> Production)

…




 13                                    4/6/2011
BI clients (Partial List)
              A global company (NYSE: DOX) with revenue of $3.0 billion in fiscal 2010, Amdocs is the
              market leader in customer experience systems innovation with over 19,000
              employees delivering the most advanced business support systems (BSS), operational
              support systems (OSS) and service delivery to innovative service providers in more than
              60 countries around the world.

              NICE Systems (NASDAQ: NICE), is the worldwide leader of intent-based solutions
              that capture and analyze interactions and transactions, realize intent, and extract
              and leverage insights to deliver impact in real time.

              Harel Group is the third largest insurance group in Israel. It is the second largest in
              general insurance; the market leader in health insurance, and from the perspective of
              premium volume, it is the third largest in life insurance.


              Eden Springs Ltd is the IL market leader in the Water Cooler Industry and forms part
              of Eden Springs Europe, which has a presence in 13 other European countries.


              013 NetVision is the leading company in the Israeli communication sector with a
              market share of 36% in International Telephony services. In addition, the company
              offers its customers a domestic calls service (VOIP).
14
Summary

Start using Vision.bi Quality gates and get
      Business alerts

      Data integrity

      Inform on data inconsistency

      Cube validation




 15                                           4/6/2011
Thank You!
                   For demo please contact

     Ram Yonish                    Yifat Vector
     M - ryonish@tact.co.il        M - yifatva@matrix.co.il
     P – 052-2424314               P – 052-8651729



                              &
16                                                    4/7/2011

Visionbi Quality Gates

  • 1.
    Your Data QualitySolution By & 1 4/6/2011
  • 2.
    Meeting Agenda  Quality Gates – A Brief Overview  BI Data quality  Demo 2 4/6/2011
  • 3.
    Vision.bi Quality Gates- overview  Vision.bi Quality Gates ™ is a centralized solution for data quality.  The solutions helps organizations to constantly and efficiently improve the quality of information and trust in organizational information systems by defining various types of quality gates.  Quality gates can be used for integration and BI projects (QA) or for monitoring data quality in production (On going…) 3 4/6/2011
  • 4.
    Vision.bi – QualityGates 4 4/6/2011
  • 5.
    QA in BIEnvironment Quality Gates OLAP Front SCD On Going QA RI Source Changes ColumnsTable Mapping Quality Gates Undated sources Data Loaded Centralize management Bugs in the sources Calculations Auto execution Roles Referential Integrity Cubes History Vision.bi Create Reports * Regression tests Various sources Methodology Load Metadata Design Your Model Create DWH Create ETL QA
  • 6.
    Centered Management Manage QAorganization tree Cartelize Solution  Unique QA dashboard  Intuitive drill to the tests result 6 4/6/2011
  • 7.
    Various test types QAbest practices  Unique test types for BI and integration  User friendly definition Best practices  Check sum - Compare between source  Compare tables – Detailed compare  Execution flow – Tests parallelism and dependencies  Referential integrity – Complete dimension missing value  Free SQL – Custom tests 7 4/6/2011
  • 8.
    #1 – Dataconsistency Test goal  Identify changes in data trend  Identify missing sources How  Compare amount between current period to previous  Compare to average  Test type: Check Sum When  End of the ETL cycle  Before cube process 8 4/6/2011
  • 9.
    #2 – DataAvailability Test goal  Verify updated data availability  Inform users for updated data How  Query for rows on the last period  If missing inform the IT team else inform the user  Test type: Custom test When  End of the ETL cycle  Every hour 9 4/6/2011
  • 10.
    #3 – RICompleteness Test goal  Check and complete dimension missing keys with default values  Insure data integrity for join between fact tables and dimensions How  Find distinct values from fact where not exists in the dimension  Test type: Referential integrity When  After loading fact tables 10 4/6/2011
  • 11.
    #4 – Cubecorrectness Test goal  Verify cube data Vs. Data warehouse How  Compare last period in cube Vs Dwhsources queries  Test type: Check Sum When  End of the ETL cycle 11 4/6/2011
  • 12.
    #5 – ExecutionFlow Test goal  Tests dependencies  Execute in parallel  Drill to the row level How  Add your tests to the execution flow test and define the dependencies  Test type: Execution flow and all other objects When  End of the ETL cycle 12 4/6/2011
  • 13.
    And more…  Comparevalues – changes over time  Tests history & versions  Advanced mail alerts  Environments (Test -> Production) … 13 4/6/2011
  • 14.
    BI clients (PartialList) A global company (NYSE: DOX) with revenue of $3.0 billion in fiscal 2010, Amdocs is the market leader in customer experience systems innovation with over 19,000 employees delivering the most advanced business support systems (BSS), operational support systems (OSS) and service delivery to innovative service providers in more than 60 countries around the world. NICE Systems (NASDAQ: NICE), is the worldwide leader of intent-based solutions that capture and analyze interactions and transactions, realize intent, and extract and leverage insights to deliver impact in real time. Harel Group is the third largest insurance group in Israel. It is the second largest in general insurance; the market leader in health insurance, and from the perspective of premium volume, it is the third largest in life insurance. Eden Springs Ltd is the IL market leader in the Water Cooler Industry and forms part of Eden Springs Europe, which has a presence in 13 other European countries. 013 NetVision is the leading company in the Israeli communication sector with a market share of 36% in International Telephony services. In addition, the company offers its customers a domestic calls service (VOIP). 14
  • 15.
    Summary Start using Vision.biQuality gates and get Business alerts Data integrity Inform on data inconsistency Cube validation 15 4/6/2011
  • 16.
    Thank You! For demo please contact Ram Yonish Yifat Vector M - ryonish@tact.co.il M - yifatva@matrix.co.il P – 052-2424314 P – 052-8651729 & 16 4/7/2011