This document discusses how to build and leverage a data model in ETL Validator for query construction, testing referential integrity, and identifying noise in a data warehouse. It explains how to select tables and define join conditions between tables to create an entity data model that can then be reused over time for these purposes. The data model can be used in the query builder to build constrained queries and in a referential integrity test plan to automatically identify records without valid parents.

1. <Insert Picture Here>
datagaps
The data testing company
Dynamic Data Model Overview

2. Typical Data Warehousing Life Cycle
Plan Design Develop Test Operate
Initiate End
End User
Interviews
Data Profile
Specification
Data
Sources
Sample
Reports &
Concurrency
ETL
Mappings
Schema
Mappings
Warehouse
Data
Dictionary
Technical
Architecture
Facts &
Dimensions
Data Testing
ETL Process
Reports &
Analytics
Performance
& Scalability
Defects
Manage
Growth
Continuous
Integration
EnhancementsReports
Leverage the data model across all phases of the DW Life Cycle

3. Objective
• As a QA Engineer, I should be able to build/leverage an
existing data model for the following:
• Query Construction
• Testing Referential Integrity
• Identifying noise in the data warehouse

4. This Deck
• The following slides explain how a data entity model
can be designed in ETL Validator so that the
aforementioned use cases can be reused over time

5. Upon Login, system displays the
Home Page

6. Select an existing connection in the
DB Explorer, right click and click on
the “Add Data Model”

7. ETL Validator a listing of all the tables
in the selected connection/schema •Click on
Create

8. Search for tables of interest and select
them by clicking on the checkboxes.
Then click on OK.. This will enable you
to specify the join conditions bet

9. Select a table and click on “Add”
button on the right side.

10. You can pick another table (Table
2) from the pick list
1 2
3
4
Pick a table from the left side
You can select the attributes for the
join conditions and operators
Click on Add Condition
CHANNEL_ID
CHANNEL_ID

11. The recently added condition
should show up here

12. I specified a number of join conditions. Where
are these used?

13. Usage
• Query Builder
• The queries can be constrained by the filter
conditions
• Referential Integrity Test Plan
• This test plan can automatically identify the records
which do not have valid parents

14. More Resources
•http://www.datagaps.com
•http://youtube.com/datagaps
•http://www.twitter.com/datagaps