The document discusses using ETL Validator's Metadata Compare Tool to identify differences in database metadata between two snapshots of a table. It demonstrates taking snapshots of a sample table's metadata before and after changes, and using the Metadata Compare Tool to display the differences in column names and data lengths between the two snapshots. The tool can also identify new or unmatched tables between two environments or points in time.
4. Usecase :
Metadata Comparison
Here we have taken two
snapshots of the table
public.test_customers from
the Sample DB - at different
times.
Notice that there is a
change in the field names
and data lengths.
Metadata Compare Tool in
ETL-Validator helps with
identifying these differences
in Metadata.
It can show differences in a
table in two different
environments OR a table in
the same DB at different
points of time.
Snapshot of Table at 04/20/2018 2:13:53 PM
TABLE public.test_customers
(
cust_id double precision NOT NULL,
cust_first_name character varying(20) NOT NULL,
cust_last_name character varying(30) NOT NULL,
cust_gender character(1) NOT NULL,
cust_year_of_birth numeric(4,0) NOT NULL,
cust_marital_status character varying(30),
cust_address1 character varying(30) NOT NULL,
cust_pin_code character varying(10) NOT NULL,
cust_city character varying(30) NOT NULL,
cust_city_id double precision NOT NULL,
cust_state_province character varying(40) NOT NULL,
cust_state_id double precision NOT NULL,
country_id double precision NOT NULL,
cust_primary_phone_number character varying(25) NOT NULL,
cust_income_level character varying(30),
cust_credit_limit double precision,
cust_email character varying(50),
cust_total character varying(14) NOT NULL,
cust_total_id double precision NOT NULL,
cust_src_id double precision,
cust_eff_from timestamp without time zone,
cust_eff_to timestamp without time zone,
cust_valid character varying(1)
Snapshot of Table at 04/20/2018 1:55:02 PM
TABLE public.test_customers
(
cust_id double precision NOT NULL,
cust_first_name character varying(20) NOT NULL,
cust_last_name character varying(30) NOT NULL,
cust_gender character(1) NOT NULL,
cust_year_of_birth numeric(4,0) NOT NULL,
cust_marital_status character varying(20),
cust_address1 character varying(30) NOT NULL,
cust_pin_code character varying(10) NOT NULL,
cust_city character varying(30) NOT NULL,
cust_city_id double precision NOT NULL,
cust_state_province character varying(40) NOT NULL,
cust_state_province_id double precision NOT NULL,
country_id double precision NOT NULL,
cust_main_phone_number character varying(25) NOT NULL,
cust_income_level character varying(30),
cust_credit_limit double precision,
cust_email character varying(30),
cust_total character varying(14) NOT NULL,
cust_total_id double precision NOT NULL,
cust_src_id double precision,
cust_eff_from timestamp without time zone,
cust_eff_to timestamp without time zone,
cust_valid character varying(1)
6. Usecase :
Metadata Comparison
Select the Database
Connection.
Select Database Schema.
Select all ‘Tables’.
Click on ‘Capture’
Repeat this step again after
Metadata change.
We are capturing the
Metadata snapshot before
and after the changes to
Database.
Go to ‘Next’.
8. Usecase :
Metadata Comparison
List of Tables that
Match are
displayed.
Click on ‘Columns’
tab.
On the top right
corner, it is shown
that all tables
matched.
12. Usecase :
Metadata Comparison
Here is a different
scenario where a
new table was added
to the DB.
When compared, the
new table is
displayed in the
‘Unmatched Tables’.
13. More with ETL Validator….
• Validating Field and Data Format
• Data counts validation with allowed variance
• Check Data Quality using Data Rules Test Plan
• Advanced ETL Testing using a Component Test Case
• Avoiding inline views on your queries in ETL Validator
• Checking for Mandatory Fields
• List of Values Conformance Check
www.datagaps.com