Achieving Data Quality Through Data Governance

Achieving Data Quality Through
Data Governance
Harald Smith, Director, Product Management

TRILLIUM SOFTWARE, A Harte Hanks Company 2
Big Data  Business Insights & Decisions
 Big Data has changed our world.
 Social media, Internet of Things (IoT), Cloud sources, …
 With it, it has brought new business insights with the
promise of better business decisions
 It’s also brought disruptive technologies and practices
 Streaming data, Self-service data preparation, Machine Learning, …

3
Critical Business Decisions driven by Trust
Challenging with  in Volume, Variety, Velocity
YES?
Option 1
Option 2
Option 3
NO?

4
What you don’t know can hurt you!
Changes to data quality quickly undermine Trust
Missing
inputs
Noise
Signal
loss
Differing
aggregations
Lack of
context
Incorrect
defaults
Unxpressed
assumptions
YES?
???
NO?
Cognitive
bias

5
Not only imperative to Understand your data
Necessary to actively Record, Monitor & Measure
YES!
NO!
ENUMERATE
Establish the criteria defining goals,
relevance, and fitness for purpose
ACQUIRE
Capture the metadata for data
sources being considered and used
DISCOVER
Profile the data sources which are
required for the desired analysis
VALIDATE
Evaluate the data sources for the
identified and required qualities
DOCUMENT
Document and store the findings
about data sources and processes
CATALOG
Provide and communicate findings
about data sources and processes
for others to utilize
Option 1
Option 2
Option 3

TRILLIUM SOFTWARE, A Harte Hanks Company 6
Information Governance becomes central to
supporting Business Insights & Decisions
These activities are all part of an active Information Governance
program

Thanks!
For more information go to: trilliumsoftware.com

1
Copyright © 2016 Robert S. Seiner – KIK Consulting & Educational Services / TDAN.com
Non-Invasive Data Governance™ is a trademark of Robert S. Seiner & KIK Consulting
#RWDG @RSeiner
Real World Data Governance
Achieving Data Quality Through Data Governance
Monthly Webinar Series Hosted by Dataversity
Robert S. Seiner – KIK Consulting / TDAN.com
October 20, 2016 – 2:00 p.m. EST
Robert S. Seiner
KIK Consulting & Educational Services, LLC - KIKconsulting.com
The Data Administration Newsletter, LLC - TDAN.com

2
2
#RWDG @RSeiner
• Real-World Data Governance – Monthly Webinar Series
– November 17, 2016 – Corporate Data Governance – The CDO is the Data Governance
Chief – with Special Guest Anthony Algmin
– December 15, 2016 – Using Agile to Justify Data Governance
– Monthly on the Third Thursday at 2 pm EST
– Register On-Line at DATAVERSITY.net or TDAN.com or KIKConsulting.com
Achieving DQ Through DG
2016 Upcoming Webinars

3
3
#RWDG @RSeiner
• Non-Invasive Data Governance:
The Path of Least Resistance and Greatest Success
ISBN 9781935504856 / Technics Publishing / Amazon.com
• KIKConsulting.com
Home of Non-Invasive Data Governance™
• DATAVERSITY Events (with DEBTech International)
Data Governance Financial Services Conference
November 14-18 – Delray Beach, Florida
Tutorial – Three-Tiers of Building and Governing a Business Glossary
Session – Data Governance in the Internet of Things Age
Real-World Data Governance
In the News

4
4
#RWDG @RSeiner
• The Data Administration Newsletter (TDAN.com)
– Bi-Monthly Publication
– October 2016 Issue Available
– New Content 1st & 3rd Wednesdays
– Articles, Columns, Features, Blogs
– Published by Bob Seiner
– Produced by DATAVERSITY
– Subscribe On-Line for Updates
• Just Announced
– DATAVERSITY Training Center
– On-Line Course Plan – 7 Courses
– Non-Invasive Data Governance
– Produced by DATAVERSITY
In the News

5
5
#RWDG @RSeiner
• Data quality requires sustained discipline around the management of data
definition and production.
• Data Governance is a large part of that discipline.
• The relationship between how well data is governed and the quality of the
data is obvious.
• You cannot have high quality data without active Data Governance.
Abstract

6
6
#RWDG @RSeiner
• In this webinar, Bob will discuss:
– How Data Governance leads to data quality
– Core principles of Data Governance and data quality success
– Quality metrics based on governance practices
– Relationship between quality and governance roles
– Steps to achieve quality through governance
Abstract

7
7
#RWDG @RSeiner
• Data Governance is the execution and enforcement of authority …
• Data Stewardship is the formalization of accountability …
• Non-Invasive Data Governance™
– The practice of:
• applying formal accountability & behavior
• through a non-invasive framework of roles & responsibilities
• to existing and / or new processes
• to assure that the definition, production & usage of data
• improves regulatory compliance, security, privacy, protection, quality.
– Non-Invasive describes how governance is applied to assure
non-threatening management of valuable data assets.
– The goal is to be transparent, supportive, collaborative.
Definitions

8
8
#RWDG @RSeiner
• Data Quality does not only focus on data content quality.
• To achieve success with Data Quality requires …
– Quality Data Definition
– Quality Data Production
– Quality Data Usage
How Data Governance Leads to Data Quality

9
9
#RWDG @RSeiner
• NIDG is the practice of:
– applying formal accountability & behavior
– through a non-invasive framework of roles & responsibilities
– to existing and / or new processes
– to assure that the Definition, Production & Usage of data
– improves regulatory compliance, security, privacy, protection, quality.

10
10
#RWDG @RSeiner
• Quality Data Definition
– Assures that someone is responsible for managing data definition
– Assures a physical definition format that is recorded
– Assures that the definition is accessible
– Assures that the definition of data is consistent and approved

11
11
#RWDG @RSeiner
• Quality Data Definition
– Assures that the data naming contains context
– Assures that you stay away from “cheeseburger” definitions
– Often a quality definition is a result of a data modeling effort
– Assures the involvement of the “right” people in the defining of data

12
12
#RWDG @RSeiner
• How does the improvement of Data Definition lead to quality?
– Hard to know what’s wrong if you don’t know what is right.
– Improve consistent understanding and usage of data
– Improve knowledge of the data that exists
– Avoids duplication of data

13
13
#RWDG @RSeiner
• Quality Data Production
– Assures that people know the impact of the data they produce
– Assures that people are given incentive to produce quality data
– Assures that applications manage data production
– Assures that data transfer checks and balances occur

14
14
#RWDG @RSeiner
• Quality Data Production
– Assures the trust (validation) of data sources
– Assures that data validation is multi-faceted (data combinations)
– Assures that data is made available in a timely manner
– Assures that data is certified for analytical purposes (if important)

15
15
#RWDG @RSeiner
• How does the improvement of Data Production lead to quality?
– Improves confidence in data
– Improves efficiency around data use
– Improves effectiveness around data use
– Improves formality around data production

16
16
#RWDG @RSeiner
• Quality Data Usage
– Assures that only the “right” people can see the data
– Assures that people know and follow the data handling rules
– Assures that data is shared appropriately
– Assures that data reporting is compliant

17
17
#RWDG @RSeiner
• Quality Data Usage
– Assures that the “right” data is used for the “right” purposes
– Assures that people know how the data can and cannot be used
– Assures that people know the most appropriate place to get the data
– Assures that people follow the rules associated with usage

18
18
#RWDG @RSeiner
• How does the improvement of Data Usage lead to quality?
– Improves data protection
– Improves efficiency around data analytics and reporting
– Improves effectiveness around data analytics and reporting
– Improves formality around data reporting

19
19
#RWDG @RSeiner
Core Principles of Data Governance and Data Quality Success
• Core Principles of Non-Invasive Data Governance
– Data Must Be Governed as a Valued & Strategic Enterprise Asset
– Data Must Have Clearly Defined Accountability
– Data Must Be Governed to Follow Internal & External Rules / Regulations
– Data Quality Must Be Governed Consistently Across the Enterprise

20
20
#RWDG @RSeiner

21
21
#RWDG @RSeiner
• Data Must Be Governed as a Valued & Strategic Enterprise Asset
– Emphasis on data at the Senior Leadership Level
– Data part of Strategic and Board-level Discussions
– Formal Data or Information Governance Program in place
– Senior Leadership Support, Sponsor and Understand Data Governance Activities
– Requires attention of Chief Data Officer or similar position

22
22
#RWDG @RSeiner
• Data Must Have Clearly Defined Accountability
– People’s accountabilities based on their relationship to data
– People know where they can go to get information pertaining to data quality
– People understand the rules for handling data
– Accountability is policy and built into people’s job description
– Accountabilities should be communicated effectively

23
23
#RWDG @RSeiner
• Data Must Be Governed to Follow Internal & External Rules / Regulations
– Data Quality Rules and Standards
– Business Rules
– Classification Rules
– Data Protection Rules (examples PII, PHI and don’t forget IP)
– Compliance and Regulatory Rules

24
24
#RWDG @RSeiner
• Data Quality Must Be Governed Consistently Across the Enterprise
– Data definition, production and usage must all be managed
– Cradle to grave management of data
– Consistent applications of quality rules across the enterprise
– Consistent classification and protection of data across the enterprise
– Data Quality must be built into data processes

25
25
#RWDG @RSeiner
• Dimensions of Data Quality
– Accessibility
– Accuracy
– Completeness
– Consistency
– Relevance
– Timeliness
– Uniqueness
Quality Metrics Based on Governance Practices

26
26
#RWDG @RSeiner

27
27
#RWDG @RSeiner
• Accessibility
– Measure how people have governed access to the data they need
• Accuracy
– Measure how data compares to the standards
• Completeness
– Measure comprehensiveness of data and available metadata
• Consistency
– Measure the uniformity of quality metrics

28
28
#RWDG @RSeiner
• Relevance
– Measure data fit for purpose
• Timeliness
– Measure data availability compared to business use
• Uniqueness
– Measure how many versions of data exist and the system of record

29
29
#RWDG @RSeiner
• Data Governance Roles
– Executive / Board > Strategic > Tactical > Operational > Support
Relationship Between Quality and Governance Roles

30
30
#RWDG @RSeiner
• Executive / Board Level – Steering Committee
– Senior-most level of the organization
– Support, Sponsor and Understand relationship between DQ and DG
– Hold someone accountable for DQ and DG results
– Assure representation of the entire organization at the strategic level
– Limited but informed involvement

31
31
#RWDG @RSeiner
• Strategic Level – Data Governance Council
– Decision makers and representatives from Business Areas
– Attend regular Council meetings
– Act virtually when necessary
– Review metrics and adjust program leadership as necessary
– Resolve data quality issues escalated to the Strategic Level

32
32
#RWDG @RSeiner
• Tactical Level – Data Domain Stewards, Steward Coordinators
– Responsibility (ownership) associated with a domain or a functional area
– Work with Data Governance Team or Manager to facilitate quality improvement
– Cornerstone Data Governance role when it comes to Data Quality
– Subject Matter Experts and Enterprise Data Stewards
– Hardest role to fill because it breaks down silos

33
33
#RWDG @RSeiner
• Operational Level – Data Stewards
– Stewards based on people’s relationship to data
– Data Definers, Data Producers and Data Users
– Accountable for improving quality at the operational level
– Focus primarily on quality data within their Business Unit
– Do not necessarily look at data across Business Units

34
34
#RWDG @RSeiner
• Support Level – Data Governance Partners
– IT, PMO, Compliance, Audit, Legal, Communications, HR …
– Responsible for representing governance within each of their disciplines
– Participate on Data Governance Team or work alongside DG Manager
– Actively involved in defining governed processes related to their discipline
– Actively involved in enforcing governed processes related to their discipline

35
35
#RWDG @RSeiner
Steps to Achieve Quality Through Governance
• Steps for Data Governance to Achieve Data Quality
– Define Data Governance and Data Quality Best Practices
– Assess Existing Practices Vs. Best Practices
– Identify Strengths, Opportunities to Improve
– Articulate Gaps & Risks Associated with Gaps
– Define, Identify & Document Data Governance Roles

36
36
#RWDG @RSeiner
• Steps for Data Governance to Achieve Data Quality
– Select Project(s) for Data Governance to Focus on Data Quality
• Master Data Management
• Data Warehouse
• Building Out of Analytical Data Resources
• Data Integration / ERP Implementation

37
37
#RWDG @RSeiner
• Steps for Data Stewardship to Achieve Data Quality
– Define Stewardship Roles and Responsibilities
• Tactical
• Operational
– Recognize People into Roles / Engage People in Roles
– Apply Stewards / Governance
• Data Definition Efforts
• Data Production Efforts
• Data Protection Efforts

38
38
#RWDG @RSeiner
• In this webinar, Bob discussed:
– How Data Governance leads to data quality
– Core principles of Data Governance and data quality success
– Quality metrics based on governance practices
– Relationship between quality and governance roles
– Steps to achieve quality through governance
Summary

39
39
#RWDG @RSeiner
• Real-World Data Governance – Monthly Webinar Series
– November 17, 2016 – Corporate Data Governance – The CDO is the Data
Governance Chief – with Special Guest Anthony Algmin
– December 15, 2016 – Using Agile to Justify Data Governance
• Questions and Answers
Conclusion

40
40
#RWDG @RSeiner
• Robert S. Seiner
KIK Consulting & Educational Services – KIKconsulting.com
The Data Administration Newsletter – TDAN.com
Post Office Box 112571, Upper St. Clair, Pennsylvania 15241
412.220.9643, 412.220.9644 (Fax)
rseiner@kikconsulting.com
rseiner@tdan.com
@RSeiner
#RWDG
Contact Information

Achieving Data Quality Through Data Governance

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Achieving Data Quality Through Data Governance

Similar to Achieving Data Quality Through Data Governance (20)

More from DATAVERSITY

More from DATAVERSITY (20)

Recently uploaded

Recently uploaded (20)

Achieving Data Quality Through Data Governance