SlideShare a Scribd company logo
An introduction to Data Quality Rule development
Data to Value Ltd.
42-44 Bishopsgate
London
EC2N 4AH
www.datatovalue.co.uk
What are DQ Rules?
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH
www.datatovalue.co.uk
 Automated data quality checks.
 Essential part of any coordinated
approach to Information Management.
 Pre or Post input.
 Many ways to group, classify & present
rules & results.
How are they used & what are benefits?
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH
www.datatovalue.co.uk
 Cost savings.
 Regulatory Compliance.
 Information Security.
 Risk reductions.
 Enhanced Customer Relationship Management (CRM)
US0378331005
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH
www.datatovalue.co.uk
Example of a basic DQ rule
ISIN – International Securities Identifier Number
12 Characters in
length
Alphanumeric
Begins with an ISO
country code
Contains a check
digit
May contain a
related code e.g.
CUSIP
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH
www.datatovalue.co.uk
Advanced DQ rules
 These can involve:
- Checking across data fields – e.g. if field
A is X, field B must be A, B or C.
- Matrix Lookups / transformations – e.g.
credit rating comparisons.
- Multiple transformation / validation
steps.
- Validation against external sources.
- More advanced logic – fuzzy matching
etc.
How to start developing rules
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH
www.datatovalue.co.uk
 Typical implementation cycle resembles:
- Discovery & analysis.
- Testing & enhancement
- Definition.
- Implementation.
- Review.
 What are alternatives to DIY?
- Data Quality rule repositories & bureaus.
- Standards bodies – e.g. ISO.
- Hire an expert consultancy.
Data to Value’s DQ Rule service
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH
www.datatovalue.co.uk
 Full on/offsite rule research,
development & implementation
service.
 All rules documented in plain English
using a specified metadata standard
e.g. your internal Data Dictionary.
 Tailored presentation of results at your
required level of detail – summary
dashboards and/or in depth KPIs.
 Choice of Data to Value’s preferred
tools or your existing DQ analysis tools
(BI tools, profiling tools, reporting tools
etc.)
8 0 %
8 5 %
9 0 %
9 5 %
1 0 0 %
In t e g rity
C o m p le t e n e s s
U n iq u e n e s sC o n s is t e n c y
C o n f o rm ity
7 5 %
8 0 %
8 5 %
9 0 %
9 5 %
1 0 0 %
M a y Ju n e J u ly A u g u s t
O v e r a ll Q u a lit y C o m p le t e n e s s C o n s is t e n c y
C o n fo r m it y U n iq u e n e s s In te g r it y
-
1 0 ,0 0 0
2 0 ,0 0 0
3 0 ,0 0 0
4 0 ,0 0 0
5 0 ,0 0 0
6 0 ,0 0 0
7 0 ,0 0 0
8 0 ,0 0 0
9 0 ,0 0 0
1 0 0 ,0 0 0
M a y Ju n e J u ly A u g u s t D e p t A D e p t B D e p t C D e p t D
Data Quality Scorecard – Product Data May 2013
Commentary:
- Data coverage of priority field
A increased from 30% to 80%.
- Tier 1 incidents down 30%
- Data Dependency X now live.
- Data Maintenance
requirement reduced by 30%
over 3 months to date.
- 2 additional power users
trained in DQ tool.
- 2 additional Data Stewards
within Product Master Data Set.
Status =
Green
May DQ dimensions
Latest dependenciesData Maintenance activity
Monthly DQ dimensions
About us
Specialist Information Management Consultancy offering services within:
Over 40 years combined Information Management experience as Executives at blue chip organisations.
Experts at bridging understanding gap between 'the business' and technology within the Information Management space.
Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH
www.datatovalue.co.uk

More Related Content

What's hot

Data Quality Best Practices
Data Quality Best PracticesData Quality Best Practices
Data Quality Best Practices
DATAVERSITY
 
Data Governance Best Practices
Data Governance Best PracticesData Governance Best Practices
Data Governance Best Practices
Boris Otto
 
Data Governance Initiative
Data Governance InitiativeData Governance Initiative
Data Governance Initiative
DataWorks Summit
 
Data Quality Best Practices
Data Quality Best PracticesData Quality Best Practices
Data Quality Best Practices
DATAVERSITY
 
Data Quality Management
Data Quality ManagementData Quality Management
Data Quality Management
Melissa Data India
 
Data Governance Takes a Village (So Why is Everyone Hiding?)
Data Governance Takes a Village (So Why is Everyone Hiding?)Data Governance Takes a Village (So Why is Everyone Hiding?)
Data Governance Takes a Village (So Why is Everyone Hiding?)
DATAVERSITY
 
Data Quality as a prerequisite for you business success: when should I start ...
Data Quality as a prerequisite for you business success: when should I start ...Data Quality as a prerequisite for you business success: when should I start ...
Data Quality as a prerequisite for you business success: when should I start ...
Anastasija Nikiforova
 
How to Build & Sustain a Data Governance Operating Model
How to Build & Sustain a Data Governance Operating Model How to Build & Sustain a Data Governance Operating Model
How to Build & Sustain a Data Governance Operating Model
DATUM LLC
 
Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?
DATAVERSITY
 
The data quality challenge
The data quality challengeThe data quality challenge
The data quality challenge
Lenia Miltiadous
 
Data Quality Dashboards
Data Quality DashboardsData Quality Dashboards
Data Quality Dashboards
William Sharp
 
How to Implement Data Governance Best Practice
How to Implement Data Governance Best PracticeHow to Implement Data Governance Best Practice
How to Implement Data Governance Best Practice
DATAVERSITY
 
Data Management is Data Governance
Data Management is Data GovernanceData Management is Data Governance
Data Management is Data Governance
DATAVERSITY
 
Master Data Management methodology
Master Data Management methodologyMaster Data Management methodology
Master Data Management methodology
Database Architechs
 
Data quality architecture
Data quality architectureData quality architecture
Data quality architecture
anicewick
 
Data Governance Best Practices, Assessments, and Roadmaps
Data Governance Best Practices, Assessments, and RoadmapsData Governance Best Practices, Assessments, and Roadmaps
Data Governance Best Practices, Assessments, and Roadmaps
DATAVERSITY
 
DAS Slides: Data Quality Best Practices
DAS Slides: Data Quality Best PracticesDAS Slides: Data Quality Best Practices
DAS Slides: Data Quality Best Practices
DATAVERSITY
 
Artifacts to Enable Data Goverance
Artifacts to Enable Data GoveranceArtifacts to Enable Data Goverance
Artifacts to Enable Data GoveranceDATAVERSITY
 
Data Catalog as a Business Enabler
Data Catalog as a Business EnablerData Catalog as a Business Enabler
Data Catalog as a Business Enabler
Srinivasan Sankar
 
Data governance - An Insight
Data governance - An InsightData governance - An Insight
Data governance - An Insight
Vivek Mohan
 

What's hot (20)

Data Quality Best Practices
Data Quality Best PracticesData Quality Best Practices
Data Quality Best Practices
 
Data Governance Best Practices
Data Governance Best PracticesData Governance Best Practices
Data Governance Best Practices
 
Data Governance Initiative
Data Governance InitiativeData Governance Initiative
Data Governance Initiative
 
Data Quality Best Practices
Data Quality Best PracticesData Quality Best Practices
Data Quality Best Practices
 
Data Quality Management
Data Quality ManagementData Quality Management
Data Quality Management
 
Data Governance Takes a Village (So Why is Everyone Hiding?)
Data Governance Takes a Village (So Why is Everyone Hiding?)Data Governance Takes a Village (So Why is Everyone Hiding?)
Data Governance Takes a Village (So Why is Everyone Hiding?)
 
Data Quality as a prerequisite for you business success: when should I start ...
Data Quality as a prerequisite for you business success: when should I start ...Data Quality as a prerequisite for you business success: when should I start ...
Data Quality as a prerequisite for you business success: when should I start ...
 
How to Build & Sustain a Data Governance Operating Model
How to Build & Sustain a Data Governance Operating Model How to Build & Sustain a Data Governance Operating Model
How to Build & Sustain a Data Governance Operating Model
 
Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?
 
The data quality challenge
The data quality challengeThe data quality challenge
The data quality challenge
 
Data Quality Dashboards
Data Quality DashboardsData Quality Dashboards
Data Quality Dashboards
 
How to Implement Data Governance Best Practice
How to Implement Data Governance Best PracticeHow to Implement Data Governance Best Practice
How to Implement Data Governance Best Practice
 
Data Management is Data Governance
Data Management is Data GovernanceData Management is Data Governance
Data Management is Data Governance
 
Master Data Management methodology
Master Data Management methodologyMaster Data Management methodology
Master Data Management methodology
 
Data quality architecture
Data quality architectureData quality architecture
Data quality architecture
 
Data Governance Best Practices, Assessments, and Roadmaps
Data Governance Best Practices, Assessments, and RoadmapsData Governance Best Practices, Assessments, and Roadmaps
Data Governance Best Practices, Assessments, and Roadmaps
 
DAS Slides: Data Quality Best Practices
DAS Slides: Data Quality Best PracticesDAS Slides: Data Quality Best Practices
DAS Slides: Data Quality Best Practices
 
Artifacts to Enable Data Goverance
Artifacts to Enable Data GoveranceArtifacts to Enable Data Goverance
Artifacts to Enable Data Goverance
 
Data Catalog as a Business Enabler
Data Catalog as a Business EnablerData Catalog as a Business Enabler
Data Catalog as a Business Enabler
 
Data governance - An Insight
Data governance - An InsightData governance - An Insight
Data governance - An Insight
 

Viewers also liked

Data quality overview
Data quality overviewData quality overview
Data quality overviewAlex Meadows
 
Data quality and data profiling
Data quality and data profilingData quality and data profiling
Data quality and data profiling
Shailja Khurana
 
Data Quality Definitions
Data Quality DefinitionsData Quality Definitions
Data Quality Definitions
Michael Küsters
 
Data profiling-best-practices
Data profiling-best-practicesData profiling-best-practices
Data profiling-best-practices
Blaise Cheuteu
 
MEASURE Evaluation Data Quality Assessment Methodology and Tools
MEASURE Evaluation Data Quality Assessment Methodology and ToolsMEASURE Evaluation Data Quality Assessment Methodology and Tools
MEASURE Evaluation Data Quality Assessment Methodology and Tools
MEASURE Evaluation
 
HUGE List of IEP Goals
HUGE List of IEP Goals HUGE List of IEP Goals
HUGE List of IEP Goals
Brent Daigle, Ph.D.
 
ETIS09 - Data Quality: Common Problems & Checks - Presentation
ETIS09 -  Data Quality: Common Problems & Checks - PresentationETIS09 -  Data Quality: Common Problems & Checks - Presentation
ETIS09 - Data Quality: Common Problems & Checks - PresentationDavid Walker
 
Establishing a Strategy for Data Quality
Establishing a Strategy for Data QualityEstablishing a Strategy for Data Quality
Establishing a Strategy for Data QualityDatabase Answers Ltd.
 
Data Quality Testing Generic (http://www.geektester.blogspot.com/)
Data Quality Testing Generic (http://www.geektester.blogspot.com/)Data Quality Testing Generic (http://www.geektester.blogspot.com/)
Data Quality Testing Generic (http://www.geektester.blogspot.com/)
raj.kamal13
 
Data journalism: Data rules, while data rule
Data journalism: Data rules, while data ruleData journalism: Data rules, while data rule
Data journalism: Data rules, while data rule
Science For You - SciFY NPC
 
Automated Quality Controls with FME
Automated Quality Controls with FMEAutomated Quality Controls with FME
Automated Quality Controls with FME
Safe Software
 
Odprti podatki & kakovost metapodatkov
Odprti podatki  & kakovost metapodatkovOdprti podatki  & kakovost metapodatkov
Odprti podatki & kakovost metapodatkov
Open Data Support
 
Informatica Data Quality Training
Informatica Data Quality TrainingInformatica Data Quality Training
Informatica Data Quality Training
tekslate1
 
Assessment & adjustment for data quality used in the South African DISTRICT ...
Assessment & adjustment for data quality used in the South African DISTRICT ...Assessment & adjustment for data quality used in the South African DISTRICT ...
Assessment & adjustment for data quality used in the South African DISTRICT ...Routine Health Information NetwOrk (RHINO)
 
LDIF Lightening Talk
LDIF Lightening TalkLDIF Lightening Talk
LDIF Lightening Talk
William Smith
 
Data Usability Assessment for Remote Sensing Data: Accuracy of Interactive Da...
Data Usability Assessment for Remote Sensing Data: Accuracy of Interactive Da...Data Usability Assessment for Remote Sensing Data: Accuracy of Interactive Da...
Data Usability Assessment for Remote Sensing Data: Accuracy of Interactive Da...
Beniamino Murgante
 
2014 review of data quality assessment methods
2014 review of data quality assessment methods2014 review of data quality assessment methods
2014 review of data quality assessment methods
Roger Zapata
 
Data quality assessment of OSM datasets of Ringroad, Kathmandu, Nepal
Data quality assessment of OSM datasets of Ringroad, Kathmandu, NepalData quality assessment of OSM datasets of Ringroad, Kathmandu, Nepal
Data quality assessment of OSM datasets of Ringroad, Kathmandu, Nepal
Survey Department
 
LDQ 2014 DQ Methodology
LDQ 2014 DQ MethodologyLDQ 2014 DQ Methodology
LDQ 2014 DQ Methodology
Amrapali Zaveri, PhD
 

Viewers also liked (20)

Data quality overview
Data quality overviewData quality overview
Data quality overview
 
Data quality and data profiling
Data quality and data profilingData quality and data profiling
Data quality and data profiling
 
Data Quality Definitions
Data Quality DefinitionsData Quality Definitions
Data Quality Definitions
 
Data Quality Presentation
Data Quality PresentationData Quality Presentation
Data Quality Presentation
 
Data profiling-best-practices
Data profiling-best-practicesData profiling-best-practices
Data profiling-best-practices
 
MEASURE Evaluation Data Quality Assessment Methodology and Tools
MEASURE Evaluation Data Quality Assessment Methodology and ToolsMEASURE Evaluation Data Quality Assessment Methodology and Tools
MEASURE Evaluation Data Quality Assessment Methodology and Tools
 
HUGE List of IEP Goals
HUGE List of IEP Goals HUGE List of IEP Goals
HUGE List of IEP Goals
 
ETIS09 - Data Quality: Common Problems & Checks - Presentation
ETIS09 -  Data Quality: Common Problems & Checks - PresentationETIS09 -  Data Quality: Common Problems & Checks - Presentation
ETIS09 - Data Quality: Common Problems & Checks - Presentation
 
Establishing a Strategy for Data Quality
Establishing a Strategy for Data QualityEstablishing a Strategy for Data Quality
Establishing a Strategy for Data Quality
 
Data Quality Testing Generic (http://www.geektester.blogspot.com/)
Data Quality Testing Generic (http://www.geektester.blogspot.com/)Data Quality Testing Generic (http://www.geektester.blogspot.com/)
Data Quality Testing Generic (http://www.geektester.blogspot.com/)
 
Data journalism: Data rules, while data rule
Data journalism: Data rules, while data ruleData journalism: Data rules, while data rule
Data journalism: Data rules, while data rule
 
Automated Quality Controls with FME
Automated Quality Controls with FMEAutomated Quality Controls with FME
Automated Quality Controls with FME
 
Odprti podatki & kakovost metapodatkov
Odprti podatki  & kakovost metapodatkovOdprti podatki  & kakovost metapodatkov
Odprti podatki & kakovost metapodatkov
 
Informatica Data Quality Training
Informatica Data Quality TrainingInformatica Data Quality Training
Informatica Data Quality Training
 
Assessment & adjustment for data quality used in the South African DISTRICT ...
Assessment & adjustment for data quality used in the South African DISTRICT ...Assessment & adjustment for data quality used in the South African DISTRICT ...
Assessment & adjustment for data quality used in the South African DISTRICT ...
 
LDIF Lightening Talk
LDIF Lightening TalkLDIF Lightening Talk
LDIF Lightening Talk
 
Data Usability Assessment for Remote Sensing Data: Accuracy of Interactive Da...
Data Usability Assessment for Remote Sensing Data: Accuracy of Interactive Da...Data Usability Assessment for Remote Sensing Data: Accuracy of Interactive Da...
Data Usability Assessment for Remote Sensing Data: Accuracy of Interactive Da...
 
2014 review of data quality assessment methods
2014 review of data quality assessment methods2014 review of data quality assessment methods
2014 review of data quality assessment methods
 
Data quality assessment of OSM datasets of Ringroad, Kathmandu, Nepal
Data quality assessment of OSM datasets of Ringroad, Kathmandu, NepalData quality assessment of OSM datasets of Ringroad, Kathmandu, Nepal
Data quality assessment of OSM datasets of Ringroad, Kathmandu, Nepal
 
LDQ 2014 DQ Methodology
LDQ 2014 DQ MethodologyLDQ 2014 DQ Methodology
LDQ 2014 DQ Methodology
 

Similar to Data Quality Rules introduction

The Great Data Debate (4) Implementing a lean approach to Data Quality Manage...
The Great Data Debate (4) Implementing a lean approach to Data Quality Manage...The Great Data Debate (4) Implementing a lean approach to Data Quality Manage...
The Great Data Debate (4) Implementing a lean approach to Data Quality Manage...
BCS Data Management Specialist Group
 
Implementar una estrategia eficiente de gobierno y seguridad del dato con la ...
Implementar una estrategia eficiente de gobierno y seguridad del dato con la ...Implementar una estrategia eficiente de gobierno y seguridad del dato con la ...
Implementar una estrategia eficiente de gobierno y seguridad del dato con la ...
Denodo
 
SAP Supply Chain Performance Management implementation for enhanced business ...
SAP Supply Chain Performance Management implementation for enhanced business ...SAP Supply Chain Performance Management implementation for enhanced business ...
SAP Supply Chain Performance Management implementation for enhanced business ...ITC Infotech
 
Big Data, analytics and 4th generation data warehousing by Martyn Jones at Bi...
Big Data, analytics and 4th generation data warehousing by Martyn Jones at Bi...Big Data, analytics and 4th generation data warehousing by Martyn Jones at Bi...
Big Data, analytics and 4th generation data warehousing by Martyn Jones at Bi...
Big Data Spain
 
SAP Applications and the Modern Data Scientist - Predictive Analytics for the...
SAP Applications and the Modern Data Scientist - Predictive Analytics for the...SAP Applications and the Modern Data Scientist - Predictive Analytics for the...
SAP Applications and the Modern Data Scientist - Predictive Analytics for the...
Dickinson + Associates
 
¿En qué se parece el Gobierno del Dato a un parque de atracciones?
¿En qué se parece el Gobierno del Dato a un parque de atracciones?¿En qué se parece el Gobierno del Dato a un parque de atracciones?
¿En qué se parece el Gobierno del Dato a un parque de atracciones?
Denodo
 
07. Analytics & Reporting Requirements Template
07. Analytics & Reporting Requirements Template07. Analytics & Reporting Requirements Template
07. Analytics & Reporting Requirements Template
Alan D. Duncan
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
Neo4j
 
China data-mngnt-solution-market-report
China data-mngnt-solution-market-reportChina data-mngnt-solution-market-report
China data-mngnt-solution-market-report
ssuser7709011
 
Data mining financial services
Data mining financial servicesData mining financial services
Data mining financial servicesHprentice
 
Sergio Juarez, Elemica – “From Big Data to Value: The Power of Master Data Ma...
Sergio Juarez, Elemica – “From Big Data to Value: The Power of Master Data Ma...Sergio Juarez, Elemica – “From Big Data to Value: The Power of Master Data Ma...
Sergio Juarez, Elemica – “From Big Data to Value: The Power of Master Data Ma...
Elemica
 
Smart Data Module 2 d drive_own data
Smart Data Module 2 d drive_own dataSmart Data Module 2 d drive_own data
Smart Data Module 2 d drive_own data
caniceconsulting
 
DataBench - Project fiche
DataBench - Project ficheDataBench - Project fiche
DataBench - Project fiche
DataBench
 
PreScouter + GE Healthcare: How will the Internet of Things Impact your Indus...
PreScouter + GE Healthcare: How will the Internet of Things Impact your Indus...PreScouter + GE Healthcare: How will the Internet of Things Impact your Indus...
PreScouter + GE Healthcare: How will the Internet of Things Impact your Indus...
PreScouter
 
ITSM and Service Catalog Overview
ITSM and Service Catalog OverviewITSM and Service Catalog Overview
ITSM and Service Catalog OverviewChristopher Glennon
 
Big Data Proof of Concept
Big Data Proof of ConceptBig Data Proof of Concept
Big Data Proof of Concept
RCG Global Services
 
Totem Sustainability Pitch Deck
Totem Sustainability Pitch DeckTotem Sustainability Pitch Deck
Totem Sustainability Pitch Deck
Ian Dodd
 
Are you getting the most out of your data?
Are you getting the most out of your data?Are you getting the most out of your data?
Are you getting the most out of your data?
SAS Canada
 
Workable Enteprise Data Governance
Workable Enteprise Data GovernanceWorkable Enteprise Data Governance
Workable Enteprise Data GovernanceBhavendra Chavan
 
Transform Data into Action
Transform Data into ActionTransform Data into Action
Transform Data into Action
Workday, Inc.
 

Similar to Data Quality Rules introduction (20)

The Great Data Debate (4) Implementing a lean approach to Data Quality Manage...
The Great Data Debate (4) Implementing a lean approach to Data Quality Manage...The Great Data Debate (4) Implementing a lean approach to Data Quality Manage...
The Great Data Debate (4) Implementing a lean approach to Data Quality Manage...
 
Implementar una estrategia eficiente de gobierno y seguridad del dato con la ...
Implementar una estrategia eficiente de gobierno y seguridad del dato con la ...Implementar una estrategia eficiente de gobierno y seguridad del dato con la ...
Implementar una estrategia eficiente de gobierno y seguridad del dato con la ...
 
SAP Supply Chain Performance Management implementation for enhanced business ...
SAP Supply Chain Performance Management implementation for enhanced business ...SAP Supply Chain Performance Management implementation for enhanced business ...
SAP Supply Chain Performance Management implementation for enhanced business ...
 
Big Data, analytics and 4th generation data warehousing by Martyn Jones at Bi...
Big Data, analytics and 4th generation data warehousing by Martyn Jones at Bi...Big Data, analytics and 4th generation data warehousing by Martyn Jones at Bi...
Big Data, analytics and 4th generation data warehousing by Martyn Jones at Bi...
 
SAP Applications and the Modern Data Scientist - Predictive Analytics for the...
SAP Applications and the Modern Data Scientist - Predictive Analytics for the...SAP Applications and the Modern Data Scientist - Predictive Analytics for the...
SAP Applications and the Modern Data Scientist - Predictive Analytics for the...
 
¿En qué se parece el Gobierno del Dato a un parque de atracciones?
¿En qué se parece el Gobierno del Dato a un parque de atracciones?¿En qué se parece el Gobierno del Dato a un parque de atracciones?
¿En qué se parece el Gobierno del Dato a un parque de atracciones?
 
07. Analytics & Reporting Requirements Template
07. Analytics & Reporting Requirements Template07. Analytics & Reporting Requirements Template
07. Analytics & Reporting Requirements Template
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
 
China data-mngnt-solution-market-report
China data-mngnt-solution-market-reportChina data-mngnt-solution-market-report
China data-mngnt-solution-market-report
 
Data mining financial services
Data mining financial servicesData mining financial services
Data mining financial services
 
Sergio Juarez, Elemica – “From Big Data to Value: The Power of Master Data Ma...
Sergio Juarez, Elemica – “From Big Data to Value: The Power of Master Data Ma...Sergio Juarez, Elemica – “From Big Data to Value: The Power of Master Data Ma...
Sergio Juarez, Elemica – “From Big Data to Value: The Power of Master Data Ma...
 
Smart Data Module 2 d drive_own data
Smart Data Module 2 d drive_own dataSmart Data Module 2 d drive_own data
Smart Data Module 2 d drive_own data
 
DataBench - Project fiche
DataBench - Project ficheDataBench - Project fiche
DataBench - Project fiche
 
PreScouter + GE Healthcare: How will the Internet of Things Impact your Indus...
PreScouter + GE Healthcare: How will the Internet of Things Impact your Indus...PreScouter + GE Healthcare: How will the Internet of Things Impact your Indus...
PreScouter + GE Healthcare: How will the Internet of Things Impact your Indus...
 
ITSM and Service Catalog Overview
ITSM and Service Catalog OverviewITSM and Service Catalog Overview
ITSM and Service Catalog Overview
 
Big Data Proof of Concept
Big Data Proof of ConceptBig Data Proof of Concept
Big Data Proof of Concept
 
Totem Sustainability Pitch Deck
Totem Sustainability Pitch DeckTotem Sustainability Pitch Deck
Totem Sustainability Pitch Deck
 
Are you getting the most out of your data?
Are you getting the most out of your data?Are you getting the most out of your data?
Are you getting the most out of your data?
 
Workable Enteprise Data Governance
Workable Enteprise Data GovernanceWorkable Enteprise Data Governance
Workable Enteprise Data Governance
 
Transform Data into Action
Transform Data into ActionTransform Data into Action
Transform Data into Action
 

Recently uploaded

FIA officials brutally tortured innocent and snatched 200 Bitcoins of worth 4...
FIA officials brutally tortured innocent and snatched 200 Bitcoins of worth 4...FIA officials brutally tortured innocent and snatched 200 Bitcoins of worth 4...
FIA officials brutally tortured innocent and snatched 200 Bitcoins of worth 4...
jamalseoexpert1978
 
The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...
Adam Smith
 
Exploring Patterns of Connection with Social Dreaming
Exploring Patterns of Connection with Social DreamingExploring Patterns of Connection with Social Dreaming
Exploring Patterns of Connection with Social Dreaming
Nicola Wreford-Howard
 
Discover the innovative and creative projects that highlight my journey throu...
Discover the innovative and creative projects that highlight my journey throu...Discover the innovative and creative projects that highlight my journey throu...
Discover the innovative and creative projects that highlight my journey throu...
dylandmeas
 
Authentically Social by Corey Perlman - EO Puerto Rico
Authentically Social by Corey Perlman - EO Puerto RicoAuthentically Social by Corey Perlman - EO Puerto Rico
Authentically Social by Corey Perlman - EO Puerto Rico
Corey Perlman, Social Media Speaker and Consultant
 
Training my puppy and implementation in this story
Training my puppy and implementation in this storyTraining my puppy and implementation in this story
Training my puppy and implementation in this story
WilliamRodrigues148
 
LA HUG - Video Testimonials with Chynna Morgan - June 2024
LA HUG - Video Testimonials with Chynna Morgan - June 2024LA HUG - Video Testimonials with Chynna Morgan - June 2024
LA HUG - Video Testimonials with Chynna Morgan - June 2024
Lital Barkan
 
Project File Report BBA 6th semester.pdf
Project File Report BBA 6th semester.pdfProject File Report BBA 6th semester.pdf
Project File Report BBA 6th semester.pdf
RajPriye
 
Top mailing list providers in the USA.pptx
Top mailing list providers in the USA.pptxTop mailing list providers in the USA.pptx
Top mailing list providers in the USA.pptx
JeremyPeirce1
 
Meas_Dylan_DMBS_PB1_2024-05XX_Revised.pdf
Meas_Dylan_DMBS_PB1_2024-05XX_Revised.pdfMeas_Dylan_DMBS_PB1_2024-05XX_Revised.pdf
Meas_Dylan_DMBS_PB1_2024-05XX_Revised.pdf
dylandmeas
 
Chapter 7 Final business management sciences .ppt
Chapter 7 Final business management sciences .pptChapter 7 Final business management sciences .ppt
Chapter 7 Final business management sciences .ppt
ssuser567e2d
 
Best Forex Brokers Comparison in INDIA 2024
Best Forex Brokers Comparison in INDIA 2024Best Forex Brokers Comparison in INDIA 2024
Best Forex Brokers Comparison in INDIA 2024
Top Forex Brokers Review
 
-- June 2024 is National Volunteer Month --
-- June 2024 is National Volunteer Month ---- June 2024 is National Volunteer Month --
-- June 2024 is National Volunteer Month --
NZSG
 
Observation Lab PowerPoint Assignment for TEM 431
Observation Lab PowerPoint Assignment for TEM 431Observation Lab PowerPoint Assignment for TEM 431
Observation Lab PowerPoint Assignment for TEM 431
ecamare2
 
Digital Transformation and IT Strategy Toolkit and Templates
Digital Transformation and IT Strategy Toolkit and TemplatesDigital Transformation and IT Strategy Toolkit and Templates
Digital Transformation and IT Strategy Toolkit and Templates
Aurelien Domont, MBA
 
The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...
Adam Smith
 
Agency Managed Advisory Board As a Solution To Career Path Defining Business ...
Agency Managed Advisory Board As a Solution To Career Path Defining Business ...Agency Managed Advisory Board As a Solution To Career Path Defining Business ...
Agency Managed Advisory Board As a Solution To Career Path Defining Business ...
Boris Ziegler
 
Organizational Change Leadership Agile Tour Geneve 2024
Organizational Change Leadership Agile Tour Geneve 2024Organizational Change Leadership Agile Tour Geneve 2024
Organizational Change Leadership Agile Tour Geneve 2024
Kirill Klimov
 
Tata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s Dholera
Tata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s DholeraTata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s Dholera
Tata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s Dholera
Avirahi City Dholera
 
Auditing study material for b.com final year students
Auditing study material for b.com final year  studentsAuditing study material for b.com final year  students
Auditing study material for b.com final year students
narasimhamurthyh4
 

Recently uploaded (20)

FIA officials brutally tortured innocent and snatched 200 Bitcoins of worth 4...
FIA officials brutally tortured innocent and snatched 200 Bitcoins of worth 4...FIA officials brutally tortured innocent and snatched 200 Bitcoins of worth 4...
FIA officials brutally tortured innocent and snatched 200 Bitcoins of worth 4...
 
The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...
 
Exploring Patterns of Connection with Social Dreaming
Exploring Patterns of Connection with Social DreamingExploring Patterns of Connection with Social Dreaming
Exploring Patterns of Connection with Social Dreaming
 
Discover the innovative and creative projects that highlight my journey throu...
Discover the innovative and creative projects that highlight my journey throu...Discover the innovative and creative projects that highlight my journey throu...
Discover the innovative and creative projects that highlight my journey throu...
 
Authentically Social by Corey Perlman - EO Puerto Rico
Authentically Social by Corey Perlman - EO Puerto RicoAuthentically Social by Corey Perlman - EO Puerto Rico
Authentically Social by Corey Perlman - EO Puerto Rico
 
Training my puppy and implementation in this story
Training my puppy and implementation in this storyTraining my puppy and implementation in this story
Training my puppy and implementation in this story
 
LA HUG - Video Testimonials with Chynna Morgan - June 2024
LA HUG - Video Testimonials with Chynna Morgan - June 2024LA HUG - Video Testimonials with Chynna Morgan - June 2024
LA HUG - Video Testimonials with Chynna Morgan - June 2024
 
Project File Report BBA 6th semester.pdf
Project File Report BBA 6th semester.pdfProject File Report BBA 6th semester.pdf
Project File Report BBA 6th semester.pdf
 
Top mailing list providers in the USA.pptx
Top mailing list providers in the USA.pptxTop mailing list providers in the USA.pptx
Top mailing list providers in the USA.pptx
 
Meas_Dylan_DMBS_PB1_2024-05XX_Revised.pdf
Meas_Dylan_DMBS_PB1_2024-05XX_Revised.pdfMeas_Dylan_DMBS_PB1_2024-05XX_Revised.pdf
Meas_Dylan_DMBS_PB1_2024-05XX_Revised.pdf
 
Chapter 7 Final business management sciences .ppt
Chapter 7 Final business management sciences .pptChapter 7 Final business management sciences .ppt
Chapter 7 Final business management sciences .ppt
 
Best Forex Brokers Comparison in INDIA 2024
Best Forex Brokers Comparison in INDIA 2024Best Forex Brokers Comparison in INDIA 2024
Best Forex Brokers Comparison in INDIA 2024
 
-- June 2024 is National Volunteer Month --
-- June 2024 is National Volunteer Month ---- June 2024 is National Volunteer Month --
-- June 2024 is National Volunteer Month --
 
Observation Lab PowerPoint Assignment for TEM 431
Observation Lab PowerPoint Assignment for TEM 431Observation Lab PowerPoint Assignment for TEM 431
Observation Lab PowerPoint Assignment for TEM 431
 
Digital Transformation and IT Strategy Toolkit and Templates
Digital Transformation and IT Strategy Toolkit and TemplatesDigital Transformation and IT Strategy Toolkit and Templates
Digital Transformation and IT Strategy Toolkit and Templates
 
The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...
 
Agency Managed Advisory Board As a Solution To Career Path Defining Business ...
Agency Managed Advisory Board As a Solution To Career Path Defining Business ...Agency Managed Advisory Board As a Solution To Career Path Defining Business ...
Agency Managed Advisory Board As a Solution To Career Path Defining Business ...
 
Organizational Change Leadership Agile Tour Geneve 2024
Organizational Change Leadership Agile Tour Geneve 2024Organizational Change Leadership Agile Tour Geneve 2024
Organizational Change Leadership Agile Tour Geneve 2024
 
Tata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s Dholera
Tata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s DholeraTata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s Dholera
Tata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s Dholera
 
Auditing study material for b.com final year students
Auditing study material for b.com final year  studentsAuditing study material for b.com final year  students
Auditing study material for b.com final year students
 

Data Quality Rules introduction

  • 1. An introduction to Data Quality Rule development Data to Value Ltd. 42-44 Bishopsgate London EC2N 4AH www.datatovalue.co.uk
  • 2. What are DQ Rules? Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH www.datatovalue.co.uk  Automated data quality checks.  Essential part of any coordinated approach to Information Management.  Pre or Post input.  Many ways to group, classify & present rules & results.
  • 3. How are they used & what are benefits? Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH www.datatovalue.co.uk  Cost savings.  Regulatory Compliance.  Information Security.  Risk reductions.  Enhanced Customer Relationship Management (CRM)
  • 4. US0378331005 Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH www.datatovalue.co.uk Example of a basic DQ rule ISIN – International Securities Identifier Number 12 Characters in length Alphanumeric Begins with an ISO country code Contains a check digit May contain a related code e.g. CUSIP
  • 5. Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH www.datatovalue.co.uk Advanced DQ rules  These can involve: - Checking across data fields – e.g. if field A is X, field B must be A, B or C. - Matrix Lookups / transformations – e.g. credit rating comparisons. - Multiple transformation / validation steps. - Validation against external sources. - More advanced logic – fuzzy matching etc.
  • 6. How to start developing rules Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH www.datatovalue.co.uk  Typical implementation cycle resembles: - Discovery & analysis. - Testing & enhancement - Definition. - Implementation. - Review.  What are alternatives to DIY? - Data Quality rule repositories & bureaus. - Standards bodies – e.g. ISO. - Hire an expert consultancy.
  • 7. Data to Value’s DQ Rule service Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH www.datatovalue.co.uk  Full on/offsite rule research, development & implementation service.  All rules documented in plain English using a specified metadata standard e.g. your internal Data Dictionary.  Tailored presentation of results at your required level of detail – summary dashboards and/or in depth KPIs.  Choice of Data to Value’s preferred tools or your existing DQ analysis tools (BI tools, profiling tools, reporting tools etc.) 8 0 % 8 5 % 9 0 % 9 5 % 1 0 0 % In t e g rity C o m p le t e n e s s U n iq u e n e s sC o n s is t e n c y C o n f o rm ity 7 5 % 8 0 % 8 5 % 9 0 % 9 5 % 1 0 0 % M a y Ju n e J u ly A u g u s t O v e r a ll Q u a lit y C o m p le t e n e s s C o n s is t e n c y C o n fo r m it y U n iq u e n e s s In te g r it y - 1 0 ,0 0 0 2 0 ,0 0 0 3 0 ,0 0 0 4 0 ,0 0 0 5 0 ,0 0 0 6 0 ,0 0 0 7 0 ,0 0 0 8 0 ,0 0 0 9 0 ,0 0 0 1 0 0 ,0 0 0 M a y Ju n e J u ly A u g u s t D e p t A D e p t B D e p t C D e p t D Data Quality Scorecard – Product Data May 2013 Commentary: - Data coverage of priority field A increased from 30% to 80%. - Tier 1 incidents down 30% - Data Dependency X now live. - Data Maintenance requirement reduced by 30% over 3 months to date. - 2 additional power users trained in DQ tool. - 2 additional Data Stewards within Product Master Data Set. Status = Green May DQ dimensions Latest dependenciesData Maintenance activity Monthly DQ dimensions
  • 8. About us Specialist Information Management Consultancy offering services within: Over 40 years combined Information Management experience as Executives at blue chip organisations. Experts at bridging understanding gap between 'the business' and technology within the Information Management space. Data to Value Ltd, 42-44 Bishopsgate, London EC2N 4AH www.datatovalue.co.uk