SlideShare a Scribd company logo
Best Practices:  Data Administration and Quality Daniel Linstedt, all rights reserved, http://LearnDataVault.com
Introduction and Expectations ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Agenda ,[object Object],[object Object],[object Object],[object Object]
Defining Data Administration Issues
What is Data Administration? “ What do we mean by that in the case of data administration? We mean that DA must get out of the design review committee mentality and substitute something more value-added and flexible. It must recognize that systems tend to grow organically, and be a part of that process, rather than an instiller of order upon it.”  Eric Rawlins, 1995 Originally Published by: Database Research Group, Inc http://www.well.com/user/woodman/organic.html
The Role of Data Administration ,[object Object],[object Object],[object Object]
Cross-Organization Roles and Responsibilities Business ( Owner View) Data Steward Discipline Authority Business Process  Manager Data Usage Contact Data Manager Data Modeler DA is a  ROLE  and typically involves more than one person in order to achieve success. Logical (Designer  View) Data Administrator Physical ( Builder View) Database Administrator
Data Administrator Responsibilities ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Top 10 Data Administration Issues ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Defining Data Administration Issues Top 4 Examples
Defining Master Metadata ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Defining Master Data Management ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Assessing Logical Model Viability ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Defining Business Process Models ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Applying Best Practices
Revealing the DA Best Practices ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
DA: MDM and Master Metadata ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Many times we see a cross-role responsibility of data management and data administration.  The cross-role is responsible for the following:
Work Breakdown Structure ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Organizational Breakdown Structure ,[object Object],[object Object],[object Object],[object Object]
DA: Architecting Data Governance Business Rules & IQ EDW Source Systems Non Compliant Data Marts Business Rules & IQ EDW Source Systems Data Marts Compliant Hard Business Rules Soft Business Rules & IQ  Shift  to process AFTER  the EDW Hard Business Rules Still process  Before the EDW
Establishing Auditable Sources Sync  Routines Data 2 nd  Source System Staging EDW Data Warehouse Source System Data Export Sync  Routines OLTP Oper Reports DW Exports ,[object Object],[object Object],[object Object]
DA – Defining Data Errors and Models ,[object Object],[object Object],[object Object],[object Object],B.I. Tool Database Wrtr xform Rdr ETL Load Process Source System Staging Area Data Warehouse Data Marts **Error Stage **Error Warehouse Error Marts ** Not usually implemented
DA Example –  Classifications of Errors ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Business Owns the Error I.T. Owns the Error
DA: Tracking Errors – KPIs at Work
Metadata and Data Administration ,[object Object],[object Object],[object Object],[object Object],[object Object]
Metadata Administration Lifecycle Identify New  Metadata Integrate With Master Metadata  Repository Edit and Manage Master Metadata (Provide Business Users  with Web Interface) Stitch  Master Metadata Together Compare Master Metadata With Business Process And Objectives Export Master Metadata or Deploy via SOA With Master Data Set Derived from Meta Integration Metadata Lifecycle
Monitoring DA Efforts ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Establish KPIs for Each of the Following Areas
Case Study for DA Results ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],After Implementing DA Best Practices
Conclusions and Q&A
Revealing the DA Best Practices (Recap) ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
The Experts Say… “ The Data Vault is the optimal choice for modeling the EDW in the DW 2.0 framework.”  Bill Inmon ,[object Object],Stephen Brobst “ The Data Vault is a technique which some industry experts have predicted may spark a revolution as the next big thing in data modeling for enterprise warehousing....”  Doug Laney
More Notables… ,[object Object],Scott Ambler
Where To Learn More ,[object Object],[object Object],[object Object],[object Object]
Thank you Contact us today: Dan Linstedt [email_address] http://LearnDataVault.com

More Related Content

What's hot

Data warehouse
Data warehouse Data warehouse
Data warehouse
Yogendra Uikey
 
DATA WAREHOUSING AND DATA MINING
DATA WAREHOUSING AND DATA MININGDATA WAREHOUSING AND DATA MINING
DATA WAREHOUSING AND DATA MINING
Lovely Professional University
 
Data warehouse concepts
Data warehouse conceptsData warehouse concepts
Data warehouse concepts
obieefans
 
Dimensional model | | Fact Tables | | Types
Dimensional model | | Fact Tables | | TypesDimensional model | | Fact Tables | | Types
Dimensional model | | Fact Tables | | Types
umair saeed
 
Database Administration
Database AdministrationDatabase Administration
Database Administration
Bilal Arshad
 
Database user and administrator.pptx
Database user and administrator.pptxDatabase user and administrator.pptx
Database user and administrator.pptx
Anusha sivakumar
 
Data quality and data profiling
Data quality and data profilingData quality and data profiling
Data quality and data profiling
Shailja Khurana
 
Data Warehouse Interview Questions And Answers | Data Warehouse Tutorial | Ed...
Data Warehouse Interview Questions And Answers | Data Warehouse Tutorial | Ed...Data Warehouse Interview Questions And Answers | Data Warehouse Tutorial | Ed...
Data Warehouse Interview Questions And Answers | Data Warehouse Tutorial | Ed...
Edureka!
 
Presentation on Database management system
Presentation on Database management systemPresentation on Database management system
Presentation on Database management system
Prerana Bhattarai
 
5 Level of MDM Maturity
5 Level of MDM Maturity5 Level of MDM Maturity
5 Level of MDM Maturity
PanaEk Warawit
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
Jason S
 
Data base management system
Data base management systemData base management system
Data base management system
ashirafzal1
 
Data warehousing testing strategies cognos
Data warehousing testing strategies cognosData warehousing testing strategies cognos
Data warehousing testing strategies cognos
Sandeep Mehta
 
MIS: Business Intelligence
MIS: Business IntelligenceMIS: Business Intelligence
MIS: Business IntelligenceJonathan Coleman
 
Transaction processing systems
Transaction processing systems Transaction processing systems
Transaction processing systems greg robertson
 
Master Data Management
Master Data ManagementMaster Data Management
Master Data Management
Sung Kuan
 
Database basics
Database basicsDatabase basics
Database basics
prachin514
 
Data Governance
Data GovernanceData Governance
Data Governance
SambaSoup
 

What's hot (20)

Data warehouse
Data warehouse Data warehouse
Data warehouse
 
DATA WAREHOUSING AND DATA MINING
DATA WAREHOUSING AND DATA MININGDATA WAREHOUSING AND DATA MINING
DATA WAREHOUSING AND DATA MINING
 
Data warehouse concepts
Data warehouse conceptsData warehouse concepts
Data warehouse concepts
 
Dimensional model | | Fact Tables | | Types
Dimensional model | | Fact Tables | | TypesDimensional model | | Fact Tables | | Types
Dimensional model | | Fact Tables | | Types
 
Database Administration
Database AdministrationDatabase Administration
Database Administration
 
Database user and administrator.pptx
Database user and administrator.pptxDatabase user and administrator.pptx
Database user and administrator.pptx
 
Data quality and data profiling
Data quality and data profilingData quality and data profiling
Data quality and data profiling
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
Data Warehouse Interview Questions And Answers | Data Warehouse Tutorial | Ed...
Data Warehouse Interview Questions And Answers | Data Warehouse Tutorial | Ed...Data Warehouse Interview Questions And Answers | Data Warehouse Tutorial | Ed...
Data Warehouse Interview Questions And Answers | Data Warehouse Tutorial | Ed...
 
Presentation on Database management system
Presentation on Database management systemPresentation on Database management system
Presentation on Database management system
 
5 Level of MDM Maturity
5 Level of MDM Maturity5 Level of MDM Maturity
5 Level of MDM Maturity
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
Data base management system
Data base management systemData base management system
Data base management system
 
Data warehousing testing strategies cognos
Data warehousing testing strategies cognosData warehousing testing strategies cognos
Data warehousing testing strategies cognos
 
MIS: Business Intelligence
MIS: Business IntelligenceMIS: Business Intelligence
MIS: Business Intelligence
 
Transaction processing systems
Transaction processing systems Transaction processing systems
Transaction processing systems
 
Data warehousing
Data warehousingData warehousing
Data warehousing
 
Master Data Management
Master Data ManagementMaster Data Management
Master Data Management
 
Database basics
Database basicsDatabase basics
Database basics
 
Data Governance
Data GovernanceData Governance
Data Governance
 

Viewers also liked

NLP Data Cleansing Based on Linguistic Ontology Constraints
NLP Data Cleansing Based on Linguistic Ontology ConstraintsNLP Data Cleansing Based on Linguistic Ontology Constraints
NLP Data Cleansing Based on Linguistic Ontology Constraints
Dimitris Kontokostas
 
Data Cleansing introduction (for BigClean Prague 2011)
Data Cleansing introduction (for BigClean Prague 2011)Data Cleansing introduction (for BigClean Prague 2011)
Data Cleansing introduction (for BigClean Prague 2011)
Stefan Urbanek
 
Scaling Big Data Cleansing
Scaling Big Data CleansingScaling Big Data Cleansing
Scaling Big Data Cleansing
Zuhair khayyat
 
Data Cleaning Process
Data Cleaning ProcessData Cleaning Process
Data Cleaning Process
InfoCheckPoint
 
Data Quality Best Practices Nbk Auto May 06 2010
Data Quality Best Practices  Nbk Auto May 06 2010Data Quality Best Practices  Nbk Auto May 06 2010
Data Quality Best Practices Nbk Auto May 06 2010Rami Mansour
 
Data-Ed: Best Practices with the Data Management Maturity Model
Data-Ed: Best Practices with the Data Management Maturity ModelData-Ed: Best Practices with the Data Management Maturity Model
Data-Ed: Best Practices with the Data Management Maturity Model
Data Blueprint
 
Applying Data Quality Best Practices at Big Data Scale
Applying Data Quality Best Practices at Big Data ScaleApplying Data Quality Best Practices at Big Data Scale
Applying Data Quality Best Practices at Big Data Scale
Precisely
 

Viewers also liked (8)

NLP Data Cleansing Based on Linguistic Ontology Constraints
NLP Data Cleansing Based on Linguistic Ontology ConstraintsNLP Data Cleansing Based on Linguistic Ontology Constraints
NLP Data Cleansing Based on Linguistic Ontology Constraints
 
Data Cleansing introduction (for BigClean Prague 2011)
Data Cleansing introduction (for BigClean Prague 2011)Data Cleansing introduction (for BigClean Prague 2011)
Data Cleansing introduction (for BigClean Prague 2011)
 
Scaling Big Data Cleansing
Scaling Big Data CleansingScaling Big Data Cleansing
Scaling Big Data Cleansing
 
Data Cleaning Process
Data Cleaning ProcessData Cleaning Process
Data Cleaning Process
 
Data Quality Best Practices Nbk Auto May 06 2010
Data Quality Best Practices  Nbk Auto May 06 2010Data Quality Best Practices  Nbk Auto May 06 2010
Data Quality Best Practices Nbk Auto May 06 2010
 
Data-Ed: Best Practices with the Data Management Maturity Model
Data-Ed: Best Practices with the Data Management Maturity ModelData-Ed: Best Practices with the Data Management Maturity Model
Data-Ed: Best Practices with the Data Management Maturity Model
 
Applying Data Quality Best Practices at Big Data Scale
Applying Data Quality Best Practices at Big Data ScaleApplying Data Quality Best Practices at Big Data Scale
Applying Data Quality Best Practices at Big Data Scale
 
Data cleansing
Data cleansingData cleansing
Data cleansing
 

Similar to Best Practices: Data Admin & Data Management

Planning Data Warehouse
Planning Data WarehousePlanning Data Warehouse
Planning Data Warehouse
Fahri Firdausillah
 
Data Governance challenges in a major Energy Company
Data Governance challenges in a major Energy CompanyData Governance challenges in a major Energy Company
Data Governance challenges in a major Energy Company
Christopher Bradley
 
Enterprise Data Governance for Financial Institutions
Enterprise Data Governance for Financial InstitutionsEnterprise Data Governance for Financial Institutions
Enterprise Data Governance for Financial InstitutionsSheldon McCarthy
 
MDM & BI Strategy For Large Enterprises
MDM & BI Strategy For Large EnterprisesMDM & BI Strategy For Large Enterprises
MDM & BI Strategy For Large Enterprises
Mark Schoeppel
 
Metadata Strategies
Metadata StrategiesMetadata Strategies
Metadata Strategies
DATAVERSITY
 
These Are The Data You Are Looking For
These Are The Data You Are Looking ForThese Are The Data You Are Looking For
These Are The Data You Are Looking For
Embarcadero Technologies
 
How JCI Prepared a Data Governance Program for Big Data & MDG on HANA
How JCI Prepared a Data Governance Program for Big Data & MDG on HANAHow JCI Prepared a Data Governance Program for Big Data & MDG on HANA
How JCI Prepared a Data Governance Program for Big Data & MDG on HANA
DATUM LLC
 
Implementing Agile Data Governance
Implementing Agile Data GovernanceImplementing Agile Data Governance
Implementing Agile Data Governance
Tami Flowers
 
11626 Bitt I 2008 Lec 2
11626 Bitt I 2008 Lec 211626 Bitt I 2008 Lec 2
11626 Bitt I 2008 Lec 2
ambujm
 
A Step-by-Step Guide to Metadata Management
A Step-by-Step Guide to Metadata ManagementA Step-by-Step Guide to Metadata Management
A Step-by-Step Guide to Metadata Management
SaachiShankar
 
Adopting a Process-Driven Approach to Master Data Management
Adopting a Process-Driven Approach to Master Data ManagementAdopting a Process-Driven Approach to Master Data Management
Adopting a Process-Driven Approach to Master Data Management
Software AG
 
Master Data Management's Place in the Data Governance Landscape
Master Data Management's Place in the Data Governance Landscape Master Data Management's Place in the Data Governance Landscape
Master Data Management's Place in the Data Governance Landscape
CCG
 
AnalytiX DS - Master Deck
AnalytiX DS - Master DeckAnalytiX DS - Master Deck
AnalytiX DS - Master Deck
AnalytiX DS
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt
BsMath3rdsem
 
EDMC_DCAM_-_WORKING_DRAFT_VERSION_0.7.pdf
EDMC_DCAM_-_WORKING_DRAFT_VERSION_0.7.pdfEDMC_DCAM_-_WORKING_DRAFT_VERSION_0.7.pdf
EDMC_DCAM_-_WORKING_DRAFT_VERSION_0.7.pdf
Abhinav195887
 
The Key Reason Why Your DG Program is Failing
The Key Reason Why Your DG Program is FailingThe Key Reason Why Your DG Program is Failing
The Key Reason Why Your DG Program is Failing
CCG
 
Introduction to Master Data Services in SQL Server 2012
Introduction to Master Data Services in SQL Server 2012Introduction to Master Data Services in SQL Server 2012
Introduction to Master Data Services in SQL Server 2012
Stéphane Fréchette
 
Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...
Health Informatics New Zealand
 

Similar to Best Practices: Data Admin & Data Management (20)

Planning Data Warehouse
Planning Data WarehousePlanning Data Warehouse
Planning Data Warehouse
 
Data Governance challenges in a major Energy Company
Data Governance challenges in a major Energy CompanyData Governance challenges in a major Energy Company
Data Governance challenges in a major Energy Company
 
Enterprise Data Governance for Financial Institutions
Enterprise Data Governance for Financial InstitutionsEnterprise Data Governance for Financial Institutions
Enterprise Data Governance for Financial Institutions
 
MDM & BI Strategy For Large Enterprises
MDM & BI Strategy For Large EnterprisesMDM & BI Strategy For Large Enterprises
MDM & BI Strategy For Large Enterprises
 
Metadata Strategies
Metadata StrategiesMetadata Strategies
Metadata Strategies
 
These Are The Data You Are Looking For
These Are The Data You Are Looking ForThese Are The Data You Are Looking For
These Are The Data You Are Looking For
 
How JCI Prepared a Data Governance Program for Big Data & MDG on HANA
How JCI Prepared a Data Governance Program for Big Data & MDG on HANAHow JCI Prepared a Data Governance Program for Big Data & MDG on HANA
How JCI Prepared a Data Governance Program for Big Data & MDG on HANA
 
Implementing Agile Data Governance
Implementing Agile Data GovernanceImplementing Agile Data Governance
Implementing Agile Data Governance
 
Database 2 External Schema
Database 2   External SchemaDatabase 2   External Schema
Database 2 External Schema
 
Business intelligence
Business intelligenceBusiness intelligence
Business intelligence
 
11626 Bitt I 2008 Lec 2
11626 Bitt I 2008 Lec 211626 Bitt I 2008 Lec 2
11626 Bitt I 2008 Lec 2
 
A Step-by-Step Guide to Metadata Management
A Step-by-Step Guide to Metadata ManagementA Step-by-Step Guide to Metadata Management
A Step-by-Step Guide to Metadata Management
 
Adopting a Process-Driven Approach to Master Data Management
Adopting a Process-Driven Approach to Master Data ManagementAdopting a Process-Driven Approach to Master Data Management
Adopting a Process-Driven Approach to Master Data Management
 
Master Data Management's Place in the Data Governance Landscape
Master Data Management's Place in the Data Governance Landscape Master Data Management's Place in the Data Governance Landscape
Master Data Management's Place in the Data Governance Landscape
 
AnalytiX DS - Master Deck
AnalytiX DS - Master DeckAnalytiX DS - Master Deck
AnalytiX DS - Master Deck
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt
 
EDMC_DCAM_-_WORKING_DRAFT_VERSION_0.7.pdf
EDMC_DCAM_-_WORKING_DRAFT_VERSION_0.7.pdfEDMC_DCAM_-_WORKING_DRAFT_VERSION_0.7.pdf
EDMC_DCAM_-_WORKING_DRAFT_VERSION_0.7.pdf
 
The Key Reason Why Your DG Program is Failing
The Key Reason Why Your DG Program is FailingThe Key Reason Why Your DG Program is Failing
The Key Reason Why Your DG Program is Failing
 
Introduction to Master Data Services in SQL Server 2012
Introduction to Master Data Services in SQL Server 2012Introduction to Master Data Services in SQL Server 2012
Introduction to Master Data Services in SQL Server 2012
 
Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...
 

More from Empowered Holdings, LLC

Introduction To Data Vault - DAMA Oregon 2012
Introduction To Data Vault - DAMA Oregon 2012Introduction To Data Vault - DAMA Oregon 2012
Introduction To Data Vault - DAMA Oregon 2012
Empowered Holdings, LLC
 
Présentation data vault et bi v20120508
Présentation data vault et bi v20120508Présentation data vault et bi v20120508
Présentation data vault et bi v20120508
Empowered Holdings, LLC
 
IRM UK - 2009: DV Modeling And Methodology
IRM UK - 2009: DV Modeling And MethodologyIRM UK - 2009: DV Modeling And Methodology
IRM UK - 2009: DV Modeling And Methodology
Empowered Holdings, LLC
 
Data Vault and DW2.0
Data Vault and DW2.0Data Vault and DW2.0
Data Vault and DW2.0
Empowered Holdings, LLC
 
Data vault what's Next: Part 2
Data vault what's Next: Part 2Data vault what's Next: Part 2
Data vault what's Next: Part 2
Empowered Holdings, LLC
 
Data vault: What's Next
Data vault: What's NextData vault: What's Next
Data vault: What's Next
Empowered Holdings, LLC
 
Operational Data Vault
Operational Data VaultOperational Data Vault
Operational Data Vault
Empowered Holdings, LLC
 
Data Vault Overview
Data Vault OverviewData Vault Overview
Data Vault Overview
Empowered Holdings, LLC
 

More from Empowered Holdings, LLC (8)

Introduction To Data Vault - DAMA Oregon 2012
Introduction To Data Vault - DAMA Oregon 2012Introduction To Data Vault - DAMA Oregon 2012
Introduction To Data Vault - DAMA Oregon 2012
 
Présentation data vault et bi v20120508
Présentation data vault et bi v20120508Présentation data vault et bi v20120508
Présentation data vault et bi v20120508
 
IRM UK - 2009: DV Modeling And Methodology
IRM UK - 2009: DV Modeling And MethodologyIRM UK - 2009: DV Modeling And Methodology
IRM UK - 2009: DV Modeling And Methodology
 
Data Vault and DW2.0
Data Vault and DW2.0Data Vault and DW2.0
Data Vault and DW2.0
 
Data vault what's Next: Part 2
Data vault what's Next: Part 2Data vault what's Next: Part 2
Data vault what's Next: Part 2
 
Data vault: What's Next
Data vault: What's NextData vault: What's Next
Data vault: What's Next
 
Operational Data Vault
Operational Data VaultOperational Data Vault
Operational Data Vault
 
Data Vault Overview
Data Vault OverviewData Vault Overview
Data Vault Overview
 

Recently uploaded

Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
Pierluigi Pugliese
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
KAMESHS29
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
Laura Byrne
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
SOFTTECHHUB
 
Enhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZEnhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZ
Globus
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
UiPathCommunity
 
UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..
UiPathCommunity
 
The Metaverse and AI: how can decision-makers harness the Metaverse for their...
The Metaverse and AI: how can decision-makers harness the Metaverse for their...The Metaverse and AI: how can decision-makers harness the Metaverse for their...
The Metaverse and AI: how can decision-makers harness the Metaverse for their...
Jen Stirrup
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
nkrafacyberclub
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 

Recently uploaded (20)

Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
RESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for studentsRESUME BUILDER APPLICATION Project for students
RESUME BUILDER APPLICATION Project for students
 
The Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and SalesThe Art of the Pitch: WordPress Relationships and Sales
The Art of the Pitch: WordPress Relationships and Sales
 
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
Why You Should Replace Windows 11 with Nitrux Linux 3.5.0 for enhanced perfor...
 
Enhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZEnhancing Performance with Globus and the Science DMZ
Enhancing Performance with Globus and the Science DMZ
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
 
UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..UiPath Community Day Dubai: AI at Work..
UiPath Community Day Dubai: AI at Work..
 
The Metaverse and AI: how can decision-makers harness the Metaverse for their...
The Metaverse and AI: how can decision-makers harness the Metaverse for their...The Metaverse and AI: how can decision-makers harness the Metaverse for their...
The Metaverse and AI: how can decision-makers harness the Metaverse for their...
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 

Best Practices: Data Admin & Data Management

  • 1. Best Practices: Data Administration and Quality Daniel Linstedt, all rights reserved, http://LearnDataVault.com
  • 2.
  • 3.
  • 5. What is Data Administration? “ What do we mean by that in the case of data administration? We mean that DA must get out of the design review committee mentality and substitute something more value-added and flexible. It must recognize that systems tend to grow organically, and be a part of that process, rather than an instiller of order upon it.”  Eric Rawlins, 1995 Originally Published by: Database Research Group, Inc http://www.well.com/user/woodman/organic.html
  • 6.
  • 7. Cross-Organization Roles and Responsibilities Business ( Owner View) Data Steward Discipline Authority Business Process Manager Data Usage Contact Data Manager Data Modeler DA is a ROLE and typically involves more than one person in order to achieve success. Logical (Designer View) Data Administrator Physical ( Builder View) Database Administrator
  • 8.
  • 9.
  • 10. Defining Data Administration Issues Top 4 Examples
  • 11.
  • 12.
  • 13.
  • 14.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20. DA: Architecting Data Governance Business Rules & IQ EDW Source Systems Non Compliant Data Marts Business Rules & IQ EDW Source Systems Data Marts Compliant Hard Business Rules Soft Business Rules & IQ Shift to process AFTER the EDW Hard Business Rules Still process Before the EDW
  • 21.
  • 22.
  • 23.
  • 24. DA: Tracking Errors – KPIs at Work
  • 25.
  • 26. Metadata Administration Lifecycle Identify New Metadata Integrate With Master Metadata Repository Edit and Manage Master Metadata (Provide Business Users with Web Interface) Stitch Master Metadata Together Compare Master Metadata With Business Process And Objectives Export Master Metadata or Deploy via SOA With Master Data Set Derived from Meta Integration Metadata Lifecycle
  • 27.
  • 28.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34. Thank you Contact us today: Dan Linstedt [email_address] http://LearnDataVault.com

Editor's Notes

  1. The purpose of this slide show is to present and discuss the role of data administration in the data integration world. Here we define some of the business and technical problems that DA’s face on a daily basis, then we move on to discuss the types of activities that a DA will under-take in an enterprise level initiative. Please bear in mind, that the DA is a role, and may not end-up being just a single individual, but rather a group of individuals, some of whom are directly responsible for Data Management as well.
  2. In this section we define different DA roles, issues, and conceptual notions. We discuss the DA role from a 20,000 foot level where the enterprise “see’s” data administrators, and begins to understand what they do. The role of the DA ranges from monitoring business user meetings to over-seeing the design of data flow through business processes. Business Process flow has a large impact on the world of the DA and what they need to be capable of achieving. They need to work across multiple groups in order to achieve an enterprise vision of the data assets and models that will serve the enterprise.
  3. http://www.cio.gov.bc.ca/other/daf/DMRolesRespV1.pdf
  4. http://www.cio.gov.bc.ca/other/daf/DMRolesRespV1.pdf
  5. http://www.educause.edu/ir/library/text/CEM9047.txt
  6. Data Must Be: Auditable, Traceable, Stored in the granular format it arrived in, A “statement-of-fact” Business Rules must move to the output side of the equation. Data can be integrated by the same semantic grain, but cannot be altered.
  7. The Data Administrator is responsible for identifying auditable or audited sources of data. The DA will be responsible for ensuring which data sets can and should be utilized to load enterprise data warehouses. The DA will set policies and procedures for measuring, auditing, and assessing the quality of information flowing to and from the source systems.
  8. The Data Administrator is responsible for assigning or classifying different groups of errors, what will make the data set or break the data set. They are also responsible for the integrity of the data set, and ensuring that the data set matches the requirements set forth by the business users.
  9. The Data Administrator might use a live chart like this one to examine the errors and the occurrences of errors over time. The DA will be responsible for the quality of the data, as it relates to the business metrics put forward. The DA will be responsible for maintaining the logical models, and the business processes – and if the error count is too high for a specific area of expertise, then the Data Manager must be notified, and corrective action must be taken.
  10. Organic Data Administration, http://www.well.com/user/woodman/organic.html