SlideShare a Scribd company logo
1 of 29
The Data Driven University
Automating Data Governance & Stewardship in
Autonomous & Decentralized Environments
Pieter De Leenheer, PhD
Cofounder and VP Innovation
What we talk about when we talk about
no Data Governance
Who approved this?
I wish these guys
spoke our
language
I can’t understand
this report !
I’ve never seen this
funding code! Who
introduced this ?
Are we sure this
definition of
‘professor’ is correct
?
The Problem
This rule is
different on our
campus!
Are we allowed to share this
student data with IR?
Glossary Search
• How frequently do you look up a word for your
business?
• To what purpose?
Clarification
Differentiation
• What are your main sources?
• Hierarchy-based navigation or key-word based
search?
• Authoritative Truth or trust?
Overview
• Data Governance Operating Framework
Data Governance
Data Stewardship
Data Management
• Implementations
Stanford University Data Stewardship (SUDS)
George Washington University
Brigham Young University
• The Bigger Picture
Inter-university Data Governance in
the Flanders Research Information Space
Data Governance Framework
Data Governance Council: Governance Operating Model
Roles &
Responsibilities
Processes &
Workflow
Asset Types &
Traceability
Data Governance
Organization
Data Stewardship Activities
Data Quality
Development
IT / Operational Data Management Activities
Data
Modeling
Metadata
Lineage
Establishes& drives
Aligns& Coordinates
Reports& Escalates
Monitors& Remediates
Metadata
Scanning
Reference Data
Authoring
Data
Integration
Collibra Business
Semantics Glossary (BSG)
Collibra Reference Data
Accelerator (RDA)
Hierarchy
Management
Business &
Data Definitions
Business
Traceability
Semantic
Modeling
Mapping
Specifications
Policy
Management
Business
Rules
Data Quality
Rules
Data Quality
Reporting
Issue
Management
Reference Data
Crosswalks
Master Data
Stewardship
Data Quality Profiling
DQ Defect
Resolution
Collibra Data Stewardship
Manager (DSM)
Collibra Platform
Other Data Management
Vendor products
...
https://compass.collibra.com/display/COOK/Data+Governance+Operating+Model
Stanford University Data Stewardship
(SUDS)
• All Materials available here
dg.stanford.edu
• Establish foundation for
Institutional Research
• Data Quality
How many faculty do we have?
• Context and Meaning
What does faculty mean in which
context?
How is faculty data structured and
where is it stored?
• Data Usage Request
Am I allowed to use faculty or student
name and age for external reporting?
SUDS: Approach
• Decentralized
 1 DG coordinator (also show vacancy)
 Project staff
 cross-functional working groups : natural scope
and resources
 focus on BI reporting, with input from above
projects
 sign off by DG coordinator and end user through
usage (full cycle)
• Step-by step; success by success
SUDS: First Success in OBIEE
reporting
REST / JSON / CSV / Excel
DG Operating Model
• What do we want to capture?
Asset Type: Business Terms, Policies, Rules, Code
Values
Attribute/Relation Type: Name, Definition, Example,
Derivations, Specializations
• Who should be involved in this process?
Communities: Finance, HR, Student, Research
Domains / subject areas: Task Management
Users and User groups
• How to execute and Monitor the process?
Key events and workflow chains
Validation rules
SUDS Data Dictionary Example
+4000 data elements
Community context: Finance, HR,
Research and Student
Custom attribute types and relation types
What attribute- and relation-types do we want to capture?
Out of the box but also custom
attribute types and relation types
What attribute- and relation-types do we want to capture?
• https://stanford.app.box.com/CollibraQuickReference
• https://stanford.box.com/UsingCollibraFields
Who is involved in the
process?
• https://compass.collibra.com/display/COOK/Role+Ty
pes
ResponsibleAccountable Informed Consulted
Who? User groups and
Dashboards
Who? – User groups and Dashboards
How to execute and monitor?
From Best Practice to Auto-Validation Rules
http://web.stanford.edu/dept/pres-provost/cgi-bin/dg/wordpress/?p=577
(generic example – not from SUDS)
How to execute and monitor?
• Status Types and Workflows
E.g., For Domains, Terms, Users, and later for Issues and Data Sharing
Agreements, we first define a “finite state machine” and then a set of
workflows that each define a transition between states. This means
workflows can trigger each other and form a complex chain.
BUSINESS SEMANTICS GLOSSARY
Candidate In Progress
Under Review
Accepted In Revision
Rejected
Term requested on
the domain page
11
1
2
2
3
3
2
3
Depricated
4
5
Workflows
1
2
Propose Business Term
Edit Business Term
3 Onboarding Business Term
4 Deprecate Business Term
5 Reactivate Business Term
How it it to be governed? Onboarding Workflow
(Not Stanford content - illustrative example only)
How it it to be governed? Approval Workflow
(not Stanford content - illustrative example only)
Stanford DG Program Key Results
(from http://web.stanford.edu/dept/pres-provost/cgi-bin/dg/wordpress/wp-content/uploads/2014/11/Stanford_DS_CAIR_v2.pdf
• Understand data from multiple
perspectives
• Central repository of verified information
(and better data infrastructure)
• Easier access to information; less reliance
on ‘oral tradition’
• Improved data quality, consistency
• Increased understanding; thoughtful
decision-making around data
SUDS Future Directions
• Continue building engagement around
data governance (define policy), in
addition to data stewardship (enforce
policy)
• Continue building engagement, especially
by executive-level leadership
• Continue increasing visibility and
consumption of definitions and other
metadata
George Washington University
(by courtesy of Ron Layne, GWU)
• centralized
• run by the DG Office division of IT
• mapping data dictionaries, rules and metrics and data sharing
agreements
• Integration with Informatica Data Quality
Flanders Research Information Space
• Providing Scientific Research Information and
Services
• Easy
• Transparent
• Open
• Timely
• Unambiguous
• Supported by Data Governance
• Qualitative meta data: e.g., definition for
project, funding codes, mappings,
classifications, etc.
• Roles and responsibilities for Information
Providers and Stiweto
• Collaborative workflows between Information
Providers and Stiweto
By courtesy of G. Van Grootel, EWI
FRIS’ Data-driven Innovation Engine
By courtesy of G. Van Grootel, EWI
The Data providers landscape
25
Universities
Research Institutes
Funders
Others
Strategic Research
Centers
Universitiy Colleges
By courtesy of G. Van Grootel, EWI
FRIS Metamodel: an example
By courtesy of G. Van Grootel, EWI
Traceability diagram
Node Description
JRC (Joint Research Centre) The Business Term representing the
Funding Source
Zevende Kader Programma.. The Business Term representin the
parent Funding Source
3723 Generation 1 Funding Code Value
258 Generation 2 Funding Code Value
G3 The Funding Stream Code Value
By courtesy of G. Van Grootel, EW
Conclusions
• Case by Case, success by success
• Identify key events and design workflow
‘chains’ to automate governance
• To support your specific use case and the
growing DG platform you need extend
asset, relation, attribute types
• Collaboration and business user
friendliness
• BOK http://compass.collibra.com
Questions For Audience
• How much % of data user need to look up
the definition of a term?
• How many % wants to know where data
around a term is stored.
• How many business terms do you have?
• Who is in charge for data quality /
governance ?
• How much % of data definition decisions
depends on business?

More Related Content

What's hot

Data Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to MeshData Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to Mesh
Jeffrey T. Pollock
 

What's hot (20)

Data Modeling Best Practices - Business & Technical Approaches
Data Modeling Best Practices - Business & Technical ApproachesData Modeling Best Practices - Business & Technical Approaches
Data Modeling Best Practices - Business & Technical Approaches
 
Activate Data Governance Using the Data Catalog
Activate Data Governance Using the Data CatalogActivate Data Governance Using the Data Catalog
Activate Data Governance Using the Data Catalog
 
Strategic Business Requirements for Master Data Management Systems
Strategic Business Requirements for Master Data Management SystemsStrategic Business Requirements for Master Data Management Systems
Strategic Business Requirements for Master Data Management Systems
 
Data Lakehouse, Data Mesh, and Data Fabric (r1)
Data Lakehouse, Data Mesh, and Data Fabric (r1)Data Lakehouse, Data Mesh, and Data Fabric (r1)
Data Lakehouse, Data Mesh, and Data Fabric (r1)
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business Goals
 
Intuit's Data Mesh - Data Mesh Leaning Community meetup 5.13.2021
Intuit's Data Mesh - Data Mesh Leaning Community meetup 5.13.2021Intuit's Data Mesh - Data Mesh Leaning Community meetup 5.13.2021
Intuit's Data Mesh - Data Mesh Leaning Community meetup 5.13.2021
 
Modernizing to a Cloud Data Architecture
Modernizing to a Cloud Data ArchitectureModernizing to a Cloud Data Architecture
Modernizing to a Cloud Data Architecture
 
Data Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to MeshData Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to Mesh
 
Data Governance
Data GovernanceData Governance
Data Governance
 
Data Governance — Aligning Technical and Business Approaches
Data Governance — Aligning Technical and Business ApproachesData Governance — Aligning Technical and Business Approaches
Data Governance — Aligning Technical and Business Approaches
 
Data Governance and Metadata Management
Data Governance and Metadata ManagementData Governance and Metadata Management
Data Governance and Metadata Management
 
Enterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data ArchitectureEnterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data Architecture
 
Data Governance Powerpoint Presentation Slides
Data Governance Powerpoint Presentation SlidesData Governance Powerpoint Presentation Slides
Data Governance Powerpoint Presentation Slides
 
Webinar Data Mesh - Part 3
Webinar Data Mesh - Part 3Webinar Data Mesh - Part 3
Webinar Data Mesh - Part 3
 
Data modelling 101
Data modelling 101Data modelling 101
Data modelling 101
 
Best Practices in Metadata Management
Best Practices in Metadata ManagementBest Practices in Metadata Management
Best Practices in Metadata Management
 
The ABCs of Treating Data as Product
The ABCs of Treating Data as ProductThe ABCs of Treating Data as Product
The ABCs of Treating Data as Product
 
DMBOK and Data Governance
DMBOK and Data GovernanceDMBOK and Data Governance
DMBOK and Data Governance
 
2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics
 
Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?
 

Similar to The Data Driven University - Automating Data Governance and Stewardship in Autonomous and Decentralized University Environments

Data warehouse 101-fundamentals-
Data warehouse 101-fundamentals-Data warehouse 101-fundamentals-
Data warehouse 101-fundamentals-
AshishGuleria
 
Data-Ed: Trends in Data Modeling
Data-Ed: Trends in Data ModelingData-Ed: Trends in Data Modeling
Data-Ed: Trends in Data Modeling
Data Blueprint
 
Seminoles United Consolidated Advancement Project
Seminoles United Consolidated Advancement ProjectSeminoles United Consolidated Advancement Project
Seminoles United Consolidated Advancement Project
Wendy Jaccard
 
Data managementfornonprofits 2014-06-19
Data managementfornonprofits   2014-06-19Data managementfornonprofits   2014-06-19
Data managementfornonprofits 2014-06-19
501 Commons
 
Data-Ed: Unlock Business Value through Data Quality Engineering
Data-Ed: Unlock Business Value through Data Quality EngineeringData-Ed: Unlock Business Value through Data Quality Engineering
Data-Ed: Unlock Business Value through Data Quality Engineering
DATAVERSITY
 

Similar to The Data Driven University - Automating Data Governance and Stewardship in Autonomous and Decentralized University Environments (20)

Business Semantics for Data Governance and Stewardship
Business Semantics for Data Governance and StewardshipBusiness Semantics for Data Governance and Stewardship
Business Semantics for Data Governance and Stewardship
 
Data warehouse 101-fundamentals-
Data warehouse 101-fundamentals-Data warehouse 101-fundamentals-
Data warehouse 101-fundamentals-
 
Data-Ed: Trends in Data Modeling
Data-Ed: Trends in Data ModelingData-Ed: Trends in Data Modeling
Data-Ed: Trends in Data Modeling
 
Data-Ed Online: Trends in Data Modeling
Data-Ed Online: Trends in Data ModelingData-Ed Online: Trends in Data Modeling
Data-Ed Online: Trends in Data Modeling
 
EPF-datagov-part1-1.pdf
EPF-datagov-part1-1.pdfEPF-datagov-part1-1.pdf
EPF-datagov-part1-1.pdf
 
jgordonres112015
jgordonres112015jgordonres112015
jgordonres112015
 
Charles Rygula: Value Beyond Words
Charles Rygula: Value Beyond WordsCharles Rygula: Value Beyond Words
Charles Rygula: Value Beyond Words
 
Seminoles United Consolidated Advancement Project
Seminoles United Consolidated Advancement ProjectSeminoles United Consolidated Advancement Project
Seminoles United Consolidated Advancement Project
 
KSU IT Capstone Report 2012-2017.pdf
KSU IT Capstone Report 2012-2017.pdfKSU IT Capstone Report 2012-2017.pdf
KSU IT Capstone Report 2012-2017.pdf
 
User-Centric Design: How to Leverage Use Cases and User Scenarios to Design S...
User-Centric Design: How to Leverage Use Cases and User Scenarios to Design S...User-Centric Design: How to Leverage Use Cases and User Scenarios to Design S...
User-Centric Design: How to Leverage Use Cases and User Scenarios to Design S...
 
Cff data governance best practices
Cff data governance best practicesCff data governance best practices
Cff data governance best practices
 
SPSChicagoBurbs 2019 - What is CDM and CDS?
SPSChicagoBurbs 2019 - What is CDM and CDS?SPSChicagoBurbs 2019 - What is CDM and CDS?
SPSChicagoBurbs 2019 - What is CDM and CDS?
 
Data managementfornonprofits 2014-06-19
Data managementfornonprofits   2014-06-19Data managementfornonprofits   2014-06-19
Data managementfornonprofits 2014-06-19
 
Why Data Standards?
Why Data Standards?Why Data Standards?
Why Data Standards?
 
Data-Ed: Unlock Business Value through Data Quality Engineering
Data-Ed: Unlock Business Value through Data Quality Engineering Data-Ed: Unlock Business Value through Data Quality Engineering
Data-Ed: Unlock Business Value through Data Quality Engineering
 
Data-Ed: Unlock Business Value through Data Quality Engineering
Data-Ed: Unlock Business Value through Data Quality EngineeringData-Ed: Unlock Business Value through Data Quality Engineering
Data-Ed: Unlock Business Value through Data Quality Engineering
 
DGIQ - Case Studies_ Applications of Data Governance in the Enterprise (Final...
DGIQ - Case Studies_ Applications of Data Governance in the Enterprise (Final...DGIQ - Case Studies_ Applications of Data Governance in the Enterprise (Final...
DGIQ - Case Studies_ Applications of Data Governance in the Enterprise (Final...
 
Jgordonres jan262016
Jgordonres jan262016Jgordonres jan262016
Jgordonres jan262016
 
jgordonresJan262016
jgordonresJan262016jgordonresJan262016
jgordonresJan262016
 
Data Systems Integration & Business Value Pt. 1: Metadata
Data Systems Integration & Business Value Pt. 1: MetadataData Systems Integration & Business Value Pt. 1: Metadata
Data Systems Integration & Business Value Pt. 1: Metadata
 

More from Pieter De Leenheer

More from Pieter De Leenheer (7)

TiE DC GovCon Panel on Emerging Technologies: AI/ML/Blockchain/Data Managemen...
TiE DC GovCon Panel on Emerging Technologies: AI/ML/Blockchain/Data Managemen...TiE DC GovCon Panel on Emerging Technologies: AI/ML/Blockchain/Data Managemen...
TiE DC GovCon Panel on Emerging Technologies: AI/ML/Blockchain/Data Managemen...
 
MIT ICIQ 2017 Keynote: Data Governance and Data Capitalization in the Big Dat...
MIT ICIQ 2017 Keynote: Data Governance and Data Capitalization in the Big Dat...MIT ICIQ 2017 Keynote: Data Governance and Data Capitalization in the Big Dat...
MIT ICIQ 2017 Keynote: Data Governance and Data Capitalization in the Big Dat...
 
Data Governance in a big data era
Data Governance in a big data eraData Governance in a big data era
Data Governance in a big data era
 
Data Governance in the Big Data Era
Data Governance in the Big Data EraData Governance in the Big Data Era
Data Governance in the Big Data Era
 
Data Stewardship and Governance: how to reach global adoption and systematic ...
Data Stewardship and Governance: how to reach global adoption and systematic ...Data Stewardship and Governance: how to reach global adoption and systematic ...
Data Stewardship and Governance: how to reach global adoption and systematic ...
 
Business Service Semantics: Ontological Representation & Governance of Busine...
Business Service Semantics: Ontological Representation & Governance of Busine...Business Service Semantics: Ontological Representation & Governance of Busine...
Business Service Semantics: Ontological Representation & Governance of Busine...
 
Open Standards for the Semantic Web: XML / RDF(S) / OWL / SOAP
Open Standards for the Semantic Web: XML / RDF(S) / OWL / SOAPOpen Standards for the Semantic Web: XML / RDF(S) / OWL / SOAP
Open Standards for the Semantic Web: XML / RDF(S) / OWL / SOAP
 

Recently uploaded

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Recently uploaded (20)

08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 

The Data Driven University - Automating Data Governance and Stewardship in Autonomous and Decentralized University Environments

  • 1. The Data Driven University Automating Data Governance & Stewardship in Autonomous & Decentralized Environments Pieter De Leenheer, PhD Cofounder and VP Innovation
  • 2. What we talk about when we talk about no Data Governance Who approved this? I wish these guys spoke our language I can’t understand this report ! I’ve never seen this funding code! Who introduced this ? Are we sure this definition of ‘professor’ is correct ? The Problem This rule is different on our campus! Are we allowed to share this student data with IR?
  • 3. Glossary Search • How frequently do you look up a word for your business? • To what purpose? Clarification Differentiation • What are your main sources? • Hierarchy-based navigation or key-word based search? • Authoritative Truth or trust?
  • 4. Overview • Data Governance Operating Framework Data Governance Data Stewardship Data Management • Implementations Stanford University Data Stewardship (SUDS) George Washington University Brigham Young University • The Bigger Picture Inter-university Data Governance in the Flanders Research Information Space
  • 5. Data Governance Framework Data Governance Council: Governance Operating Model Roles & Responsibilities Processes & Workflow Asset Types & Traceability Data Governance Organization Data Stewardship Activities Data Quality Development IT / Operational Data Management Activities Data Modeling Metadata Lineage Establishes& drives Aligns& Coordinates Reports& Escalates Monitors& Remediates Metadata Scanning Reference Data Authoring Data Integration Collibra Business Semantics Glossary (BSG) Collibra Reference Data Accelerator (RDA) Hierarchy Management Business & Data Definitions Business Traceability Semantic Modeling Mapping Specifications Policy Management Business Rules Data Quality Rules Data Quality Reporting Issue Management Reference Data Crosswalks Master Data Stewardship Data Quality Profiling DQ Defect Resolution Collibra Data Stewardship Manager (DSM) Collibra Platform Other Data Management Vendor products ... https://compass.collibra.com/display/COOK/Data+Governance+Operating+Model
  • 6. Stanford University Data Stewardship (SUDS) • All Materials available here dg.stanford.edu • Establish foundation for Institutional Research • Data Quality How many faculty do we have? • Context and Meaning What does faculty mean in which context? How is faculty data structured and where is it stored? • Data Usage Request Am I allowed to use faculty or student name and age for external reporting?
  • 7. SUDS: Approach • Decentralized  1 DG coordinator (also show vacancy)  Project staff  cross-functional working groups : natural scope and resources  focus on BI reporting, with input from above projects  sign off by DG coordinator and end user through usage (full cycle) • Step-by step; success by success
  • 8. SUDS: First Success in OBIEE reporting REST / JSON / CSV / Excel
  • 9. DG Operating Model • What do we want to capture? Asset Type: Business Terms, Policies, Rules, Code Values Attribute/Relation Type: Name, Definition, Example, Derivations, Specializations • Who should be involved in this process? Communities: Finance, HR, Student, Research Domains / subject areas: Task Management Users and User groups • How to execute and Monitor the process? Key events and workflow chains Validation rules
  • 10. SUDS Data Dictionary Example +4000 data elements Community context: Finance, HR, Research and Student Custom attribute types and relation types
  • 11. What attribute- and relation-types do we want to capture? Out of the box but also custom attribute types and relation types
  • 12. What attribute- and relation-types do we want to capture? • https://stanford.app.box.com/CollibraQuickReference • https://stanford.box.com/UsingCollibraFields
  • 13. Who is involved in the process? • https://compass.collibra.com/display/COOK/Role+Ty pes ResponsibleAccountable Informed Consulted
  • 14. Who? User groups and Dashboards
  • 15. Who? – User groups and Dashboards
  • 16. How to execute and monitor? From Best Practice to Auto-Validation Rules http://web.stanford.edu/dept/pres-provost/cgi-bin/dg/wordpress/?p=577 (generic example – not from SUDS)
  • 17. How to execute and monitor? • Status Types and Workflows E.g., For Domains, Terms, Users, and later for Issues and Data Sharing Agreements, we first define a “finite state machine” and then a set of workflows that each define a transition between states. This means workflows can trigger each other and form a complex chain. BUSINESS SEMANTICS GLOSSARY Candidate In Progress Under Review Accepted In Revision Rejected Term requested on the domain page 11 1 2 2 3 3 2 3 Depricated 4 5 Workflows 1 2 Propose Business Term Edit Business Term 3 Onboarding Business Term 4 Deprecate Business Term 5 Reactivate Business Term
  • 18. How it it to be governed? Onboarding Workflow (Not Stanford content - illustrative example only)
  • 19. How it it to be governed? Approval Workflow (not Stanford content - illustrative example only)
  • 20. Stanford DG Program Key Results (from http://web.stanford.edu/dept/pres-provost/cgi-bin/dg/wordpress/wp-content/uploads/2014/11/Stanford_DS_CAIR_v2.pdf • Understand data from multiple perspectives • Central repository of verified information (and better data infrastructure) • Easier access to information; less reliance on ‘oral tradition’ • Improved data quality, consistency • Increased understanding; thoughtful decision-making around data
  • 21. SUDS Future Directions • Continue building engagement around data governance (define policy), in addition to data stewardship (enforce policy) • Continue building engagement, especially by executive-level leadership • Continue increasing visibility and consumption of definitions and other metadata
  • 22. George Washington University (by courtesy of Ron Layne, GWU) • centralized • run by the DG Office division of IT • mapping data dictionaries, rules and metrics and data sharing agreements • Integration with Informatica Data Quality
  • 23. Flanders Research Information Space • Providing Scientific Research Information and Services • Easy • Transparent • Open • Timely • Unambiguous • Supported by Data Governance • Qualitative meta data: e.g., definition for project, funding codes, mappings, classifications, etc. • Roles and responsibilities for Information Providers and Stiweto • Collaborative workflows between Information Providers and Stiweto By courtesy of G. Van Grootel, EWI
  • 24. FRIS’ Data-driven Innovation Engine By courtesy of G. Van Grootel, EWI
  • 25. The Data providers landscape 25 Universities Research Institutes Funders Others Strategic Research Centers Universitiy Colleges By courtesy of G. Van Grootel, EWI
  • 26. FRIS Metamodel: an example By courtesy of G. Van Grootel, EWI
  • 27. Traceability diagram Node Description JRC (Joint Research Centre) The Business Term representing the Funding Source Zevende Kader Programma.. The Business Term representin the parent Funding Source 3723 Generation 1 Funding Code Value 258 Generation 2 Funding Code Value G3 The Funding Stream Code Value By courtesy of G. Van Grootel, EW
  • 28. Conclusions • Case by Case, success by success • Identify key events and design workflow ‘chains’ to automate governance • To support your specific use case and the growing DG platform you need extend asset, relation, attribute types • Collaboration and business user friendliness • BOK http://compass.collibra.com
  • 29. Questions For Audience • How much % of data user need to look up the definition of a term? • How many % wants to know where data around a term is stored. • How many business terms do you have? • Who is in charge for data quality / governance ? • How much % of data definition decisions depends on business?

Editor's Notes

  1. Audience from various academic institutions before collibra I was a researcher and assisttant prof in 3 univ In fact collibra is a university spinoff valorising the research on data govenance, ontologies and semantics web.
  2. We should know how universities tick. From my own experience as an employee and as vendor I think I know how university departments thrive as decentralized and autonomous entities. No data governance does not mean data quality can be managed good. It us just that globalization and increased data servicing between university entities that makes quality and truth of data relative, and we more and more have to rely on mutual trust.
  3. Put yourself in the user of your data. An consider these questions ?
  4. Stewardship activities doing: scattered, no unified operatnig model and no clear sight on the results of doing it.
  5. Een goede cae om dit te illustreren is de Vlaamse departement van Economie, Wetenschap en Innovatie.
  6. Logo’s van alle Hogescholen post fusie
  7. Illustrates the implemented FRIS Metamodel in the DGC operational model. Allows for formal named relations between the different FRIS Business leveling model concepts