SlideShare a Scribd company logo
1 of 1
Download to read offline
Information and Integration Management (IIM)Colin Bell <cpbell@uwaterloo.ca> - December 2016
Operational Data Stores
Relational databases created by extracting,
transforming, and loading data from operational
systems into restructured logical data models.
Dimensional Data Stores
Relational databases created by extracting,
transforming, and loading data conformed to a star
schema from operational data stores.
Non-Relational Data Stores
Data storage platforms that allow arbitrary data to
be stored. Data can usually be paired with
metadata.
Graph Data Stores
Data storage platforms to capture sets of nodes
and their relationships.
Distributed Data Processing
Data processing platforms allow data processing
workloads to be spread between a number of
hosts. Allows large scale search and inquiry.
Distributed Transaction Stores
Data storage for transaction records maintained in
distributed chains of cryptographically signed
blocks.
Data Access, Lineage, and
Provenance
Interfaces that allow access to core data elements,
meaning of those data elements, and associated
lifecycle / origin metadata
Cognitive Processing (AI)
Semantic modelling, natural language, machine
learning, and cognitive systems to support data
processing.
DataManagementPlatform
On-Premise
QUEST
QUEST
DB
PeopleSoft
CS
Waterloo Works
Works
DB
Orbis
Comms.
Request Tracker (RT)
RT DB
Best
Practical RT
Library
Library
DB
Product
Names
System Name
Database
Name
Product
Name
Operational Systems
The systems running on-premise or in the cloud
that support University operations.
Cloud
Finance
Aggresso
DB
Business
World ERP
Learn
Learn DB
Brightspace
Student Email
Office
Cloud
Office 365
Research
Pure DB
Pure
System Name
Database
Name
Product
Name
InformationLifecycleManagement
KeyCampusRelationships
Secretariat (SEC)
Information and Integration Management (IIM) will support SEC’s University
Records Manager and Privacy Officer through metadata management around
records, data requests, and data uses on campus.
Institutional Analysis and Planning (IAP)
The Director, Institutional Analysis and Planning, "designs measures and collects data to
assess University-wide goals and objectives and coordinates the design, implementation
and management of a University-wide decision support data warehouse.”
Information and Integration Management (IIM) will support IAP in this effort as a data broker
and technical support partner. IIM will be focused on providing high quality data feeds from
operational systems to support IAP’s designed measures on University-wide goals and
objectives.
IAP will implement and manage data warehousing for designed measures and official
reporting/analysis purposes. Internal and external governance reporting and strategic
planning will be serviced from IAP’s warehousing. IIM will support IAP by providing access to
knowledge, expertise, tooling, information infrastructure, and captured data elements.
IST-IIM
Data Capture, Cleaning, and
Enrichment
Capability to capture, clean, and enrich disparate
large volume static or streaming data sources.
Make unstructured, semi-structured, and
structured data a valuable asset.
De-identification of Personal
Information
Capability to de-identify, redact, pseudonymize,
and anonymize data. Transform Personally
Identifiable Information (PII) so that it can be used
in analysis without presenting a privacy risk.
Information Cataloging,
Documentation, and Metadata
Management
Capability to catalog data elements, document
them through information modelling, and describe
them with metadata.
Institutional Analysis
and Planning
(IAP)
Secretariat
(SEC)
University Community
Mission
This group exists at the University of Waterloo to provide the knowledge, expertise, and centralized
capability required to make information a valuable asset for the University—to create a trusted
information asset base to support the University.
Vision
If useful information exists, make it a competitive advantage for Waterloo; capture, organize, and make
information accessible for future decision making.
Policy 46
Principles and Practices
Accountability and
Accessibility
Privacy and
Confidentiality
Compliance
Information Quality Information Security
Information Lifecycle
Management
Capture Organize Store Use Disposition
Digital Imaging &
Auto-Uploads
Coding &
Indexing
Backups &
Versioning
Business Process
Workflows
Retention Schedules &
Record Destruction
IndexCatalog
SearchDiscover
Access Uses
Privacy Risk
Document Management
Physical
Document
Digital
Document
Digital
Imaging
Captured Document
Document
Metadata
Coding and
Indexing
Document
Document
Metadata
Business
Processing
Workflows
Retention /
Disposition
Schedule
Record of
Disposition
Case
Delivery
Plan
Case
Case Event Case Activity
Case
Communication
Case
Participant
Case
Output
Case
Outcome
Case
Document
includes
Case
Facility
Case Party
Relationship
Case
Location
Case-Party-Document Model
Content Management
Sharepoint
WCMS
Network Drives
Email Archives
Confluence
InformationandIntegrationManagement
Meaning and Metadata
Physical
Logical
Conceptual
Data Models
Information Models
Semantic Models Ontologies
Glossaries and
Taxonomies
Data Element
Rules and Definitions
Metadata
Management
A robust metadata management capability
and platform is crucial to the University’s
ability to leverage its information assets.
Capture Organize
Storage
Use Disposition
Integration Platform
Current State Integration Future State Integration
Most systems follow a point-to-point
integration pattern.
Data is exchanged through batch copies.
Some exchange is through direct database
links increasing complexity of change
efforts.
Pattern of operations is effective but
inefficient.
Duplication Complexity
Inaccuracy Risk
Dept Sys Dept Sys Dept Sys Dept Sys
Faculty Sys Faculty Sys Faculty Sys Faculty Sys
HR
Student Finance
Research
IDM
ReliabilityScalability
EvolvabilityConsistency
Systems flow requests for information
through a common integration platform.
The platform:
- enforces security,
- creates audit logs for lineage/
provenance needs,
- clarifies interpretation/meaning, and;
- captures/creates metadata.
Reduces risks and improves efficiency.
Student
HR
Finance
IAM
Resear
ch
Dept
Sys
Faculty
Open
Data
Enterprise
Integration
Plaform
InnovationPlatform
User-Centric Design (UCD)
Information Architecture User Experience Design (UX) Platform and Agile
Current State
Future State
X Y
Y
Y
X
Y YY X X
Intrapreneurship
As a
user…
http://bit.ly/2h3OFeG
Institute for Government
System Error: Fixing the Flaws
in Government IT.
User Developer
Co-op Co-op
Custom
Web Apps
JIRA
Confluence
CompellingDataEnvironment
System Name
Database
Name
Product
Name
System Name
Database
Name
Product
Name
System Name
Database
Name
Product
Name
Operational Data
Capture
Real-Time
Robust
Reliable
Operational Storage
Dimensional Storage
Non-Relational Storage
Graph Data Storage
Distributed Processing
Transaction Storage
Access, Lineage, and
Provenance
Cognitive (AI) Processing
Identify
De-Identify
Clean
EnrichIndex
Store
Acceptable Uses
Report
Users
Data
Scientists
Data
Access
"DIKW Pyramid" by Longlivetheux - Own work. Licensed under CC BY-SA 4.0 via Commons
https://commons.wikimedia.org/wiki/File:DIKW_Pyramid.svg#/media/File:DIKW_Pyramid.svg
Unstructured
Information
“Documents”
Semi-Structured
Information
“Content”
Structured
Information
“Data”
Tableau
Jupyter Notebooks
(Python, R, F#)
Sharepoint
(MSBI)
Visualization
Users
Power BI
Reporting Services
SQL Server
Dapper.NET APIs
Ad-Hoc
Inquiry
Users
Excel
Meaning and
Metadata
Information and Integration Management
Data Curation
QlikView
InformationAssetBase
Local Unit
Operational,
Tactical, and
Strategic
Documentation
Information
System
Architecture
Documentation
Internal and
External
Governance
Reporting
Project / Initative
Documentation
Web Content
Service
Documentation
Information System
Logs
Data
Documentation
…
…
http://motivationmodel.com/
Information Asset
Base
Information
Portfolio
Process
Portfolio
Service
Portfolio
HR
Portfolio
Financial
Portfolio Strategy
Portfolio
Technology
Portfolio
Strategic
Information
Stream
Application
Portfolio
Project
Portfolio

More Related Content

What's hot

Data mining
Data mining Data mining
Data mining AthiraR23
 
Building an Enterprise Metadata Repository
Building an Enterprise Metadata RepositoryBuilding an Enterprise Metadata Repository
Building an Enterprise Metadata RepositoryEmbarcadero Technologies
 
Data mining concepts and work
Data mining concepts and workData mining concepts and work
Data mining concepts and workAmr Abd El Latief
 
Introduction to metadata management
Introduction to metadata managementIntroduction to metadata management
Introduction to metadata managementOpen Data Support
 
DOCUMENT SELECTION USING MAPREDUCE
DOCUMENT SELECTION USING MAPREDUCEDOCUMENT SELECTION USING MAPREDUCE
DOCUMENT SELECTION USING MAPREDUCEijsptm
 
Company Metadata and Master Data Management Unit 9 Assigment 1 Jessica Graf
Company Metadata and Master Data Management Unit 9 Assigment 1 Jessica GrafCompany Metadata and Master Data Management Unit 9 Assigment 1 Jessica Graf
Company Metadata and Master Data Management Unit 9 Assigment 1 Jessica GrafJessica Graf
 
A Practical Approach To Data Mining Presentation
A Practical Approach To Data Mining PresentationA Practical Approach To Data Mining Presentation
A Practical Approach To Data Mining Presentationmillerca2
 
Data Warehouse and Data Mining
Data Warehouse and Data MiningData Warehouse and Data Mining
Data Warehouse and Data MiningRanak Ghosh
 
Additional themes of data mining for Msc CS
Additional themes of data mining for Msc CSAdditional themes of data mining for Msc CS
Additional themes of data mining for Msc CSThanveen
 
Datamining - On What Kind of Data
Datamining - On What Kind of DataDatamining - On What Kind of Data
Datamining - On What Kind of Datawina wulansari
 
Artificial Intelligence: Data Mining
Artificial Intelligence: Data MiningArtificial Intelligence: Data Mining
Artificial Intelligence: Data MiningThe Integral Worm
 
data mining and data warehousing
data mining and data warehousingdata mining and data warehousing
data mining and data warehousingSunny Gandhi
 
The Metadata Secret in Your Data
The Metadata Secret in Your DataThe Metadata Secret in Your Data
The Metadata Secret in Your DataEverteam
 
Data warehousing
Data warehousingData warehousing
Data warehousingkeeyre
 

What's hot (20)

Data mining notes
Data mining notesData mining notes
Data mining notes
 
Introduction
IntroductionIntroduction
Introduction
 
Data mining
Data mining Data mining
Data mining
 
Data mining
Data mining Data mining
Data mining
 
Building an Enterprise Metadata Repository
Building an Enterprise Metadata RepositoryBuilding an Enterprise Metadata Repository
Building an Enterprise Metadata Repository
 
Data mining concepts and work
Data mining concepts and workData mining concepts and work
Data mining concepts and work
 
Introduction to metadata management
Introduction to metadata managementIntroduction to metadata management
Introduction to metadata management
 
DOCUMENT SELECTION USING MAPREDUCE
DOCUMENT SELECTION USING MAPREDUCEDOCUMENT SELECTION USING MAPREDUCE
DOCUMENT SELECTION USING MAPREDUCE
 
Company Metadata and Master Data Management Unit 9 Assigment 1 Jessica Graf
Company Metadata and Master Data Management Unit 9 Assigment 1 Jessica GrafCompany Metadata and Master Data Management Unit 9 Assigment 1 Jessica Graf
Company Metadata and Master Data Management Unit 9 Assigment 1 Jessica Graf
 
Metadata in Business Intelligence
Metadata in Business IntelligenceMetadata in Business Intelligence
Metadata in Business Intelligence
 
A Practical Approach To Data Mining Presentation
A Practical Approach To Data Mining PresentationA Practical Approach To Data Mining Presentation
A Practical Approach To Data Mining Presentation
 
Data Warehouse and Data Mining
Data Warehouse and Data MiningData Warehouse and Data Mining
Data Warehouse and Data Mining
 
Additional themes of data mining for Msc CS
Additional themes of data mining for Msc CSAdditional themes of data mining for Msc CS
Additional themes of data mining for Msc CS
 
Unit 3 part i Data mining
Unit 3 part i Data miningUnit 3 part i Data mining
Unit 3 part i Data mining
 
Datamining - On What Kind of Data
Datamining - On What Kind of DataDatamining - On What Kind of Data
Datamining - On What Kind of Data
 
Artificial Intelligence: Data Mining
Artificial Intelligence: Data MiningArtificial Intelligence: Data Mining
Artificial Intelligence: Data Mining
 
Metadata
MetadataMetadata
Metadata
 
data mining and data warehousing
data mining and data warehousingdata mining and data warehousing
data mining and data warehousing
 
The Metadata Secret in Your Data
The Metadata Secret in Your DataThe Metadata Secret in Your Data
The Metadata Secret in Your Data
 
Data warehousing
Data warehousingData warehousing
Data warehousing
 

Similar to Information and Integration Management Vision

Data lake benefits
Data lake benefitsData lake benefits
Data lake benefitsRicky Barron
 
BDA Mod1@AzDOCUMENTS.in.pdf
BDA Mod1@AzDOCUMENTS.in.pdfBDA Mod1@AzDOCUMENTS.in.pdf
BDA Mod1@AzDOCUMENTS.in.pdfJayanthSram
 
Decoding the Role of a Data Engineer.pdf
Decoding the Role of a Data Engineer.pdfDecoding the Role of a Data Engineer.pdf
Decoding the Role of a Data Engineer.pdfDatavalley.ai
 
DATAWAREHOUSE MAIn under data mining for
DATAWAREHOUSE MAIn under data mining forDATAWAREHOUSE MAIn under data mining for
DATAWAREHOUSE MAIn under data mining forAyushMeraki1
 
IT for Management On-Demand Strategies for Performance, Growth,.docx
IT for Management On-Demand Strategies for Performance, Growth,.docxIT for Management On-Demand Strategies for Performance, Growth,.docx
IT for Management On-Demand Strategies for Performance, Growth,.docxvrickens
 
Unit III Introduction to DWH.pdf
Unit III Introduction to DWH.pdfUnit III Introduction to DWH.pdf
Unit III Introduction to DWH.pdfShivarkarSandip
 
data collection, data integration, data management, data modeling.pptx
data collection, data integration, data management, data modeling.pptxdata collection, data integration, data management, data modeling.pptx
data collection, data integration, data management, data modeling.pptxSourabhkumar729579
 
data resource management
 data resource management data resource management
data resource managementsoodsurbhi123
 
Top 60+ Data Warehouse Interview Questions and Answers.pdf
Top 60+ Data Warehouse Interview Questions and Answers.pdfTop 60+ Data Warehouse Interview Questions and Answers.pdf
Top 60+ Data Warehouse Interview Questions and Answers.pdfDatacademy.ai
 
introduction to data warehousing
introduction to data warehousingintroduction to data warehousing
introduction to data warehousingssuser2e437f
 
[DSC Europe 23] Milos Solujic - Data Lakehouse Revolutionizing Data Managemen...
[DSC Europe 23] Milos Solujic - Data Lakehouse Revolutionizing Data Managemen...[DSC Europe 23] Milos Solujic - Data Lakehouse Revolutionizing Data Managemen...
[DSC Europe 23] Milos Solujic - Data Lakehouse Revolutionizing Data Managemen...DataScienceConferenc1
 
Data warehouse
Data warehouseData warehouse
Data warehouseRajThakuri
 
CWIN17 India / Bigdata architecture yashowardhan sowale
CWIN17 India / Bigdata architecture  yashowardhan sowaleCWIN17 India / Bigdata architecture  yashowardhan sowale
CWIN17 India / Bigdata architecture yashowardhan sowaleCapgemini
 
Security issues in big data
Security issues in big data Security issues in big data
Security issues in big data Shallote Dsouza
 
8 Guiding Principles to Kickstart Your Healthcare Big Data Project
8 Guiding Principles to Kickstart Your Healthcare Big Data Project8 Guiding Principles to Kickstart Your Healthcare Big Data Project
8 Guiding Principles to Kickstart Your Healthcare Big Data ProjectCitiusTech
 

Similar to Information and Integration Management Vision (20)

Data Science
Data ScienceData Science
Data Science
 
Kaizentric Presentation
Kaizentric PresentationKaizentric Presentation
Kaizentric Presentation
 
Data lake benefits
Data lake benefitsData lake benefits
Data lake benefits
 
BDA Mod1@AzDOCUMENTS.in.pdf
BDA Mod1@AzDOCUMENTS.in.pdfBDA Mod1@AzDOCUMENTS.in.pdf
BDA Mod1@AzDOCUMENTS.in.pdf
 
Decoding the Role of a Data Engineer.pdf
Decoding the Role of a Data Engineer.pdfDecoding the Role of a Data Engineer.pdf
Decoding the Role of a Data Engineer.pdf
 
Unit Ii
Unit IiUnit Ii
Unit Ii
 
DATAWAREHOUSE MAIn under data mining for
DATAWAREHOUSE MAIn under data mining forDATAWAREHOUSE MAIn under data mining for
DATAWAREHOUSE MAIn under data mining for
 
IT for Management On-Demand Strategies for Performance, Growth,.docx
IT for Management On-Demand Strategies for Performance, Growth,.docxIT for Management On-Demand Strategies for Performance, Growth,.docx
IT for Management On-Demand Strategies for Performance, Growth,.docx
 
Unit III Introduction to DWH.pdf
Unit III Introduction to DWH.pdfUnit III Introduction to DWH.pdf
Unit III Introduction to DWH.pdf
 
data collection, data integration, data management, data modeling.pptx
data collection, data integration, data management, data modeling.pptxdata collection, data integration, data management, data modeling.pptx
data collection, data integration, data management, data modeling.pptx
 
data resource management
 data resource management data resource management
data resource management
 
Top 60+ Data Warehouse Interview Questions and Answers.pdf
Top 60+ Data Warehouse Interview Questions and Answers.pdfTop 60+ Data Warehouse Interview Questions and Answers.pdf
Top 60+ Data Warehouse Interview Questions and Answers.pdf
 
introduction to data warehousing
introduction to data warehousingintroduction to data warehousing
introduction to data warehousing
 
[DSC Europe 23] Milos Solujic - Data Lakehouse Revolutionizing Data Managemen...
[DSC Europe 23] Milos Solujic - Data Lakehouse Revolutionizing Data Managemen...[DSC Europe 23] Milos Solujic - Data Lakehouse Revolutionizing Data Managemen...
[DSC Europe 23] Milos Solujic - Data Lakehouse Revolutionizing Data Managemen...
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Big data
Big dataBig data
Big data
 
DataPlatform.pptx
DataPlatform.pptxDataPlatform.pptx
DataPlatform.pptx
 
CWIN17 India / Bigdata architecture yashowardhan sowale
CWIN17 India / Bigdata architecture  yashowardhan sowaleCWIN17 India / Bigdata architecture  yashowardhan sowale
CWIN17 India / Bigdata architecture yashowardhan sowale
 
Security issues in big data
Security issues in big data Security issues in big data
Security issues in big data
 
8 Guiding Principles to Kickstart Your Healthcare Big Data Project
8 Guiding Principles to Kickstart Your Healthcare Big Data Project8 Guiding Principles to Kickstart Your Healthcare Big Data Project
8 Guiding Principles to Kickstart Your Healthcare Big Data Project
 

More from Colin Bell

Service-Oriented Architectures and the Services Oriented Enterprise
Service-Oriented Architectures and the Services Oriented EnterpriseService-Oriented Architectures and the Services Oriented Enterprise
Service-Oriented Architectures and the Services Oriented EnterpriseColin Bell
 
Progress IST-EA: Role, Responsibilities, and Activities
Progress IST-EA: Role, Responsibilities, and ActivitiesProgress IST-EA: Role, Responsibilities, and Activities
Progress IST-EA: Role, Responsibilities, and ActivitiesColin Bell
 
Do More with Less: Semantic Technologies
Do More with Less: Semantic TechnologiesDo More with Less: Semantic Technologies
Do More with Less: Semantic TechnologiesColin Bell
 
ITANA 2016: API Architecture and Implementation
ITANA 2016: API Architecture and ImplementationITANA 2016: API Architecture and Implementation
ITANA 2016: API Architecture and ImplementationColin Bell
 
WatITis2012: The Service Oriented Enterprise (SOE) [cpbell]
WatITis2012: The Service Oriented Enterprise (SOE) [cpbell]WatITis2012: The Service Oriented Enterprise (SOE) [cpbell]
WatITis2012: The Service Oriented Enterprise (SOE) [cpbell]Colin Bell
 
WatITis2013: Why API? (cpbell)
WatITis2013: Why API? (cpbell)WatITis2013: Why API? (cpbell)
WatITis2013: Why API? (cpbell)Colin Bell
 
Social Graphs and Semantic Analytics
Social Graphs and Semantic AnalyticsSocial Graphs and Semantic Analytics
Social Graphs and Semantic AnalyticsColin Bell
 
cs241-f06-final-overview
cs241-f06-final-overviewcs241-f06-final-overview
cs241-f06-final-overviewColin Bell
 
OUCC2015 Service Oriented Enterprise (SOE)
OUCC2015 Service Oriented Enterprise (SOE)OUCC2015 Service Oriented Enterprise (SOE)
OUCC2015 Service Oriented Enterprise (SOE)Colin Bell
 
FINAL-PDAG-May2016--IST-EA-Update
FINAL-PDAG-May2016--IST-EA-UpdateFINAL-PDAG-May2016--IST-EA-Update
FINAL-PDAG-May2016--IST-EA-UpdateColin Bell
 

More from Colin Bell (10)

Service-Oriented Architectures and the Services Oriented Enterprise
Service-Oriented Architectures and the Services Oriented EnterpriseService-Oriented Architectures and the Services Oriented Enterprise
Service-Oriented Architectures and the Services Oriented Enterprise
 
Progress IST-EA: Role, Responsibilities, and Activities
Progress IST-EA: Role, Responsibilities, and ActivitiesProgress IST-EA: Role, Responsibilities, and Activities
Progress IST-EA: Role, Responsibilities, and Activities
 
Do More with Less: Semantic Technologies
Do More with Less: Semantic TechnologiesDo More with Less: Semantic Technologies
Do More with Less: Semantic Technologies
 
ITANA 2016: API Architecture and Implementation
ITANA 2016: API Architecture and ImplementationITANA 2016: API Architecture and Implementation
ITANA 2016: API Architecture and Implementation
 
WatITis2012: The Service Oriented Enterprise (SOE) [cpbell]
WatITis2012: The Service Oriented Enterprise (SOE) [cpbell]WatITis2012: The Service Oriented Enterprise (SOE) [cpbell]
WatITis2012: The Service Oriented Enterprise (SOE) [cpbell]
 
WatITis2013: Why API? (cpbell)
WatITis2013: Why API? (cpbell)WatITis2013: Why API? (cpbell)
WatITis2013: Why API? (cpbell)
 
Social Graphs and Semantic Analytics
Social Graphs and Semantic AnalyticsSocial Graphs and Semantic Analytics
Social Graphs and Semantic Analytics
 
cs241-f06-final-overview
cs241-f06-final-overviewcs241-f06-final-overview
cs241-f06-final-overview
 
OUCC2015 Service Oriented Enterprise (SOE)
OUCC2015 Service Oriented Enterprise (SOE)OUCC2015 Service Oriented Enterprise (SOE)
OUCC2015 Service Oriented Enterprise (SOE)
 
FINAL-PDAG-May2016--IST-EA-Update
FINAL-PDAG-May2016--IST-EA-UpdateFINAL-PDAG-May2016--IST-EA-Update
FINAL-PDAG-May2016--IST-EA-Update
 

Recently uploaded

Industrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfIndustrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfLars Albertsson
 
Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingNeil Barnes
 
RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998YohFuh
 
VidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptxVidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptxolyaivanovalion
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAroojKhan71
 
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...Suhani Kapoor
 
Carero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxCarero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxolyaivanovalion
 
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...Suhani Kapoor
 
定制英国白金汉大学毕业证(UCB毕业证书) 成绩单原版一比一
定制英国白金汉大学毕业证(UCB毕业证书)																			成绩单原版一比一定制英国白金汉大学毕业证(UCB毕业证书)																			成绩单原版一比一
定制英国白金汉大学毕业证(UCB毕业证书) 成绩单原版一比一ffjhghh
 
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Callshivangimorya083
 
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptSonatrach
 
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Callshivangimorya083
 
Invezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz1
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxolyaivanovalion
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxolyaivanovalion
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxJohnnyPlasten
 

Recently uploaded (20)

Industrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfIndustrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdf
 
E-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptxE-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptx
 
Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data Storytelling
 
RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998RA-11058_IRR-COMPRESS Do 198 series of 1998
RA-11058_IRR-COMPRESS Do 198 series of 1998
 
VidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptxVidaXL dropshipping via API with DroFx.pptx
VidaXL dropshipping via API with DroFx.pptx
 
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al BarshaAl Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
Al Barsha Escorts $#$ O565212860 $#$ Escort Service In Al Barsha
 
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
VIP Call Girls Service Charbagh { Lucknow Call Girls Service 9548273370 } Boo...
 
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
VIP High Profile Call Girls Amravati Aarushi 8250192130 Independent Escort Se...
 
Carero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxCarero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptx
 
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
 
定制英国白金汉大学毕业证(UCB毕业证书) 成绩单原版一比一
定制英国白金汉大学毕业证(UCB毕业证书)																			成绩单原版一比一定制英国白金汉大学毕业证(UCB毕业证书)																			成绩单原版一比一
定制英国白金汉大学毕业证(UCB毕业证书) 成绩单原版一比一
 
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
 
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.pptdokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
dokumen.tips_chapter-4-transient-heat-conduction-mehmet-kanoglu.ppt
 
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls Punjabi Bagh 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
 
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in  KishangarhDelhi 99530 vip 56974 Genuine Escort Service Call Girls in  Kishangarh
Delhi 99530 vip 56974 Genuine Escort Service Call Girls in Kishangarh
 
Invezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signals
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptx
 
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFx
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptx
 

Information and Integration Management Vision

  • 1. Information and Integration Management (IIM)Colin Bell <cpbell@uwaterloo.ca> - December 2016 Operational Data Stores Relational databases created by extracting, transforming, and loading data from operational systems into restructured logical data models. Dimensional Data Stores Relational databases created by extracting, transforming, and loading data conformed to a star schema from operational data stores. Non-Relational Data Stores Data storage platforms that allow arbitrary data to be stored. Data can usually be paired with metadata. Graph Data Stores Data storage platforms to capture sets of nodes and their relationships. Distributed Data Processing Data processing platforms allow data processing workloads to be spread between a number of hosts. Allows large scale search and inquiry. Distributed Transaction Stores Data storage for transaction records maintained in distributed chains of cryptographically signed blocks. Data Access, Lineage, and Provenance Interfaces that allow access to core data elements, meaning of those data elements, and associated lifecycle / origin metadata Cognitive Processing (AI) Semantic modelling, natural language, machine learning, and cognitive systems to support data processing. DataManagementPlatform On-Premise QUEST QUEST DB PeopleSoft CS Waterloo Works Works DB Orbis Comms. Request Tracker (RT) RT DB Best Practical RT Library Library DB Product Names System Name Database Name Product Name Operational Systems The systems running on-premise or in the cloud that support University operations. Cloud Finance Aggresso DB Business World ERP Learn Learn DB Brightspace Student Email Office Cloud Office 365 Research Pure DB Pure System Name Database Name Product Name InformationLifecycleManagement KeyCampusRelationships Secretariat (SEC) Information and Integration Management (IIM) will support SEC’s University Records Manager and Privacy Officer through metadata management around records, data requests, and data uses on campus. Institutional Analysis and Planning (IAP) The Director, Institutional Analysis and Planning, "designs measures and collects data to assess University-wide goals and objectives and coordinates the design, implementation and management of a University-wide decision support data warehouse.” Information and Integration Management (IIM) will support IAP in this effort as a data broker and technical support partner. IIM will be focused on providing high quality data feeds from operational systems to support IAP’s designed measures on University-wide goals and objectives. IAP will implement and manage data warehousing for designed measures and official reporting/analysis purposes. Internal and external governance reporting and strategic planning will be serviced from IAP’s warehousing. IIM will support IAP by providing access to knowledge, expertise, tooling, information infrastructure, and captured data elements. IST-IIM Data Capture, Cleaning, and Enrichment Capability to capture, clean, and enrich disparate large volume static or streaming data sources. Make unstructured, semi-structured, and structured data a valuable asset. De-identification of Personal Information Capability to de-identify, redact, pseudonymize, and anonymize data. Transform Personally Identifiable Information (PII) so that it can be used in analysis without presenting a privacy risk. Information Cataloging, Documentation, and Metadata Management Capability to catalog data elements, document them through information modelling, and describe them with metadata. Institutional Analysis and Planning (IAP) Secretariat (SEC) University Community Mission This group exists at the University of Waterloo to provide the knowledge, expertise, and centralized capability required to make information a valuable asset for the University—to create a trusted information asset base to support the University. Vision If useful information exists, make it a competitive advantage for Waterloo; capture, organize, and make information accessible for future decision making. Policy 46 Principles and Practices Accountability and Accessibility Privacy and Confidentiality Compliance Information Quality Information Security Information Lifecycle Management Capture Organize Store Use Disposition Digital Imaging & Auto-Uploads Coding & Indexing Backups & Versioning Business Process Workflows Retention Schedules & Record Destruction IndexCatalog SearchDiscover Access Uses Privacy Risk Document Management Physical Document Digital Document Digital Imaging Captured Document Document Metadata Coding and Indexing Document Document Metadata Business Processing Workflows Retention / Disposition Schedule Record of Disposition Case Delivery Plan Case Case Event Case Activity Case Communication Case Participant Case Output Case Outcome Case Document includes Case Facility Case Party Relationship Case Location Case-Party-Document Model Content Management Sharepoint WCMS Network Drives Email Archives Confluence InformationandIntegrationManagement Meaning and Metadata Physical Logical Conceptual Data Models Information Models Semantic Models Ontologies Glossaries and Taxonomies Data Element Rules and Definitions Metadata Management A robust metadata management capability and platform is crucial to the University’s ability to leverage its information assets. Capture Organize Storage Use Disposition Integration Platform Current State Integration Future State Integration Most systems follow a point-to-point integration pattern. Data is exchanged through batch copies. Some exchange is through direct database links increasing complexity of change efforts. Pattern of operations is effective but inefficient. Duplication Complexity Inaccuracy Risk Dept Sys Dept Sys Dept Sys Dept Sys Faculty Sys Faculty Sys Faculty Sys Faculty Sys HR Student Finance Research IDM ReliabilityScalability EvolvabilityConsistency Systems flow requests for information through a common integration platform. The platform: - enforces security, - creates audit logs for lineage/ provenance needs, - clarifies interpretation/meaning, and; - captures/creates metadata. Reduces risks and improves efficiency. Student HR Finance IAM Resear ch Dept Sys Faculty Open Data Enterprise Integration Plaform InnovationPlatform User-Centric Design (UCD) Information Architecture User Experience Design (UX) Platform and Agile Current State Future State X Y Y Y X Y YY X X Intrapreneurship As a user… http://bit.ly/2h3OFeG Institute for Government System Error: Fixing the Flaws in Government IT. User Developer Co-op Co-op Custom Web Apps JIRA Confluence CompellingDataEnvironment System Name Database Name Product Name System Name Database Name Product Name System Name Database Name Product Name Operational Data Capture Real-Time Robust Reliable Operational Storage Dimensional Storage Non-Relational Storage Graph Data Storage Distributed Processing Transaction Storage Access, Lineage, and Provenance Cognitive (AI) Processing Identify De-Identify Clean EnrichIndex Store Acceptable Uses Report Users Data Scientists Data Access "DIKW Pyramid" by Longlivetheux - Own work. Licensed under CC BY-SA 4.0 via Commons https://commons.wikimedia.org/wiki/File:DIKW_Pyramid.svg#/media/File:DIKW_Pyramid.svg Unstructured Information “Documents” Semi-Structured Information “Content” Structured Information “Data” Tableau Jupyter Notebooks (Python, R, F#) Sharepoint (MSBI) Visualization Users Power BI Reporting Services SQL Server Dapper.NET APIs Ad-Hoc Inquiry Users Excel Meaning and Metadata Information and Integration Management Data Curation QlikView InformationAssetBase Local Unit Operational, Tactical, and Strategic Documentation Information System Architecture Documentation Internal and External Governance Reporting Project / Initative Documentation Web Content Service Documentation Information System Logs Data Documentation … … http://motivationmodel.com/ Information Asset Base Information Portfolio Process Portfolio Service Portfolio HR Portfolio Financial Portfolio Strategy Portfolio Technology Portfolio Strategic Information Stream Application Portfolio Project Portfolio