SlideShare a Scribd company logo
1 of 60
Download to read offline
Data Architecture Best Practices for
Today’s Changing Data Landscape
Donna Burbank, Managing Director
Global Data Strategy, Ltd.
May 24th, 2018
Follow on Twitter @donnaburbank
Twitter Event hashtag: #DAStrategies
from
to
from
to
…
DATA INTEGRATION SOFTWARE ❏
❏
❏
Global Data Strategy, Ltd. 2018
Donna Burbank
Donna is a recognised industry expert in
information management with over 20 years
of experience in data strategy, information
management, data modeling, metadata
management, and enterprise architecture.
Her background is multi-faceted across
consulting, product development, product
management, brand strategy, marketing,
and business leadership.
She is currently the Managing Director at
Global Data Strategy, Ltd., an international
information management consulting
company that specializes in the alignment of
business drivers with data-centric
technology. In past roles, she has served in
key brand strategy and product
management roles at CA Technologies and
Embarcadero Technologies for several of the
leading data management products in the
market.
As an active contributor to the data
management community, she is a long time
DAMA International member, Past President
and Advisor to the DAMA Rocky Mountain
chapter, and was recently awarded the
Excellence in Data Management Award from
DAMA International in 2016.
Donna is also an analyst at the Boulder BI
Train Trust (BBBT) where she provides advice
and gains insight on the latest BI and
Analytics software in the market. She was on
several review committees for the Object
Management Group’s for key information
management and process modeling
notations.
She has worked with dozens of Fortune 500
companies worldwide in the Americas,
Europe, Asia, and Africa and speaks regularly
at industry conferences. She has co-
authored two books: Data Modeling for the
Business and Data Modeling Made Simple
with ERwin Data Modeler and is a regular
contributor to industry publications. She can
be reached at
donna.burbank@globaldatastrategy.com
Donna is based in Boulder, Colorado, USA.
2
Follow on Twitter @donnaburbank
Twitter Event hashtag: #DAStrategies
Global Data Strategy, Ltd. 2018
DATAVERSITY Data Architecture Strategies
• January - on demand Panel: Emerging Trends in Data Architecture – What’s the Next Big Thing?
• February - on demand Building an Enterprise Data Strategy – Where to Start?
• March - on demand Modern Metadata Strategies
• April - on demand The Rise of the Graph Database
• May Data Architecture Best Practices for Today’s Rapidly Changing Data Landscape
• June Artificial Intelligence: Real-World Applications for Your Organization
• July Panel: Data as a Profit Driver – Emerging Techniques to Monetize Data as a Strategic Asset
• August Data Lake Architecture – Modern Strategies & Approaches
• Sept Master Data Management: Practical Strategies for Integrating into Your Data Architecture
• October Business-Centric Data Modeling: Strategies for Maximizing Business Benefit
• December Panel: Self-Service Reporting and Data Prep – Benefits & Risks
3
This Year’s Line Up for 2018
Global Data Strategy, Ltd. 2018
What We’ll Cover Today
• With the rise of the data-driven organization, the pace of innovation in data-centric technologies
has been tremendous. New tools and techniques are emerging at an exponential rate, and it is
difficult to keep track of the array of technological choices available to today’s data management
professional.
• At the same time, core fundamentals such as data quality and metadata management remain
critical in order for organizations to obtain true business value from their data.
• This webinar will help demystify the options available:
• from Data Lake to Data Warehouse
• to Graph database
• to NoSQL, and more
• and how to integrate these new technologies with core architectural fundamentals
• that will help your organization benefit from the quick wins that are possible from these exciting
technologies, while at the same time build a longer-term sustainable architecture that will
support the inevitable change that will continue in the industry.
4
Global Data Strategy, Ltd. 2018
What is Data Architecture?
• The DAMA Data Management Body of Knowledge (DMBOK), defines data architecture as the
following:
• “Data Architecture is fundamental to data management. Because most organizations have more
data than individual people can comprehend, it is necessary to represent organizational data at
different levels of abstraction so that it can be understood and management can make decisions
about it.
• … Data Architecture artifacts include specifications used to describe existing state, define data
requirements, guide data integration, and control data assets as put forth in data strategy.
• An organization’s Data Architecture is described by an integrated collection of master design
documents at different levels of abstraction, including standards that govern how data is
collected, stored, arranged, used, and removed. It is also classified by descriptions of all the
containers and paths that data takes through an organization’s systems.”
5
DMBOK Definition
Global Data Strategy, Ltd. 2018
What is Data Architecture?
• Survey respondents from a 2017 DATAVERSITY survey on “Emerging Trends in Data Architecture”.
also provided a range of relevant definitions including:
“…the practice of examining the enterprise strategy, and identifying the key Data Integration points
that need to be enabled to execute that strategy, and laying out a roadmap for creating the core
capabilities to deliver those integrations, so that companies can leverage data as a strategic
asset.”
“…the science of assessing where your company data is, and the art of designing the best future
way of storing data across the enterprise.”
“…the discipline to help businesses manage their data in the most effective, secure, compliant, and
profitable way.”
6
Survey Respondents Provided a Range of Views
From Trends in Data Architecture 2017, by Donna Burbank & Charles Roe
Global Data Strategy, Ltd. 2018
Business Drivers for Data Architecture
• As more organizations see
data as a strategic asset, and
with the drive towards Digital
Business Transformation on
the rise, the need to analyze,
understand & govern core
data assets continue to be a
key goal.
7
What’s Driving the Need?
Global Data Strategy, Ltd. 2018 8
A Successful Data Strategy links Business Goals with Technology Solutions
“Top-Down” alignment with
business priorities
“Bottom-Up” management &
inventory of data sources
Managing the people, process,
policies & culture around data
Coordinating & integrating
disparate data sources
Leveraging & managing data for
strategic advantage
Copyright 2018 Global Data Strategy, Ltd
Aligning Business Strategy and Data Strategy
Global Data Strategy, Ltd. 2018
Developers
Managers
Data Architecture: Finding the Right Fit
9
A Successful Data Architecture Enforces Fit for Purpose Solutions
Operational Data Reporting & Analytics Master & Reference Data Metadata
CRM
Customer X orders
Product Y at 2pm on
Oct 24, 2017 Sales
CRM
ERP
Customer
Care
IoT
Customer X calls
Support at 1pm on
Nov 1, 2017
Inventory consists of x
number of Product X
components on Oct
24, 2017
Supply
Chain
Customer turns on
foot warmer at 11pm
on Oct 30, 2017
Product
Team
Customer
CRM
& other
systems
DW
What were total
sales for Product X
in 2016 by region?
Lake
Operational Reporting
Enterprise Historical Reporting
Analytics & Discovery
What variables
most influence
customer repeat
purchases?
Limited Personal Use
Limited ad hoc analysis
for small data sets.
Not recommended
for enterprise data
management.
Customer
Master
Product
Master
“Golden Record” for Customer,
Product, etc.
Mary Smith lives on 101 Main ST,
Minneapolis, MN and has been a
customer since 2011
SuperProd has a product code of
SS720 & a suggested retail price
of $11,000 USD.
Business & Technical Context &
Descriptions
ELT
How many support
calls are currently
open?
Analytics
Team
Managers
Reference Data
Hierarchies
The Sales management reporting
hierarchy is structured as follows.
Valid Return Codes are “X, Y, & Z”
State Codes include MA, MD MI …
Applications
DW Etc
DW Etc
DW Etc
Business
Glossary How is Total Sales
calculated?
What is a Qualified
Lead?
Business
Users
Data
Models
How do we uniquely
identify a customer?
Can a customer have
more than 1 email?
Data
Dictionary
What is this DW table
used for?
The standard length for
customer ID is CHAR(12)
Developers
Data
Lineage
How was this field
calculated?
What will break
downstream if I make a
change?
Developers
Developers
Business
Users
Access
Global Data Strategy, Ltd. 2018
Industry Trends: Data Platforms are Currently in Use?
• A wide range of technologies are
currently in use:
• Relational databases most common
o Both Cloud & On-Premises
• Spreadsheets ubiquitous
10
“Which of the following data sources or platforms are you currently using?
[Select all that apply]
Relational Databases
are still clearly the
leader.
Spreadsheets are
ubiquitous
More Legacy
platforms (44.6%)
than Big Data (42.2%)
From Emerging Trends in Data Architecture, DATAVERSITY, by
Donna Burbank & Charles Roe, October 2017
Global Data Strategy, Ltd. 2018
Industry Trends: Emerging Technologies
11
“Which of the following do you plan to use in the future that you are not using
currently? [Select all that Apply]”
Many looking to Big
Data Platforms
Movement to the
Cloud is popular
Uncertainty is
common.
• For those looking at new
technologies, there is a wide range
of responses.
• Big Data Platforms a leader
• Move to Cloud RDMBS
• Graph Database
• Real-time Streaming
• Internet of Things (IoT)
• Many are still uncertain, indicating
the vast rate of change and wide
array of choices available.
From Emerging Trends in Data Architecture,
DATAVERSITY, by Donna Burbank & Charles Roe,
October 2017
Global Data Strategy, Ltd. 2018
Big Data a Growing Trend
• Over 70% of organizations are
either using Big Data solutions, or
planning to in the future.
• Analysis & Discovery are leading
trends including:
• Data Science & Discovery
• Reporting & Analytics
• “Sandbox” Exploration
12
Analysis & Discovery are Key Drivers
Global Data Strategy, Ltd. 2018
Big Data Concerns
13
• The Complexity of current Big
Data solutions & the Skills
Required to manage them
were also common issues.
• Security is a leading concern, and Data
Governance was a top write-in response.
Global Data Strategy, Ltd. 2018
Data Lakes
• There was a mixed response
to Data Lake Implementation
14
Global Data Strategy, Ltd. 2018
Data Warehouse vs. Data Lake
15
Data Warehouse Data Lake
A Data Lake is a storage repository that holds a vast
amount of raw data in its native format, including
structured, semi-structured, and unstructured data.
The data structure & requirements are not defined until
the data is needed.
A Data Warehouse is a storage repository that holds current
and historical data used for creating analytical reports. Data
structures & requirements are pre-defined, and data is
organized & stored according to these definitions.
Global Data Strategy, Ltd. 2018
Integrating the Data Lake & Traditional Data Sources
• The Data Lake has a different architecture & purpose than traditional data sources such as data
warehouses.
• But the two environments can co-exist to share relevant information.
16
Data Analysis & Discovery – Data Lake Enterprise Systems of Record
Data Governance & Collaboration
Master &
Reference Data
Data Warehouse
Data MartsOperational Data
Security & Privacy
Sandbox
Lightly Modeled
Data
Data
Exploration
Reporting & Analytics
Advanced
Analytics
Self-Service BI
Standard BI
Reports
Global Data Strategy, Ltd. 2018
The Data Ecosystem
• Know what to manage closely and what to leave alone
• The more the data is shared across & beyond the organization, the more formal governance needs to be
17
Core Enterprise
Data
Functional & Operational
Data
Exploratory Data
Reference &
Master Data
Core Enterprise Data
• Common data elements used by multiple
stakeholders colleges, departments, etc. (e.g. DW)
• Highly governed
• Highly published & shared
Functional & Operational Data
• Lightly modeled & prepared data for
limited sharing & reuse
• Collaboration-based governance
• May be future candidates for core data
Exploratory Data
• Raw or lightly prepped data for
exploratory analysis
• Mainly ad hoc, one-off analysis
• Light touch governance
Examples
• Operational Reporting
• Non-productionized analytical model data
• Ad hoc reporting & discovery
Examples
• Raw data sets for exploratory analytics
• External & Open data sources
Examples
• Common Financial Metrics: for Financial & Regulatory Reporting
• Common Attributes: Core attributes reused across multiple areas
(e.g. Student name, Address, Courses, etc.)
Master & Reference Data
• Common data elements used by multiple stakeholders
across functional areas, applications, etc.
• Highly governed
• Highly published & shared
Examples
• Reference Data: Department Codes, Country Codes, etc.
• Master Data: Student, Faculty, etc.
Exploratory analysis
uses core data sets
when applicable
Derived variables of
value can be fed into
Core Enterprise, or
even Master Data.
PublishPromote
Global Data Strategy, Ltd. 2018
The Self-Service User
18
“If there are standardized
data sets, I’d love to use
them!”
e.g. Master Data, Data Warehouse
“Published documentation,
metadata, & standard
definitions are super-helpful!”
e.g. Glossaries, data models, etc.
“I want to integrate these data
sets with my own exploratory
data for analysis & modeling!”
e.g. Self-Service Data Prep & Analysis Tools
“How can I leverage what other
people have done, and see
what is most relevant?
e.g. Data Cataloguing & Crowdsourcing,
Exploratory and/or 3rd party data sets
Global Data Strategy, Ltd. 2018
Crowdsourcing Governance & Metadata
• Many data governance projects (& vendors) are embracing the concept of “crowdsourcing”. i.e. The
Wikipedia vs. Encyclopedia approach
• Open editing
• Popularity & Usage Rankings
• Dynamically changing
19
Encyclopedia Wikipedia
• Created by a few, then published as read-only
• Single source of “vetted” truth
• Static
• Created by a by many, edited by many
• Eventual consistency with multiple inputs
• Dynamic
For Standardized, Enterprise Data Sets For Self-Service Data Prep & Analytics
Global Data Strategy, Ltd. 2018
Who is Responsible for Creating a Data Architecture?
• With a greater business focus on
data and a wider range of
technologies associated with Data
Management…
• … it is not surprising that there is a
concomitant rise in the diversity of
roles responsible for developing a
Data Architecture.
• … the role of the data architect, not
surprisingly, continues to play a
large role.
20
Wide Range of Responses shows Need for Collaboration
Collaboration is Key
From Trends in Data Architecture 2017, by Donna
Burbank & Charles Roe
Wide range
of roles
Global Data Strategy, Ltd. 2018
Moving to the Cloud
• As indicated in the previous response re: Future Technologies, adoption of Cloud Technologies is
on the rise, with over 75% of respondents currently implementing a Cloud strategy, or planning
to in the future.
21
A Growing Trend
Scalability & Cost Savings are leading reasons for moving to the Cloud
From Trends in Data Architecture 2017, by Donna
Burbank & Charles Roe
Global Data Strategy, Ltd. 2018
Cloud Migration not without its Concerns
• Security & Privacy are
leading concerns for those
moving to the Cloud.
22
What are your Concerns regarding moving data to the Cloud? [Select All that Apply]
From Trends in Data Architecture 2017, by Donna
Burbank & Charles Roe
Global Data Strategy, Ltd. 2018
Master Data Management
• As more and more organizations struggle with obtaining a single, consistent view of core data
such as Product, Customer, Vendor, and Location, Master Data Management (MDM) is seeing a
rise in implementations with over 65% of respondents pursuing a MDM strategy.
23
• Master Data is the consistent and uniform set of identifiers and
extended attributes that describes the core entities of the
enterprise including customers, prospects, citizens, suppliers, sites,
hierarchies and chart of accounts (sic).
• Master data management (MDM) is a technology-enabled
discipline in which business and IT work together to ensure the
uniformity, accuracy, stewardship, semantic consistency and
accountability of the enterprise's official shared master data assets.
- Source GartnerFrom Trends in Data Architecture 2017, by Donna
Burbank & Charles Roe
Global Data Strategy, Ltd. 2018
Master Data – the Opportunity
24
A 360 Degree View through Data
Stefan Krauss
Age = 31
Occupation = Ski Instructor Purchased €500 in
outdoor gear in 2016
100% of purchases online
Top Finisher in Engadin Ski
Marathon 2010-2015
Member of Loyalty
Program since 2010
Prefers Text Message
Address = Pontresina, Switzerland
Global Data Strategy, Ltd. 2018
Optimizing Restaurant Revenue through Menu Data
• An international restaurant chain realized through its digital strategy that:
• While menus are the core product that drives their business…
• They had little control or visibility over their menu data
• Menu data was scattered across multiple systems in the organization from supply chain to kitchen prep to marketing,
restaurant operations, etc.
• Menu data was consolidated & managed in a central hub:
• Master Data Management created a “single view of menu” for business efficiency & quality control
• Data Governance created the workflow & policies around managing menu data
25
Managing the Data that Runs the Business
Product Creation &
Testing
Menu Display &
Marketing
Supply Chain Point of Sale &
Restaurant Operations
Global Data Strategy, Ltd. 2018
Transaction Data vs. Master Data
Customer Date Product Code Price Quantity Location
Stefan Kraus 1/2/2017 Scarpa Telemark Ski Boot SC1279 €250 1 St. Moritz, CH
Donna Burbank 1/5/2017 Scarpa Telemark Ski Boot SCU1289 $150 1 Boulder, CO
Stefan Kraus 1/2/2017 North Face Down Jacket NF8392 €450 1 Zurich, CH
Stefan Kraus 1/2/2017 Garmin Sports Watch GM29384 €200 2 Zurich, CH
Wendy Hu 3/4/2017 Prana Yoga Pant PN82734 $51 5 New York, NY
Joe Smith 4/1/2017 Garmin Sports Watch GM29384 $150 1 Albany, NY
26
Consider the following retail transaction data
Transaction Data
• Describes an action (verb): E.g. “buy”
• May include measurements about the action: (Who, When,
What, How Many, Where, How Much, etc.)
• E.g. Stefan Kraus, 1/2/2017/, Scarpa Telemark Ski Boot, St.
Moritz, CH, €250
Master Data
• Describes the key entities (nouns), e.g. Customer, Product,
Location
• Provides attributes & context for these nouns
• e.g. Wendy Hu, age 25, female, resident of New York, NY,
Customer since 2005, preferred customer card, etc.
Global Data Strategy, Ltd. 2018
Customer Date Product Code Price Quantity Location
Stefan Kraus 1/2/2017 Scarpa Telemark Ski Boot SC1279 €250 1 St. Moritz, CH
Donna Burbank 1/5/2017 Scarpa Telemark Ski Boot SCU1289 $150 1 Boulder, CO
Stefan Kraus 1/2/2017 North Face Down Jacket NF8392 €450 1 Zurich, CH
Stefan Kraus 1/2/2017 Garmin Sports Watch GM29384 €200 2 Zurich, CH
Wendy Hu 3/4/2017 Prana Yoga Pant PN82734 $51 5 New York, NY
Joe Smith 4/1/2017 Garmin Sports Watch GM29384 $150 1 Albany, NY
Transaction Data vs. Master Data
27
Master Data:
Customer
Master Data: Product
Master Data: Location
Reference Data:
Country Codes
Reference Data:
State Codes
Transaction
Data
Global Data Strategy, Ltd. 2018
Relational Databases & Transaction Data
• Relational Databases are well-suited for transaction data:
• Avoid Redundancy & Duplication: Through referential integrity, normalization
• ACID Transactions (Atomicity, Consistency, Isolation, Durability) - guarantee validity even in the event
of errors, power failures, etc.
• Ease of Query via SQL: Table-based structure allows for ease of query.
28
Relational Databases are the workhorses of many organizations
Relational Database
Global Data Strategy, Ltd. 2018
ETL
Master Data Solutions Can Help Create a
Customer “Golden Record”
29
CRM In-Store
Sales
MarketingFinance Online
Sales
Supply
Chain
MDM
“Golden Record”
Data
Warehouse BI & Reporting
Data Model
Lookup
End User Applications
Reference
Data Sets
Data Quality
& Matching
Publish & Subscribe
Global Data Strategy, Ltd. 2018
Graph Databases
• With graph databases, the relationships between data
points often matter more than the individual points
themselves. In order to leverage those data relationships,
your organization needs a database technology that stores
• A graph database uses a set of nodes, edges, and
properties to represent and store data.
• These relationships can help you discover new insights
from your data.
• Common use cases include:
• Social Networks
• “Enterprise Knowledge Graph”
• Fraud Detection
• Recommendation Engines
30
You bought this…
You may also like
this…
Global Data Strategy, Ltd. 2018
No SQL
• No SQL databases such as key value stores can store customer information such as Web session
logs, user preference and profile stores, etc.
31
Fast response and high volume for web sessions, profiles, etc.
Web pages from scarpa.com
Global Data Strategy, Ltd. 2018
Data Models
• Data Models can provide a holistic view of the organization
• Provide a helpful overlay against
• Business Process
• Technical Architecture
• Organizational Capability
• Etc.
32
Address
Customer
Contact
Order
Request
Product
Schedule
Company
Invoice
Payment
Sales Rep
Global Data Strategy, Ltd. 2018
Data Modeling is Hotter than ever
33
In a recent DATAVERSITY survey,
over 96% of were engaged in Data
Modeling in their organizations.
Sexiest job of the 21st Century?
Global Data Strategy, Ltd. 2018
Mapping Data to Business Process
• Process models are a helpful tool for describing core business processes.
• “Swimlanes” outline organizational considerations
• Data can be mapped to key business processes to understand creation & usage of information.
34
Identifying key data dependencies in core business processes
Global Data Strategy, Ltd. 2018
Business Capability Models
• A business capability model outlines the core functional areas of the organization.
• Note: this is not the same as an organizational chart
• Capabilities can be overlayed with key data domains to create a “heat map” of cross-functional data usage.
35
Core Business
Shared Services
Artful Art’s Business Capabilities
Etc. – sample subset only
Product Development
R&D
Product
Management
Product
Manufacturing
Packaging
Marketing
Product
Messaging
Branding
Product
Launch
Campaign
Development
Lead
Generation
Pricing
Sales
Pipeline
Management
Customer
Relationship
Quotes &
Tenders
Research & Development Branding & Go-to-Market
Partner
Management
Sales & Distribution
Human Resources
Recruitment
Employee
Training
Performance
Management
Legal
Compliance
Contract
Management
Data Domains
Customer
Product
Account
Etc.
Global Data Strategy, Ltd. 2018
Data-Driven Merger for Financial Services
The combined information assets of both companies is one of our biggest strategic advantages.
- CEO
• A key driver for a recent merger of two large financial institutions was the integration of
data assets
• Streamlining the merger of the two organizations by integrating the data assets
• Identify ways in which data can be used to strategic advantage
• Organizational Structure & Business Capability Alignment were critical
• Understanding how data was used across the organization
• Identifying efficiencies & opportunities for collaboration Business Capabilities
Company A
Business Capabilities
Company B
Common Data Foundation
Global Data Strategy, Ltd. 2018
CRUD Matrix
Product
Development
Supply Chain
Accounting
Marketing Finance
Product Assembly Instructions C R
Product Components C R
Product Price C U R
Product Name C U,D
Etc.
37
Create, Read, Update, Delete
• CRUD Matrices shows where data is Created, Read, Updated or Deleted across the
various areas of the organization
• This can be a helpful tool in data governance & data quality.
Global Data Strategy, Ltd. 2018
Process Models & CRUD Fit Well Together
• Business Process Models describe key activities within the organization.
• Linking these processes to the data that is Created, Updated, or Deleted (CRUD) is important
to understanding data usage.
Customer Order Account Invoice Product
Receive Customer Order R C C, R
Process Customer Order C,R,U R,U R
Fill Order R,U R,U R,U
Send Invoice R,U R,U C
CRUD Matrix
Business Process Model
Global Data Strategy, Ltd. 2018
Architecture helps create “Quick Wins”
• Data Architecture aligned with business architecture helps identify key pain points &
opportunities
Customer Order Account Invoice Product
Receive Customer Order R C C, R
Process Customer Order C,R,U R,U R
Fill Order R,U R,U R,U
Send Invoice R,U R,U C
CRUD Matrix
Business Process Model
• Customer Contact Information is not Consistent throughout the Customer Journey
• In other words, we can’t follow up with our customers to:
• Process their orders
• Send an invoice
• Join a Loyalty Program
• Etc.
Global Data Strategy, Ltd. 2018
Metadata Drives FTLB1 – Faster Time to Light Bulb
Comprehensive, documented metadata helps organizations make better, faster, more cohesive decisions.
40
1 FTLB: Faster Time to Light Bulb. Not to be confused with:
Ft lb: foot-pound (ft-lb) energy measurement unit
FTLB: First Trust Hedged BuyWrite Income ETF (FTLB) investment fund.
Metadata matters!
Could Engineers have access
to Support logs to understand
product design issues & make
improvements?
Could we understand which Customers
are in the Loyalty Program and what
Products they’ve purchased?
Etc, etc. -- Once you have a
roadmap for your data assets,
you can truly innovate and
optimize the business.
Global Data Strategy, Ltd. 2018
Optimizing Customer Experience through Better Data
• A major Retail Vendor wanted to become a data-driven company
• Enhancing the customer experience by mapping the Customer Journey to the Data Lifecycle
• Using IoT product data to improve product design & customer service
• Optimizing product supply chain & delivery
• Developing a Tactical Data Strategy determined that
• Master Data Management was needed to manage customer contact data throughout the Customer Journey
• Data Governance was required to manage data across organizational siloes: product development, marketing, sales, etc.
• Data Architecture was needed to understand the data ecosystem: data flow diagrams, data models, process models, etc.
41
Improving Customer Contact Data to Build Customer Loyalty & Increase Sales
Customer SupportCustomer Discovery &
Purchase
Product Delivery &
Tracking
Product Usage Tracking Product Development
Global Data Strategy, Ltd. 2018
Summary
• A Successful Data Architecture creates fit for purpose solutions using the right
technology for the right job
• “Fit for Purpose” depends largely on business drivers and use cases
• Collaboration is key as more and more roles are involved in data architecture
• Data Architecture fundamentals such as:
• Data models
• Process models
• Organizational capability models
• and more…
are critical in aligning business goals with data implementations
• A Robust Data Architecture fundamentals helps identify & solve “quick wins”, and
communicate the issues effectively across the enterprise.
Global Data Strategy, Ltd. 2018
About Global Data Strategy, Ltd.
• Global Data Strategy is an international information management consulting company that specializes
in the alignment of business drivers with data-centric technology.
• Our passion is data, and helping organizations enrich their business opportunities through data and
information.
• Our core values center around providing solutions that are:
• Business-Driven: We put the needs of your business first, before we look at any technological solution.
• Clear & Relevant: We provide clear explanations using real-world examples, not technical jargon.
• Customized & Right-Sized: Our implementations are based on the unique needs of your organization’s
size, corporate culture, and geography.
• High Quality & Technically Precise: We pride ourselves in excellence of execution, and we attract high-
quality professionals with years of technical expertise in the industry.
43
Data-Driven Business Transformation
Business Strategy
Aligned With
Data Strategy
www.globaldatastrategy.com
Global Data Strategy, Ltd. 2018
White Paper: Trends in Data Architecture
44
Free Download
• Download from
www.globaldatastrategy.com
• Under ‘Resources/Whitepapers’
Global Data Strategy, Ltd. 2018
DATAVERSITY Data Architecture Strategies
• January Panel: Emerging Trends in Data Architecture – What’s the Next Big Thing?
• February Building an Enterprise Data Strategy – Where to Start?
• March Modern Metadata Strategies
• April The Rise of the Graph Database: Practical Use Cases & Approaches to Benefit your Business
• May Data Architecture Best Practices for Today’s Rapidly Changing Data Landscape
• June Artificial Intelligence: Real-World Applications for Your Organization
• July Panel: Data as a Profit Driver – Emerging Techniques to Monetize Data as a Strategic Asset
• August Data Lake Architecture – Modern Strategies & Approaches
• Sept Master Data Management: Practical Strategies for Integrating into Your Data Architecture
• October Business-Centric Data Modeling: Strategies for Maximizing Business Benefit
• December Panel: Self-Service Reporting and Data Prep – Benefits & Risks
45
This Year’s Line Up for 2018 – Join Us Next Month
Global Data Strategy, Ltd. 2018
Questions?
46
Thoughts? Ideas?

More Related Content

What's hot

Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?DATAVERSITY
 
Business Intelligence & Data Analytics– An Architected Approach
Business Intelligence & Data Analytics– An Architected ApproachBusiness Intelligence & Data Analytics– An Architected Approach
Business Intelligence & Data Analytics– An Architected ApproachDATAVERSITY
 
Enterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data ArchitectureEnterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data ArchitectureDATAVERSITY
 
Activate Data Governance Using the Data Catalog
Activate Data Governance Using the Data CatalogActivate Data Governance Using the Data Catalog
Activate Data Governance Using the Data CatalogDATAVERSITY
 
Master Data Management – Aligning Data, Process, and Governance
Master Data Management – Aligning Data, Process, and GovernanceMaster Data Management – Aligning Data, Process, and Governance
Master Data Management – Aligning Data, Process, and GovernanceDATAVERSITY
 
DAS Slides: Building a Data Strategy – Practical Steps for Aligning with Busi...
DAS Slides: Building a Data Strategy – Practical Steps for Aligning with Busi...DAS Slides: Building a Data Strategy – Practical Steps for Aligning with Busi...
DAS Slides: Building a Data Strategy – Practical Steps for Aligning with Busi...DATAVERSITY
 
Data Quality Best Practices
Data Quality Best PracticesData Quality Best Practices
Data Quality Best PracticesDATAVERSITY
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?DATAVERSITY
 
Key Elements of a Successful Data Governance Program
Key Elements of a Successful Data Governance ProgramKey Elements of a Successful Data Governance Program
Key Elements of a Successful Data Governance ProgramDATAVERSITY
 
Data Governance Best Practices, Assessments, and Roadmaps
Data Governance Best Practices, Assessments, and RoadmapsData Governance Best Practices, Assessments, and Roadmaps
Data Governance Best Practices, Assessments, and RoadmapsDATAVERSITY
 
Data Catalog as the Platform for Data Intelligence
Data Catalog as the Platform for Data IntelligenceData Catalog as the Platform for Data Intelligence
Data Catalog as the Platform for Data IntelligenceAlation
 
Data Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to MeshData Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to MeshJeffrey T. Pollock
 
Why an AI-Powered Data Catalog Tool is Critical to Business Success
Why an AI-Powered Data Catalog Tool is Critical to Business SuccessWhy an AI-Powered Data Catalog Tool is Critical to Business Success
Why an AI-Powered Data Catalog Tool is Critical to Business SuccessInformatica
 
Modern Data architecture Design
Modern Data architecture DesignModern Data architecture Design
Modern Data architecture DesignKujambu Murugesan
 
Webinar: Decoding the Mystery - How to Know if You Need a Data Catalog, a Dat...
Webinar: Decoding the Mystery - How to Know if You Need a Data Catalog, a Dat...Webinar: Decoding the Mystery - How to Know if You Need a Data Catalog, a Dat...
Webinar: Decoding the Mystery - How to Know if You Need a Data Catalog, a Dat...DATAVERSITY
 
Enterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data ArchitectureEnterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data ArchitectureDATAVERSITY
 
Improving Data Literacy Around Data Architecture
Improving Data Literacy Around Data ArchitectureImproving Data Literacy Around Data Architecture
Improving Data Literacy Around Data ArchitectureDATAVERSITY
 
Data strategy demistifying data
Data strategy demistifying dataData strategy demistifying data
Data strategy demistifying dataHans Verstraeten
 
You Need a Data Catalog. Do You Know Why?
You Need a Data Catalog. Do You Know Why?You Need a Data Catalog. Do You Know Why?
You Need a Data Catalog. Do You Know Why?Precisely
 

What's hot (20)

Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?
 
Business Intelligence & Data Analytics– An Architected Approach
Business Intelligence & Data Analytics– An Architected ApproachBusiness Intelligence & Data Analytics– An Architected Approach
Business Intelligence & Data Analytics– An Architected Approach
 
Enterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data ArchitectureEnterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data Architecture
 
Activate Data Governance Using the Data Catalog
Activate Data Governance Using the Data CatalogActivate Data Governance Using the Data Catalog
Activate Data Governance Using the Data Catalog
 
Master Data Management – Aligning Data, Process, and Governance
Master Data Management – Aligning Data, Process, and GovernanceMaster Data Management – Aligning Data, Process, and Governance
Master Data Management – Aligning Data, Process, and Governance
 
DAS Slides: Building a Data Strategy – Practical Steps for Aligning with Busi...
DAS Slides: Building a Data Strategy – Practical Steps for Aligning with Busi...DAS Slides: Building a Data Strategy – Practical Steps for Aligning with Busi...
DAS Slides: Building a Data Strategy – Practical Steps for Aligning with Busi...
 
Data Quality Best Practices
Data Quality Best PracticesData Quality Best Practices
Data Quality Best Practices
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?
 
Key Elements of a Successful Data Governance Program
Key Elements of a Successful Data Governance ProgramKey Elements of a Successful Data Governance Program
Key Elements of a Successful Data Governance Program
 
Data Governance Best Practices, Assessments, and Roadmaps
Data Governance Best Practices, Assessments, and RoadmapsData Governance Best Practices, Assessments, and Roadmaps
Data Governance Best Practices, Assessments, and Roadmaps
 
Data Catalog as the Platform for Data Intelligence
Data Catalog as the Platform for Data IntelligenceData Catalog as the Platform for Data Intelligence
Data Catalog as the Platform for Data Intelligence
 
Data Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to MeshData Mesh Part 4 Monolith to Mesh
Data Mesh Part 4 Monolith to Mesh
 
Why an AI-Powered Data Catalog Tool is Critical to Business Success
Why an AI-Powered Data Catalog Tool is Critical to Business SuccessWhy an AI-Powered Data Catalog Tool is Critical to Business Success
Why an AI-Powered Data Catalog Tool is Critical to Business Success
 
Modern Data architecture Design
Modern Data architecture DesignModern Data architecture Design
Modern Data architecture Design
 
Webinar: Decoding the Mystery - How to Know if You Need a Data Catalog, a Dat...
Webinar: Decoding the Mystery - How to Know if You Need a Data Catalog, a Dat...Webinar: Decoding the Mystery - How to Know if You Need a Data Catalog, a Dat...
Webinar: Decoding the Mystery - How to Know if You Need a Data Catalog, a Dat...
 
Enterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data ArchitectureEnterprise Architecture vs. Data Architecture
Enterprise Architecture vs. Data Architecture
 
Data modelling 101
Data modelling 101Data modelling 101
Data modelling 101
 
Improving Data Literacy Around Data Architecture
Improving Data Literacy Around Data ArchitectureImproving Data Literacy Around Data Architecture
Improving Data Literacy Around Data Architecture
 
Data strategy demistifying data
Data strategy demistifying dataData strategy demistifying data
Data strategy demistifying data
 
You Need a Data Catalog. Do You Know Why?
You Need a Data Catalog. Do You Know Why?You Need a Data Catalog. Do You Know Why?
You Need a Data Catalog. Do You Know Why?
 

Similar to Data Architecture Best Practices for Today’s Rapidly Changing Data Landscape

DAS Slides: Self-Service Reporting and Data Prep – Benefits & Risks
DAS Slides: Self-Service Reporting and Data Prep – Benefits & RisksDAS Slides: Self-Service Reporting and Data Prep – Benefits & Risks
DAS Slides: Self-Service Reporting and Data Prep – Benefits & RisksDATAVERSITY
 
Data Architecture Strategies Webinar: Emerging Trends in Data Architecture – ...
Data Architecture Strategies Webinar: Emerging Trends in Data Architecture – ...Data Architecture Strategies Webinar: Emerging Trends in Data Architecture – ...
Data Architecture Strategies Webinar: Emerging Trends in Data Architecture – ...DATAVERSITY
 
Data Lake Architecture – Modern Strategies & Approaches
Data Lake Architecture – Modern Strategies & ApproachesData Lake Architecture – Modern Strategies & Approaches
Data Lake Architecture – Modern Strategies & ApproachesDATAVERSITY
 
Modern Metadata Strategies
Modern Metadata StrategiesModern Metadata Strategies
Modern Metadata StrategiesDATAVERSITY
 
Data Governance & Data Architecture - Alignment and Synergies
Data Governance & Data Architecture - Alignment and SynergiesData Governance & Data Architecture - Alignment and Synergies
Data Governance & Data Architecture - Alignment and SynergiesDATAVERSITY
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsDATAVERSITY
 
Data Modeling, Data Governance, & Data Quality
Data Modeling, Data Governance, & Data QualityData Modeling, Data Governance, & Data Quality
Data Modeling, Data Governance, & Data QualityDATAVERSITY
 
Data Modeling Best Practices - Business & Technical Approaches
Data Modeling Best Practices - Business & Technical ApproachesData Modeling Best Practices - Business & Technical Approaches
Data Modeling Best Practices - Business & Technical ApproachesDATAVERSITY
 
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...DATAVERSITY
 
DAS Slides: Building a Data Strategy - Practical Steps for Aligning with Busi...
DAS Slides: Building a Data Strategy - Practical Steps for Aligning with Busi...DAS Slides: Building a Data Strategy - Practical Steps for Aligning with Busi...
DAS Slides: Building a Data Strategy - Practical Steps for Aligning with Busi...DATAVERSITY
 
DAS Slides: Data Governance and Data Architecture – Alignment and Synergies
DAS Slides: Data Governance and Data Architecture – Alignment and SynergiesDAS Slides: Data Governance and Data Architecture – Alignment and Synergies
DAS Slides: Data Governance and Data Architecture – Alignment and SynergiesDATAVERSITY
 
DAS Slides: Cloud-Based Data Warehousing – What’s New and What Stays the Same
DAS Slides: Cloud-Based Data Warehousing – What’s New and What Stays the SameDAS Slides: Cloud-Based Data Warehousing – What’s New and What Stays the Same
DAS Slides: Cloud-Based Data Warehousing – What’s New and What Stays the SameDATAVERSITY
 
Data Catalogues - Architecting for Collaboration & Self-Service
Data Catalogues - Architecting for Collaboration & Self-ServiceData Catalogues - Architecting for Collaboration & Self-Service
Data Catalogues - Architecting for Collaboration & Self-ServiceDATAVERSITY
 
The Business Value of Metadata for Data Governance
The Business Value of Metadata for Data GovernanceThe Business Value of Metadata for Data Governance
The Business Value of Metadata for Data GovernanceRoland Bullivant
 
DAS Slides: Best Practices in Metadata Management
DAS Slides: Best Practices in Metadata ManagementDAS Slides: Best Practices in Metadata Management
DAS Slides: Best Practices in Metadata ManagementDATAVERSITY
 
The Missing Link in Enterprise Data Governance - Automated Metadata Management
The Missing Link in Enterprise Data Governance - Automated Metadata ManagementThe Missing Link in Enterprise Data Governance - Automated Metadata Management
The Missing Link in Enterprise Data Governance - Automated Metadata ManagementDATAVERSITY
 
DAS Slides: Building a Data Strategy — Practical Steps for Aligning with Busi...
DAS Slides: Building a Data Strategy — Practical Steps for Aligning with Busi...DAS Slides: Building a Data Strategy — Practical Steps for Aligning with Busi...
DAS Slides: Building a Data Strategy — Practical Steps for Aligning with Busi...DATAVERSITY
 
DAS Slides: Building a Future-State Data Architecture Plan - Where to Begin?
DAS Slides: Building a Future-State Data Architecture Plan - Where to Begin?DAS Slides: Building a Future-State Data Architecture Plan - Where to Begin?
DAS Slides: Building a Future-State Data Architecture Plan - Where to Begin?DATAVERSITY
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsDATAVERSITY
 
Self-Service Data Analysis, Data Wrangling, Data Munging, and Data Modeling –...
Self-Service Data Analysis, Data Wrangling, Data Munging, and Data Modeling –...Self-Service Data Analysis, Data Wrangling, Data Munging, and Data Modeling –...
Self-Service Data Analysis, Data Wrangling, Data Munging, and Data Modeling –...DATAVERSITY
 

Similar to Data Architecture Best Practices for Today’s Rapidly Changing Data Landscape (20)

DAS Slides: Self-Service Reporting and Data Prep – Benefits & Risks
DAS Slides: Self-Service Reporting and Data Prep – Benefits & RisksDAS Slides: Self-Service Reporting and Data Prep – Benefits & Risks
DAS Slides: Self-Service Reporting and Data Prep – Benefits & Risks
 
Data Architecture Strategies Webinar: Emerging Trends in Data Architecture – ...
Data Architecture Strategies Webinar: Emerging Trends in Data Architecture – ...Data Architecture Strategies Webinar: Emerging Trends in Data Architecture – ...
Data Architecture Strategies Webinar: Emerging Trends in Data Architecture – ...
 
Data Lake Architecture – Modern Strategies & Approaches
Data Lake Architecture – Modern Strategies & ApproachesData Lake Architecture – Modern Strategies & Approaches
Data Lake Architecture – Modern Strategies & Approaches
 
Modern Metadata Strategies
Modern Metadata StrategiesModern Metadata Strategies
Modern Metadata Strategies
 
Data Governance & Data Architecture - Alignment and Synergies
Data Governance & Data Architecture - Alignment and SynergiesData Governance & Data Architecture - Alignment and Synergies
Data Governance & Data Architecture - Alignment and Synergies
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business Goals
 
Data Modeling, Data Governance, & Data Quality
Data Modeling, Data Governance, & Data QualityData Modeling, Data Governance, & Data Quality
Data Modeling, Data Governance, & Data Quality
 
Data Modeling Best Practices - Business & Technical Approaches
Data Modeling Best Practices - Business & Technical ApproachesData Modeling Best Practices - Business & Technical Approaches
Data Modeling Best Practices - Business & Technical Approaches
 
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...
Data Architecture Strategies: Building an Enterprise Data Strategy – Where to...
 
DAS Slides: Building a Data Strategy - Practical Steps for Aligning with Busi...
DAS Slides: Building a Data Strategy - Practical Steps for Aligning with Busi...DAS Slides: Building a Data Strategy - Practical Steps for Aligning with Busi...
DAS Slides: Building a Data Strategy - Practical Steps for Aligning with Busi...
 
DAS Slides: Data Governance and Data Architecture – Alignment and Synergies
DAS Slides: Data Governance and Data Architecture – Alignment and SynergiesDAS Slides: Data Governance and Data Architecture – Alignment and Synergies
DAS Slides: Data Governance and Data Architecture – Alignment and Synergies
 
DAS Slides: Cloud-Based Data Warehousing – What’s New and What Stays the Same
DAS Slides: Cloud-Based Data Warehousing – What’s New and What Stays the SameDAS Slides: Cloud-Based Data Warehousing – What’s New and What Stays the Same
DAS Slides: Cloud-Based Data Warehousing – What’s New and What Stays the Same
 
Data Catalogues - Architecting for Collaboration & Self-Service
Data Catalogues - Architecting for Collaboration & Self-ServiceData Catalogues - Architecting for Collaboration & Self-Service
Data Catalogues - Architecting for Collaboration & Self-Service
 
The Business Value of Metadata for Data Governance
The Business Value of Metadata for Data GovernanceThe Business Value of Metadata for Data Governance
The Business Value of Metadata for Data Governance
 
DAS Slides: Best Practices in Metadata Management
DAS Slides: Best Practices in Metadata ManagementDAS Slides: Best Practices in Metadata Management
DAS Slides: Best Practices in Metadata Management
 
The Missing Link in Enterprise Data Governance - Automated Metadata Management
The Missing Link in Enterprise Data Governance - Automated Metadata ManagementThe Missing Link in Enterprise Data Governance - Automated Metadata Management
The Missing Link in Enterprise Data Governance - Automated Metadata Management
 
DAS Slides: Building a Data Strategy — Practical Steps for Aligning with Busi...
DAS Slides: Building a Data Strategy — Practical Steps for Aligning with Busi...DAS Slides: Building a Data Strategy — Practical Steps for Aligning with Busi...
DAS Slides: Building a Data Strategy — Practical Steps for Aligning with Busi...
 
DAS Slides: Building a Future-State Data Architecture Plan - Where to Begin?
DAS Slides: Building a Future-State Data Architecture Plan - Where to Begin?DAS Slides: Building a Future-State Data Architecture Plan - Where to Begin?
DAS Slides: Building a Future-State Data Architecture Plan - Where to Begin?
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business Goals
 
Self-Service Data Analysis, Data Wrangling, Data Munging, and Data Modeling –...
Self-Service Data Analysis, Data Wrangling, Data Munging, and Data Modeling –...Self-Service Data Analysis, Data Wrangling, Data Munging, and Data Modeling –...
Self-Service Data Analysis, Data Wrangling, Data Munging, and Data Modeling –...
 

More from DATAVERSITY

Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...DATAVERSITY
 
Data at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceData at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceDATAVERSITY
 
Exploring Levels of Data Literacy
Exploring Levels of Data LiteracyExploring Levels of Data Literacy
Exploring Levels of Data LiteracyDATAVERSITY
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsDATAVERSITY
 
Make Data Work for You
Make Data Work for YouMake Data Work for You
Make Data Work for YouDATAVERSITY
 
Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?DATAVERSITY
 
Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?DATAVERSITY
 
Data Modeling Fundamentals
Data Modeling FundamentalsData Modeling Fundamentals
Data Modeling FundamentalsDATAVERSITY
 
Showing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectShowing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectDATAVERSITY
 
How a Semantic Layer Makes Data Mesh Work at Scale
How a Semantic Layer Makes  Data Mesh Work at ScaleHow a Semantic Layer Makes  Data Mesh Work at Scale
How a Semantic Layer Makes Data Mesh Work at ScaleDATAVERSITY
 
Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?DATAVERSITY
 
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...DATAVERSITY
 
Data Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsData Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsDATAVERSITY
 
Data Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayData Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayDATAVERSITY
 
2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics2023 Trends in Enterprise Analytics
2023 Trends in Enterprise AnalyticsDATAVERSITY
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best PracticesDATAVERSITY
 
Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?DATAVERSITY
 
Data Management Best Practices
Data Management Best PracticesData Management Best Practices
Data Management Best PracticesDATAVERSITY
 
MLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageMLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageDATAVERSITY
 
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...DATAVERSITY
 

More from DATAVERSITY (20)

Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
 
Data at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceData at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and Governance
 
Exploring Levels of Data Literacy
Exploring Levels of Data LiteracyExploring Levels of Data Literacy
Exploring Levels of Data Literacy
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business Goals
 
Make Data Work for You
Make Data Work for YouMake Data Work for You
Make Data Work for You
 
Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?
 
Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?
 
Data Modeling Fundamentals
Data Modeling FundamentalsData Modeling Fundamentals
Data Modeling Fundamentals
 
Showing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectShowing ROI for Your Analytic Project
Showing ROI for Your Analytic Project
 
How a Semantic Layer Makes Data Mesh Work at Scale
How a Semantic Layer Makes  Data Mesh Work at ScaleHow a Semantic Layer Makes  Data Mesh Work at Scale
How a Semantic Layer Makes Data Mesh Work at Scale
 
Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?
 
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
 
Data Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsData Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and Forwards
 
Data Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayData Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement Today
 
2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best Practices
 
Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?
 
Data Management Best Practices
Data Management Best PracticesData Management Best Practices
Data Management Best Practices
 
MLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageMLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive Advantage
 
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...
Keeping the Pulse of Your Data – Why You Need Data Observability to Improve D...
 

Recently uploaded

Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenHervé Boutemy
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationSlibray Presentation
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 

Recently uploaded (20)

Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
"Federated learning: out of reach no matter how close",Oleksandr Lapshyn
 
DevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache MavenDevoxxFR 2024 Reproducible Builds with Apache Maven
DevoxxFR 2024 Reproducible Builds with Apache Maven
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdf
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Connect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck PresentationConnect Wave/ connectwave Pitch Deck Presentation
Connect Wave/ connectwave Pitch Deck Presentation
 
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxE-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 

Data Architecture Best Practices for Today’s Rapidly Changing Data Landscape

  • 1. Data Architecture Best Practices for Today’s Changing Data Landscape Donna Burbank, Managing Director Global Data Strategy, Ltd. May 24th, 2018 Follow on Twitter @donnaburbank Twitter Event hashtag: #DAStrategies
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 11.
  • 12.
  • 13.
  • 14.
  • 16. Global Data Strategy, Ltd. 2018 Donna Burbank Donna is a recognised industry expert in information management with over 20 years of experience in data strategy, information management, data modeling, metadata management, and enterprise architecture. Her background is multi-faceted across consulting, product development, product management, brand strategy, marketing, and business leadership. She is currently the Managing Director at Global Data Strategy, Ltd., an international information management consulting company that specializes in the alignment of business drivers with data-centric technology. In past roles, she has served in key brand strategy and product management roles at CA Technologies and Embarcadero Technologies for several of the leading data management products in the market. As an active contributor to the data management community, she is a long time DAMA International member, Past President and Advisor to the DAMA Rocky Mountain chapter, and was recently awarded the Excellence in Data Management Award from DAMA International in 2016. Donna is also an analyst at the Boulder BI Train Trust (BBBT) where she provides advice and gains insight on the latest BI and Analytics software in the market. She was on several review committees for the Object Management Group’s for key information management and process modeling notations. She has worked with dozens of Fortune 500 companies worldwide in the Americas, Europe, Asia, and Africa and speaks regularly at industry conferences. She has co- authored two books: Data Modeling for the Business and Data Modeling Made Simple with ERwin Data Modeler and is a regular contributor to industry publications. She can be reached at donna.burbank@globaldatastrategy.com Donna is based in Boulder, Colorado, USA. 2 Follow on Twitter @donnaburbank Twitter Event hashtag: #DAStrategies
  • 17. Global Data Strategy, Ltd. 2018 DATAVERSITY Data Architecture Strategies • January - on demand Panel: Emerging Trends in Data Architecture – What’s the Next Big Thing? • February - on demand Building an Enterprise Data Strategy – Where to Start? • March - on demand Modern Metadata Strategies • April - on demand The Rise of the Graph Database • May Data Architecture Best Practices for Today’s Rapidly Changing Data Landscape • June Artificial Intelligence: Real-World Applications for Your Organization • July Panel: Data as a Profit Driver – Emerging Techniques to Monetize Data as a Strategic Asset • August Data Lake Architecture – Modern Strategies & Approaches • Sept Master Data Management: Practical Strategies for Integrating into Your Data Architecture • October Business-Centric Data Modeling: Strategies for Maximizing Business Benefit • December Panel: Self-Service Reporting and Data Prep – Benefits & Risks 3 This Year’s Line Up for 2018
  • 18. Global Data Strategy, Ltd. 2018 What We’ll Cover Today • With the rise of the data-driven organization, the pace of innovation in data-centric technologies has been tremendous. New tools and techniques are emerging at an exponential rate, and it is difficult to keep track of the array of technological choices available to today’s data management professional. • At the same time, core fundamentals such as data quality and metadata management remain critical in order for organizations to obtain true business value from their data. • This webinar will help demystify the options available: • from Data Lake to Data Warehouse • to Graph database • to NoSQL, and more • and how to integrate these new technologies with core architectural fundamentals • that will help your organization benefit from the quick wins that are possible from these exciting technologies, while at the same time build a longer-term sustainable architecture that will support the inevitable change that will continue in the industry. 4
  • 19. Global Data Strategy, Ltd. 2018 What is Data Architecture? • The DAMA Data Management Body of Knowledge (DMBOK), defines data architecture as the following: • “Data Architecture is fundamental to data management. Because most organizations have more data than individual people can comprehend, it is necessary to represent organizational data at different levels of abstraction so that it can be understood and management can make decisions about it. • … Data Architecture artifacts include specifications used to describe existing state, define data requirements, guide data integration, and control data assets as put forth in data strategy. • An organization’s Data Architecture is described by an integrated collection of master design documents at different levels of abstraction, including standards that govern how data is collected, stored, arranged, used, and removed. It is also classified by descriptions of all the containers and paths that data takes through an organization’s systems.” 5 DMBOK Definition
  • 20. Global Data Strategy, Ltd. 2018 What is Data Architecture? • Survey respondents from a 2017 DATAVERSITY survey on “Emerging Trends in Data Architecture”. also provided a range of relevant definitions including: “…the practice of examining the enterprise strategy, and identifying the key Data Integration points that need to be enabled to execute that strategy, and laying out a roadmap for creating the core capabilities to deliver those integrations, so that companies can leverage data as a strategic asset.” “…the science of assessing where your company data is, and the art of designing the best future way of storing data across the enterprise.” “…the discipline to help businesses manage their data in the most effective, secure, compliant, and profitable way.” 6 Survey Respondents Provided a Range of Views From Trends in Data Architecture 2017, by Donna Burbank & Charles Roe
  • 21. Global Data Strategy, Ltd. 2018 Business Drivers for Data Architecture • As more organizations see data as a strategic asset, and with the drive towards Digital Business Transformation on the rise, the need to analyze, understand & govern core data assets continue to be a key goal. 7 What’s Driving the Need?
  • 22. Global Data Strategy, Ltd. 2018 8 A Successful Data Strategy links Business Goals with Technology Solutions “Top-Down” alignment with business priorities “Bottom-Up” management & inventory of data sources Managing the people, process, policies & culture around data Coordinating & integrating disparate data sources Leveraging & managing data for strategic advantage Copyright 2018 Global Data Strategy, Ltd Aligning Business Strategy and Data Strategy
  • 23. Global Data Strategy, Ltd. 2018 Developers Managers Data Architecture: Finding the Right Fit 9 A Successful Data Architecture Enforces Fit for Purpose Solutions Operational Data Reporting & Analytics Master & Reference Data Metadata CRM Customer X orders Product Y at 2pm on Oct 24, 2017 Sales CRM ERP Customer Care IoT Customer X calls Support at 1pm on Nov 1, 2017 Inventory consists of x number of Product X components on Oct 24, 2017 Supply Chain Customer turns on foot warmer at 11pm on Oct 30, 2017 Product Team Customer CRM & other systems DW What were total sales for Product X in 2016 by region? Lake Operational Reporting Enterprise Historical Reporting Analytics & Discovery What variables most influence customer repeat purchases? Limited Personal Use Limited ad hoc analysis for small data sets. Not recommended for enterprise data management. Customer Master Product Master “Golden Record” for Customer, Product, etc. Mary Smith lives on 101 Main ST, Minneapolis, MN and has been a customer since 2011 SuperProd has a product code of SS720 & a suggested retail price of $11,000 USD. Business & Technical Context & Descriptions ELT How many support calls are currently open? Analytics Team Managers Reference Data Hierarchies The Sales management reporting hierarchy is structured as follows. Valid Return Codes are “X, Y, & Z” State Codes include MA, MD MI … Applications DW Etc DW Etc DW Etc Business Glossary How is Total Sales calculated? What is a Qualified Lead? Business Users Data Models How do we uniquely identify a customer? Can a customer have more than 1 email? Data Dictionary What is this DW table used for? The standard length for customer ID is CHAR(12) Developers Data Lineage How was this field calculated? What will break downstream if I make a change? Developers Developers Business Users Access
  • 24. Global Data Strategy, Ltd. 2018 Industry Trends: Data Platforms are Currently in Use? • A wide range of technologies are currently in use: • Relational databases most common o Both Cloud & On-Premises • Spreadsheets ubiquitous 10 “Which of the following data sources or platforms are you currently using? [Select all that apply] Relational Databases are still clearly the leader. Spreadsheets are ubiquitous More Legacy platforms (44.6%) than Big Data (42.2%) From Emerging Trends in Data Architecture, DATAVERSITY, by Donna Burbank & Charles Roe, October 2017
  • 25. Global Data Strategy, Ltd. 2018 Industry Trends: Emerging Technologies 11 “Which of the following do you plan to use in the future that you are not using currently? [Select all that Apply]” Many looking to Big Data Platforms Movement to the Cloud is popular Uncertainty is common. • For those looking at new technologies, there is a wide range of responses. • Big Data Platforms a leader • Move to Cloud RDMBS • Graph Database • Real-time Streaming • Internet of Things (IoT) • Many are still uncertain, indicating the vast rate of change and wide array of choices available. From Emerging Trends in Data Architecture, DATAVERSITY, by Donna Burbank & Charles Roe, October 2017
  • 26. Global Data Strategy, Ltd. 2018 Big Data a Growing Trend • Over 70% of organizations are either using Big Data solutions, or planning to in the future. • Analysis & Discovery are leading trends including: • Data Science & Discovery • Reporting & Analytics • “Sandbox” Exploration 12 Analysis & Discovery are Key Drivers
  • 27. Global Data Strategy, Ltd. 2018 Big Data Concerns 13 • The Complexity of current Big Data solutions & the Skills Required to manage them were also common issues. • Security is a leading concern, and Data Governance was a top write-in response.
  • 28. Global Data Strategy, Ltd. 2018 Data Lakes • There was a mixed response to Data Lake Implementation 14
  • 29. Global Data Strategy, Ltd. 2018 Data Warehouse vs. Data Lake 15 Data Warehouse Data Lake A Data Lake is a storage repository that holds a vast amount of raw data in its native format, including structured, semi-structured, and unstructured data. The data structure & requirements are not defined until the data is needed. A Data Warehouse is a storage repository that holds current and historical data used for creating analytical reports. Data structures & requirements are pre-defined, and data is organized & stored according to these definitions.
  • 30. Global Data Strategy, Ltd. 2018 Integrating the Data Lake & Traditional Data Sources • The Data Lake has a different architecture & purpose than traditional data sources such as data warehouses. • But the two environments can co-exist to share relevant information. 16 Data Analysis & Discovery – Data Lake Enterprise Systems of Record Data Governance & Collaboration Master & Reference Data Data Warehouse Data MartsOperational Data Security & Privacy Sandbox Lightly Modeled Data Data Exploration Reporting & Analytics Advanced Analytics Self-Service BI Standard BI Reports
  • 31. Global Data Strategy, Ltd. 2018 The Data Ecosystem • Know what to manage closely and what to leave alone • The more the data is shared across & beyond the organization, the more formal governance needs to be 17 Core Enterprise Data Functional & Operational Data Exploratory Data Reference & Master Data Core Enterprise Data • Common data elements used by multiple stakeholders colleges, departments, etc. (e.g. DW) • Highly governed • Highly published & shared Functional & Operational Data • Lightly modeled & prepared data for limited sharing & reuse • Collaboration-based governance • May be future candidates for core data Exploratory Data • Raw or lightly prepped data for exploratory analysis • Mainly ad hoc, one-off analysis • Light touch governance Examples • Operational Reporting • Non-productionized analytical model data • Ad hoc reporting & discovery Examples • Raw data sets for exploratory analytics • External & Open data sources Examples • Common Financial Metrics: for Financial & Regulatory Reporting • Common Attributes: Core attributes reused across multiple areas (e.g. Student name, Address, Courses, etc.) Master & Reference Data • Common data elements used by multiple stakeholders across functional areas, applications, etc. • Highly governed • Highly published & shared Examples • Reference Data: Department Codes, Country Codes, etc. • Master Data: Student, Faculty, etc. Exploratory analysis uses core data sets when applicable Derived variables of value can be fed into Core Enterprise, or even Master Data. PublishPromote
  • 32. Global Data Strategy, Ltd. 2018 The Self-Service User 18 “If there are standardized data sets, I’d love to use them!” e.g. Master Data, Data Warehouse “Published documentation, metadata, & standard definitions are super-helpful!” e.g. Glossaries, data models, etc. “I want to integrate these data sets with my own exploratory data for analysis & modeling!” e.g. Self-Service Data Prep & Analysis Tools “How can I leverage what other people have done, and see what is most relevant? e.g. Data Cataloguing & Crowdsourcing, Exploratory and/or 3rd party data sets
  • 33. Global Data Strategy, Ltd. 2018 Crowdsourcing Governance & Metadata • Many data governance projects (& vendors) are embracing the concept of “crowdsourcing”. i.e. The Wikipedia vs. Encyclopedia approach • Open editing • Popularity & Usage Rankings • Dynamically changing 19 Encyclopedia Wikipedia • Created by a few, then published as read-only • Single source of “vetted” truth • Static • Created by a by many, edited by many • Eventual consistency with multiple inputs • Dynamic For Standardized, Enterprise Data Sets For Self-Service Data Prep & Analytics
  • 34. Global Data Strategy, Ltd. 2018 Who is Responsible for Creating a Data Architecture? • With a greater business focus on data and a wider range of technologies associated with Data Management… • … it is not surprising that there is a concomitant rise in the diversity of roles responsible for developing a Data Architecture. • … the role of the data architect, not surprisingly, continues to play a large role. 20 Wide Range of Responses shows Need for Collaboration Collaboration is Key From Trends in Data Architecture 2017, by Donna Burbank & Charles Roe Wide range of roles
  • 35. Global Data Strategy, Ltd. 2018 Moving to the Cloud • As indicated in the previous response re: Future Technologies, adoption of Cloud Technologies is on the rise, with over 75% of respondents currently implementing a Cloud strategy, or planning to in the future. 21 A Growing Trend Scalability & Cost Savings are leading reasons for moving to the Cloud From Trends in Data Architecture 2017, by Donna Burbank & Charles Roe
  • 36. Global Data Strategy, Ltd. 2018 Cloud Migration not without its Concerns • Security & Privacy are leading concerns for those moving to the Cloud. 22 What are your Concerns regarding moving data to the Cloud? [Select All that Apply] From Trends in Data Architecture 2017, by Donna Burbank & Charles Roe
  • 37. Global Data Strategy, Ltd. 2018 Master Data Management • As more and more organizations struggle with obtaining a single, consistent view of core data such as Product, Customer, Vendor, and Location, Master Data Management (MDM) is seeing a rise in implementations with over 65% of respondents pursuing a MDM strategy. 23 • Master Data is the consistent and uniform set of identifiers and extended attributes that describes the core entities of the enterprise including customers, prospects, citizens, suppliers, sites, hierarchies and chart of accounts (sic). • Master data management (MDM) is a technology-enabled discipline in which business and IT work together to ensure the uniformity, accuracy, stewardship, semantic consistency and accountability of the enterprise's official shared master data assets. - Source GartnerFrom Trends in Data Architecture 2017, by Donna Burbank & Charles Roe
  • 38. Global Data Strategy, Ltd. 2018 Master Data – the Opportunity 24 A 360 Degree View through Data Stefan Krauss Age = 31 Occupation = Ski Instructor Purchased €500 in outdoor gear in 2016 100% of purchases online Top Finisher in Engadin Ski Marathon 2010-2015 Member of Loyalty Program since 2010 Prefers Text Message Address = Pontresina, Switzerland
  • 39. Global Data Strategy, Ltd. 2018 Optimizing Restaurant Revenue through Menu Data • An international restaurant chain realized through its digital strategy that: • While menus are the core product that drives their business… • They had little control or visibility over their menu data • Menu data was scattered across multiple systems in the organization from supply chain to kitchen prep to marketing, restaurant operations, etc. • Menu data was consolidated & managed in a central hub: • Master Data Management created a “single view of menu” for business efficiency & quality control • Data Governance created the workflow & policies around managing menu data 25 Managing the Data that Runs the Business Product Creation & Testing Menu Display & Marketing Supply Chain Point of Sale & Restaurant Operations
  • 40. Global Data Strategy, Ltd. 2018 Transaction Data vs. Master Data Customer Date Product Code Price Quantity Location Stefan Kraus 1/2/2017 Scarpa Telemark Ski Boot SC1279 €250 1 St. Moritz, CH Donna Burbank 1/5/2017 Scarpa Telemark Ski Boot SCU1289 $150 1 Boulder, CO Stefan Kraus 1/2/2017 North Face Down Jacket NF8392 €450 1 Zurich, CH Stefan Kraus 1/2/2017 Garmin Sports Watch GM29384 €200 2 Zurich, CH Wendy Hu 3/4/2017 Prana Yoga Pant PN82734 $51 5 New York, NY Joe Smith 4/1/2017 Garmin Sports Watch GM29384 $150 1 Albany, NY 26 Consider the following retail transaction data Transaction Data • Describes an action (verb): E.g. “buy” • May include measurements about the action: (Who, When, What, How Many, Where, How Much, etc.) • E.g. Stefan Kraus, 1/2/2017/, Scarpa Telemark Ski Boot, St. Moritz, CH, €250 Master Data • Describes the key entities (nouns), e.g. Customer, Product, Location • Provides attributes & context for these nouns • e.g. Wendy Hu, age 25, female, resident of New York, NY, Customer since 2005, preferred customer card, etc.
  • 41. Global Data Strategy, Ltd. 2018 Customer Date Product Code Price Quantity Location Stefan Kraus 1/2/2017 Scarpa Telemark Ski Boot SC1279 €250 1 St. Moritz, CH Donna Burbank 1/5/2017 Scarpa Telemark Ski Boot SCU1289 $150 1 Boulder, CO Stefan Kraus 1/2/2017 North Face Down Jacket NF8392 €450 1 Zurich, CH Stefan Kraus 1/2/2017 Garmin Sports Watch GM29384 €200 2 Zurich, CH Wendy Hu 3/4/2017 Prana Yoga Pant PN82734 $51 5 New York, NY Joe Smith 4/1/2017 Garmin Sports Watch GM29384 $150 1 Albany, NY Transaction Data vs. Master Data 27 Master Data: Customer Master Data: Product Master Data: Location Reference Data: Country Codes Reference Data: State Codes Transaction Data
  • 42. Global Data Strategy, Ltd. 2018 Relational Databases & Transaction Data • Relational Databases are well-suited for transaction data: • Avoid Redundancy & Duplication: Through referential integrity, normalization • ACID Transactions (Atomicity, Consistency, Isolation, Durability) - guarantee validity even in the event of errors, power failures, etc. • Ease of Query via SQL: Table-based structure allows for ease of query. 28 Relational Databases are the workhorses of many organizations Relational Database
  • 43. Global Data Strategy, Ltd. 2018 ETL Master Data Solutions Can Help Create a Customer “Golden Record” 29 CRM In-Store Sales MarketingFinance Online Sales Supply Chain MDM “Golden Record” Data Warehouse BI & Reporting Data Model Lookup End User Applications Reference Data Sets Data Quality & Matching Publish & Subscribe
  • 44. Global Data Strategy, Ltd. 2018 Graph Databases • With graph databases, the relationships between data points often matter more than the individual points themselves. In order to leverage those data relationships, your organization needs a database technology that stores • A graph database uses a set of nodes, edges, and properties to represent and store data. • These relationships can help you discover new insights from your data. • Common use cases include: • Social Networks • “Enterprise Knowledge Graph” • Fraud Detection • Recommendation Engines 30 You bought this… You may also like this…
  • 45. Global Data Strategy, Ltd. 2018 No SQL • No SQL databases such as key value stores can store customer information such as Web session logs, user preference and profile stores, etc. 31 Fast response and high volume for web sessions, profiles, etc. Web pages from scarpa.com
  • 46. Global Data Strategy, Ltd. 2018 Data Models • Data Models can provide a holistic view of the organization • Provide a helpful overlay against • Business Process • Technical Architecture • Organizational Capability • Etc. 32 Address Customer Contact Order Request Product Schedule Company Invoice Payment Sales Rep
  • 47. Global Data Strategy, Ltd. 2018 Data Modeling is Hotter than ever 33 In a recent DATAVERSITY survey, over 96% of were engaged in Data Modeling in their organizations. Sexiest job of the 21st Century?
  • 48. Global Data Strategy, Ltd. 2018 Mapping Data to Business Process • Process models are a helpful tool for describing core business processes. • “Swimlanes” outline organizational considerations • Data can be mapped to key business processes to understand creation & usage of information. 34 Identifying key data dependencies in core business processes
  • 49. Global Data Strategy, Ltd. 2018 Business Capability Models • A business capability model outlines the core functional areas of the organization. • Note: this is not the same as an organizational chart • Capabilities can be overlayed with key data domains to create a “heat map” of cross-functional data usage. 35 Core Business Shared Services Artful Art’s Business Capabilities Etc. – sample subset only Product Development R&D Product Management Product Manufacturing Packaging Marketing Product Messaging Branding Product Launch Campaign Development Lead Generation Pricing Sales Pipeline Management Customer Relationship Quotes & Tenders Research & Development Branding & Go-to-Market Partner Management Sales & Distribution Human Resources Recruitment Employee Training Performance Management Legal Compliance Contract Management Data Domains Customer Product Account Etc.
  • 50. Global Data Strategy, Ltd. 2018 Data-Driven Merger for Financial Services The combined information assets of both companies is one of our biggest strategic advantages. - CEO • A key driver for a recent merger of two large financial institutions was the integration of data assets • Streamlining the merger of the two organizations by integrating the data assets • Identify ways in which data can be used to strategic advantage • Organizational Structure & Business Capability Alignment were critical • Understanding how data was used across the organization • Identifying efficiencies & opportunities for collaboration Business Capabilities Company A Business Capabilities Company B Common Data Foundation
  • 51. Global Data Strategy, Ltd. 2018 CRUD Matrix Product Development Supply Chain Accounting Marketing Finance Product Assembly Instructions C R Product Components C R Product Price C U R Product Name C U,D Etc. 37 Create, Read, Update, Delete • CRUD Matrices shows where data is Created, Read, Updated or Deleted across the various areas of the organization • This can be a helpful tool in data governance & data quality.
  • 52. Global Data Strategy, Ltd. 2018 Process Models & CRUD Fit Well Together • Business Process Models describe key activities within the organization. • Linking these processes to the data that is Created, Updated, or Deleted (CRUD) is important to understanding data usage. Customer Order Account Invoice Product Receive Customer Order R C C, R Process Customer Order C,R,U R,U R Fill Order R,U R,U R,U Send Invoice R,U R,U C CRUD Matrix Business Process Model
  • 53. Global Data Strategy, Ltd. 2018 Architecture helps create “Quick Wins” • Data Architecture aligned with business architecture helps identify key pain points & opportunities Customer Order Account Invoice Product Receive Customer Order R C C, R Process Customer Order C,R,U R,U R Fill Order R,U R,U R,U Send Invoice R,U R,U C CRUD Matrix Business Process Model • Customer Contact Information is not Consistent throughout the Customer Journey • In other words, we can’t follow up with our customers to: • Process their orders • Send an invoice • Join a Loyalty Program • Etc.
  • 54. Global Data Strategy, Ltd. 2018 Metadata Drives FTLB1 – Faster Time to Light Bulb Comprehensive, documented metadata helps organizations make better, faster, more cohesive decisions. 40 1 FTLB: Faster Time to Light Bulb. Not to be confused with: Ft lb: foot-pound (ft-lb) energy measurement unit FTLB: First Trust Hedged BuyWrite Income ETF (FTLB) investment fund. Metadata matters! Could Engineers have access to Support logs to understand product design issues & make improvements? Could we understand which Customers are in the Loyalty Program and what Products they’ve purchased? Etc, etc. -- Once you have a roadmap for your data assets, you can truly innovate and optimize the business.
  • 55. Global Data Strategy, Ltd. 2018 Optimizing Customer Experience through Better Data • A major Retail Vendor wanted to become a data-driven company • Enhancing the customer experience by mapping the Customer Journey to the Data Lifecycle • Using IoT product data to improve product design & customer service • Optimizing product supply chain & delivery • Developing a Tactical Data Strategy determined that • Master Data Management was needed to manage customer contact data throughout the Customer Journey • Data Governance was required to manage data across organizational siloes: product development, marketing, sales, etc. • Data Architecture was needed to understand the data ecosystem: data flow diagrams, data models, process models, etc. 41 Improving Customer Contact Data to Build Customer Loyalty & Increase Sales Customer SupportCustomer Discovery & Purchase Product Delivery & Tracking Product Usage Tracking Product Development
  • 56. Global Data Strategy, Ltd. 2018 Summary • A Successful Data Architecture creates fit for purpose solutions using the right technology for the right job • “Fit for Purpose” depends largely on business drivers and use cases • Collaboration is key as more and more roles are involved in data architecture • Data Architecture fundamentals such as: • Data models • Process models • Organizational capability models • and more… are critical in aligning business goals with data implementations • A Robust Data Architecture fundamentals helps identify & solve “quick wins”, and communicate the issues effectively across the enterprise.
  • 57. Global Data Strategy, Ltd. 2018 About Global Data Strategy, Ltd. • Global Data Strategy is an international information management consulting company that specializes in the alignment of business drivers with data-centric technology. • Our passion is data, and helping organizations enrich their business opportunities through data and information. • Our core values center around providing solutions that are: • Business-Driven: We put the needs of your business first, before we look at any technological solution. • Clear & Relevant: We provide clear explanations using real-world examples, not technical jargon. • Customized & Right-Sized: Our implementations are based on the unique needs of your organization’s size, corporate culture, and geography. • High Quality & Technically Precise: We pride ourselves in excellence of execution, and we attract high- quality professionals with years of technical expertise in the industry. 43 Data-Driven Business Transformation Business Strategy Aligned With Data Strategy www.globaldatastrategy.com
  • 58. Global Data Strategy, Ltd. 2018 White Paper: Trends in Data Architecture 44 Free Download • Download from www.globaldatastrategy.com • Under ‘Resources/Whitepapers’
  • 59. Global Data Strategy, Ltd. 2018 DATAVERSITY Data Architecture Strategies • January Panel: Emerging Trends in Data Architecture – What’s the Next Big Thing? • February Building an Enterprise Data Strategy – Where to Start? • March Modern Metadata Strategies • April The Rise of the Graph Database: Practical Use Cases & Approaches to Benefit your Business • May Data Architecture Best Practices for Today’s Rapidly Changing Data Landscape • June Artificial Intelligence: Real-World Applications for Your Organization • July Panel: Data as a Profit Driver – Emerging Techniques to Monetize Data as a Strategic Asset • August Data Lake Architecture – Modern Strategies & Approaches • Sept Master Data Management: Practical Strategies for Integrating into Your Data Architecture • October Business-Centric Data Modeling: Strategies for Maximizing Business Benefit • December Panel: Self-Service Reporting and Data Prep – Benefits & Risks 45 This Year’s Line Up for 2018 – Join Us Next Month
  • 60. Global Data Strategy, Ltd. 2018 Questions? 46 Thoughts? Ideas?