DATA GOVERNANCE &
DATA QUALITY PROGRAMS
BETTER OUTCOMES, WORTHWHILE CHANGE, FOR ANY
ORGANIZATION
6/18/2013
+
by Deepak Bhaskar
AGENDA
AGENDA
 Introduction
 Speaker Bio
 Company introduction
 Data issues for our Business:
 Challenge 1
 Batch mode Data cleansing: Centralizing commerce data in an ERP
DQP in ERP Implementation (Data Discover Profiling & DQ Tool)
 Challenge 2
 Real Time Data cleansing: Cloud Commerce Billing/Shipping Address Errors
DQP in Real Time Address Validation & Cleansing (DQ Tool & Postal dir.)
 Further Recommendations
 Conclusion: Digital River Data Governance best practices
3
SPEAKER BIO:
4
Introduction Business Challenge 1 Business Challenge 2 Recommendations Conclusion
 At Digital River – 10 years
 Other roles held:
 Manager, Enterprise Data Quality, (2008-12)
 Sr. Strategic Database Analyst, Strategic Marketing (2005-08)
 Sr. Software Test Engineer, Quality Assurance (2003-05)
 Roles held in prior to Digital River include:
 Lead Test Consultant, (Gelco Info. Network, now Concur Technologies)
 DBA, (Eschelon Telecom, now Integra Telecom)
 DBA, Software Developer , Sr. Test Engineer (techies.com)
 Retail Marketing Associate (Barnes and Noble Booksellers)
 Outside of work:
 Enjoy reading, gardening and DIY home projects, vacationing and foreign travels
DEEPAK BHASKAR
Sr. Manager, Data Governance, Trillium Product.
Governance and Compliance.
COMPANY OVERVIEW
DIGITAL RIVER
DIGITAL RIVER
6
Generating Revenue in Virtually Every
Country on the Planet
38 Patents Issued in Commerce,
Marketing and Payments
Technology Pioneer, Founded in 1994
2012 FINANCIAL HIGHLIGHTS
Revenue $386 MILLION
R&D Investment $64 MILLION
Strong Financial Balance Sheet
NASDAQ: DRIV
Invest 3 Million Hours Per Year Focused
on Growing Our Clients Revenue
Who We Are Our Focus Our Passion Experience
Managing Over $22 Billion in Annual
Online Transactions
Innovation
SIMPILFY THE COMPLEX
Shopping Cart
Export
Compliance
Global Capabilities
Payments, Multi-lingual
Advanced Business Models
Subs, Rentals, Points, etc.
Tax & Fraud
Management
Compliance
(PCI, SOX, SAS, Export)
Marketing and
Demand Gen
Store Front
API’s &
Integrations
We manage the complexity
and risk on a global scale to
enable a great user
experience
Who We Are Our Focus Our Passion Experience Innovation
7
UNMATCHED GLOBAL EXPERIENCE AND REACH
8
40
40
30
31
15
localized payment methods
transaction currencies
site display languages
offices across the globe
languages in customer service
Minneapolis • Aliso Viejo • Pittsburgh • Portland • Provo • San
Diego • Seattle • Cologne • London • Luxembourg • São Paulo •
Shanghai • Shannon • Stockholm • Taipei • Tokyo • Vienna
Who We Are Our Focus Our Passion Experience Innovation
DIGITAL RIVER PROMISE
9
Unmatched speed to
market
19 years of experience
Why world class companies put their trust in Digital River
1,400+ e-commerce
experts worldwide
3 million hours a year
invested in our client
success
Deep understanding of
consumer psychology
and online behaviors
Manage more than
$22 billion in online
transactions
Global Demand
marketing experts
Over 100 third party
relationships
Most complete fraud
detection tools in the
industry
Who We Are Our Focus Our Passion Experience
“Digital River has been with us step-by-step as we’ve launched online stores. Their technology
supports our online commerce capabilities in North America, Europe and Asia, and their
marketing solutions help us acquire and retain new customers every day.”
- Lance Binley, Logitech Vice President of Digital and E-Commerce
Innovation
 Software and Services: We support the online businesses of some of the
most recognized names in the software industry, including Microsoft, Adobe
and SAP
 Consumer Electronics: We Partner with global consumer electronic
manufacturers to help them grow revenue through the direct to consumer
channel—Our customers include Samsung, Lenovo, Logitech and others
 Games & Entertainment: Enabling consumers across the globe to access
their favorite titles immediately through e-commerce customers include
Electronic Arts, Ubisoft and Ticketmaster
 Education: We help learners take advantage of the benefits associated
with online education—customers include University of Phoenix, Kaplan and
Barnes & Noble, and many others
 Travel: We support some of the travel industry’s leading online sites
including Orbitz, Hotels.com and Expedia.
 E-tail: Online retailers such as eBay, American Apparel and Mary Kay rely
on Digital River to take their products to the online market.
10
Digital River has helped some of the world’s leading brands build successful online
businesses. We focus on global enterprises and SMBs in industries that include:
Who We Are Our Focus Our Passion Experience
MARKETS WE SERVE
Innovation
SERVICES
11
Store
Architecture
Store
Content
Local
Fulfillment
Customer
Service
Subscriptions
Reporting
& Analytics
Locale
Merchandising
Email
Marketing
Search
Optimization
Affiliate
Marketing
Brand
Development
Currency
Pricing
Local/VAT
Tax Support
Global
Processing
Transaction
Routing
Fraud
Screening
Site
Optimization
WORLDWIDE
PAYMENTS
WORLDWIDE
COMMERCE
WORLDWIDE
MARKETING
Who We Are Our Focus Our Passion Experience
Merchant
Services
A flexible, expandable e-commerce ecosystem
perfectly suited to the needs of your business.
YOUR CUSTOM ECOSYSTEM
Innovation
PERFORMANCE MARKETING
Who We Are Our Focus Our Passion Experience
12
Marketing expertise to acquire and retain
customers.
• Search Engine Marketing services to help create
a strategy that maximizes your pay-per-click ad
spend
• Display Advertising to drive “eyeballs” to your
sites and create the brand awareness needed to
compete for market share
• Affiliate Programs and Networks to drive
revenue through a community of pay-for-
performance publishers
• Site Optimization to make sure customers find
their way to your site
• Email Programs that match messages to your
customers digital body language
• Advanced Analytics to provide the data points
needed to manage key performance indicators
Innovation
SOFTWARE &
SERVICES
GAMES AND
ENTERTAINMENT
WORLD-CLASS CUSTOMERS
13
TRAVEL
E-TAIL
EDUCATION
Who We Are Our Focus Our Passion Experience
Consumer
Electronics
Innovation
OPEN. MODULAR. ECOSYSTEM
14
Who We Are Our Focus Our Passion Experience Innovation
BATCH MODE DATA CLEANSING: CENTRALIZING
COMMERCE DATA
BUSINESS CHALLENGE 1
EARLY YEARS (MID-90’S): SINGLE E-COMMERCE PLATFORM
16
Introduction Business Challenge 1 Business Challenge 2 Recommendations Conclusion
 At the heart of the web hosting business:
 The order checkout workflow, which consists of:
 Store homepage
 Product detail Page
 Shopping cart page
 Bill to page
 Ship to page
 Payment processing page
 Order confirmation page
 Thank you page
 Invoice page
TODAY: MANY CLOUD COMMERCE PLATFORMS (A RESULT OF ACQUISITIONS)
17
Introduction Business Challenge 1 Business Challenge 2 Recommendations Conclusion
E-Com1
E-Com2
E-Com3
E-Com4
E-Com5
E-Com6
E-Com7
E-Com8
BATCH MODE DATA CLEANSING: CENTRALIZING COMMERCE DATA
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
 In 2008 Digital River was dealing with Multiple commerce platforms
 Cons:
 Inefficient use of Developers and Functional teams
 Confusion around definition of common terms
 Inaccurate data being propagated across the systems
 Longer times to close our books at the end of the month
 Many manual work efforts
 Digital River Solution:
 Align all of the platform transaction data, as a Business
Imperative with the aid of a Data Governance Program, to
support creating a single source of truth (ERP)
 Challenges:
 Different source data capture points and multiple workflows
 Different payments methods and fraud rates
 Similar technology processes performed by different systems
 Similar business concepts that used many terminologies
18
DATA MANAGEMENT ASSOCIATION (DAMA)
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
- Data Architecture: as an integral part of the enterprise
architecture
- Data Modeling & Design: analysis, design, build, test,
deployment and maintain
- Data Storage: structured physical data assets storage
management
- Data Security– support ensuring privacy, confidentiality
and appropriate access
- Data Integration & Interoperability – support data
acquisition, transformation and movement (ETL),
federation, or virtualization
- Documents and Content – store, protect, index, and
enable access to data found in unstructured sources
(electronic files and physical records), and make data
available for integration and interoperability with
structured (database) data.
- Reference & Master Data – manage gold versions and
replicas
- Data Warehousing and Business Intelligence –
support managing analytical data processing and enable
access to decision support data for reporting and analysis
- Meta-data: integrate, control and deliver meta-data
- Data Quality: define, monitor and improve data quality
DATA MANAGEMENT BODY OF
KNOWLEDGE (DMBOK) GOVERNANCE
FRAMEWORK
© DAMA-DMBOK2 (Apr 2012)
19
DATA MANAGEMENT ASSOCIATION (DAMA)
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
DATA MANAGEMENT BODY OF
KNOWLEDGE (DMBOK) GOVERNANCE
FRAMEWORK
Data Governance:
Involves planning, oversight, and
control over data management
and use of data
© DAMA-DMBOK2 (Apr 2012)
20
DATA MANAGEMENT ASSOCIATION (DAMA)
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
© DAMA-DMBOK2 (Apr 2012)
Data Management Functions Environmental Elements
21
WHAT IS DATA GOVERNANCE?
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
Data Governance has all the
characteristics of any Strategic
governance process
Process
People
Technology
Programs
Management
Governing
body
Procedures
Plan
Decision
-making
Business
needs
support
Strategy
Assets
Digital River’s definition of Data Governance:-
A set of processes that treats Data as a Strategic Area within the enterprise
(just like Sales, Finance, HR, Sourcing, etc…)
22
BUSINESS IMPACT/BENEFITS AND RETURN ON OBJECTIVE
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
 A mechanism to convert raw Order/Transaction, Customer, Client, Vendor,
Product and Other data collected from the shopper websites that we host
for our clients, to 2 categories.
 Clean Data (passed on to the ERP)
 Dirty Data (requiring some clarification and remediation)
 Digital River’s definition of Data Governance:-
 A set of processes that treats Data as a Strategic Area within
the enterprise
23
THE DATA MANAGEMENT WHEEL: BINARY VS. TERNARY
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
 In 2008 embraced DM which meant fundamentally
changing the organizational structure of Digital
River:
IT
Bus
IT
Bus
DM
Binary model:
No Data Mgmt
IT and Business frictions
Ternary model:
Data Mgmt
No IT and Business frictions
DM deployment
 The DM is a process “wheel” owned by the Data Stewards
 Data Stewards interface with Business and IT Stewards to carry
out Data Management activities around remediating the Dirty Data
24
ENTERPRISE DATA MANAGEMENT MATRIX ORGANIZATION & ACTIVITIES
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
Data Management
Data
Governance
Policies and
processes
governing the
management of
the data
environment
Data Quality
People,
Processes and
Tools involved in
enhancing,
measuring, and
monitoring data
quality
Master Data
Management
People,
Processes and
Tools controlling
the body of
master data
Meta Data
Management
Centralization of
all data
definitions,
relationships,
ownership and
identification
ERP & Data Warehousing
Integrated environment enabling the implementation of all data rules and processes
Data Stewardship
Organizational resources carrying out and supporting all Data Management activities
25
SIMPLIFYING PLATFORMS DOING SIMILAR THINGS
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
E-Com1 E-Com2
- Accounting
- Reporting
- Billing
- Client Management
- Tax
- Compliance
- Accounting
- Reporting
- Billing
- Client Management
- Tax
- Compliance
- Accounting
- Reporting
- Billing
- Client Management
- Tax
- Compliance
 Challenge:
 How can we centralize all of our platforms, creating one
true source for all Accounting, Reporting, Billing, etc?
.
.
.
E-Com8
 Business functions spread across each platform
 Decentralized structure
26
SOLUTION: ERP
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
 Commerce would continue to happen on platforms, and transmit to the ERP
system in batches of data
 Implement an ERP system, sourced from each of the separate e-commerce
platforms
E-Com1
E-Com2
E-Com8
SAP - ERP
.
.
.
27
SOLUTION: ERP SYSTEM FED BY COMMERCE PLATFORM DATA
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
ERP
ETL
E-Com1
E-Com2
E-Com3
DATA QUALITY
ERP
ERP
Integration
Structure (ETL)
• Extract
• Transform
• Load
Content (Data Quality Tool)
• Quality Rules
• Governance
• Certification
ERP
DW
BI
REPORTING
Process (ERP)
• Integration
• Productivity
• Controls
Reporting
• Accuracy
• Flexibility
• Scalability
Ancillary systems
ERP
MDM
ETL drop
zone
TSS ®
Stage
.
.
.
> Commerce occurs on platforms, batches of data transmitted to ERP
> DQP RFP: DQP Tool became an integral Technology component of
the ERP Implementation 28
THE DATA QUALITY PROGRAM (DQP): PROCESS COMPONENT
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
Identification
Impact
assessment
Clarification &
remediation
Monitoring IT Bus.
1. Identification:
> Top Data Areas of importance
> Top 5 issues/concerns in Data Areas
> Provide unfiltered dataset to EDM
2. Impact assessment:
> EDM loads dataset to TSS for Profiling
> EDM writes up potential Business Rule
> EDM sets up a workshop
3. Clarification & remediation
> Data Steward attends Business Rules workshop
> Data Steward clarifies and sign-off Business Rules
> EDM Implement Business Rules
4. Monitoring
> EDM builds the Data Quality dashboard
> EDM conducts regular Data Quality compliance
monitoring
> Objective:
> Improving the Quality of your Data through a strategic framework and a tactical
methodology
29
DATA QUALITY PROGRAM (DQP FOR ERP): PEOPLE COMPONENT
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
>Roles & responsibilities:
>Data Management (DQP Manager,
Data Stewards)
>Handle the implementation and regular
review of their assigned rules (monthly
data quality meetings, rules sign off, Data
Quality policy enforcement, etc…)
>Business Owners:
>Own the determination of Business rules.
Engage their Data Stewards when an
update/new rule is required.
>IT SMEs:
>Build and maintain the interfaces
between data consuming systems and the
DQP application
Identification
Impact
assessment
Clarification &
remediation
Monitoring IT Bus.
> Objective:
> Centralize the management of quality rules for all enterprise data elements
30
DQP ROLES
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
31
DQP: ERP IMPACT ASSESSMENT
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
Attribute
Unique
Values
Min Max
Null Dist
%
Business Rules
Platform Id 1 GAT GAT 0
Permissible values are GAT, TLA, or GNT. Nulls are not allowed. When the
value is TLA, it must be recoded to TA.
Customer Id 37216 742328 2789613 0 Nulls are not allowed. When a value is present, this field is a pass through.
Bill To Address Id 39044 4293408 5749721 0 Nulls are not allowed. When a value is present, this field is a pass through.
Ship To Address Id 39044 4293408 5749721 0 Nulls are not allowed. When a value is present, this field is a pass through.
Site Id 216 bhaute zitvee 0
No Nulls Allowed. Permissible Value set are determined within ERP
(location of master list to be determined)
Site Owner Id 151 bhaute zitvee 0
No Nulls Allowed. Permissible Value set are determined within ERP
(location of master list to be determined)
DQP: ERP Clarification & Remediation
> DQ Tool Business Rules were recorded in a Business Rule Book
> Each rule was approved and signed off by a Business Steward
> DQ Workshop Document
32
DQP: ERP CLARIFICATION & REMEDIATION
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
 Where do we implement the Business rules?
E-Com1
E-Com2
E-Com3
ERP
DATA QUALITY
ETL drop zone
TSS ®
payment_type
varchar2 (32 byte)
Visa
payment_id
number (2)
1
pay_method
char (2 byte)
VS
payment_method
varchar2 (32 byte)
VISA
payment_method
Visa
1
VS
payment_method
VISA
Impact
assessment
Identification
IT Bus.
Clarification &
remediation
Monitoring
.
.
.
Staging
Each Business Rule is against a column:
> If the Payment method column value is: ‘Visa’ , ‘1’ , ‘VS’
> Then recode the Payment Method column value to ‘VISA’
33
DQP: ERP MONITORING
Business Challenge 1
Introduction Business Challenge 2 Recommendations Conclusion
 Measures the level of
data quality = rate of
compliance with business
rules (DQ Tool output)
 Data Quality is measured
monthly, after updates in
Business Rules from
previous report
 Data Stewards
responsible for acting on
DQ Dashboard metrics
 Over 400+ attributes
have business rules fired.
 Consistently achieving
15-20% increase in the
quality of data as a result
of data cleansing
34
REAL TIME ADDRESS VALIDATION FOR COMMERCE STORES
BUSINESS CHALLENGE 2
THE ON-DEMAND TECHNOLOGY ADVANTAGE
36
Who We Are Our Focus Our Passion Experience Innovation
An Average Day, We Support:
• 1.5+ billion API calls
• Serve 60 million pages
• Send 3+ million emails
• Process 300,000 orders
• Create 5 authorizations/sec
• Host 6+ terabytes of digital content
Industry Leading 99.997% Uptime
Managed to < 40% Utilization
7 Triple Redundant Servers Worldwide
E-COMMERCE TAILORED TO YOUR NEEDS
37
Our partners complement existing systems, address specific technology requirements, and evolve
with the market and your growing business over time.
Who We Are Our Focus Our Passion Experience Innovation
API FIRST METHODOLOGY
38
Who We Are Our Focus Our Passion Experience Innovation
APIs
CLOUD COMMERCE BILLING & SHIPPING ADDRESS ORDER ERRORS
39
Business Challenge 2
Business Challenge 1
Introduction Recommendations Conclusion
 Incorrect Cloud Commerce Billing and Shipping Address Order Errors
 Challenges:
 Increased Lost / Returned Package costs
 Incorrect taxation on orders
 Cons:
 Increased customer service costs
 Unsatisfied customers
 Loss of products and sales
 Potential for undetected fraud
 Many manual work efforts to go around the challenge
 Digital River Solution:
 Digital River implemented Real-Time Address validation
(RTAV). A Data Quality Traffic Monitor/Router and a Data
Quality Tool were selected for the RTAV.
 Enterprise Software licenses were acquired and Country Postal
Templates and Country Postal Subscriptions were subscribed to.
 Data Management team was made responsible for the and Data
Governance and Data Quality efforts pertain Addresses.
 And DQ efforts moved upstream from ERP batch to real-time.
BUSINESS IMPACT/ BENEFITS AND RETURN ON OBJECTIVE FOR RTAV
40
Business Challenge 2
Business Challenge 1
Introduction Recommendations Conclusion
DUE DILIGENCE: ADDRESS DATA QUALITY VENDOR REVIEW
41
Business Challenge 2
Business Challenge 1
Introduction Recommendations Conclusion
LENGTH OF TIME RTAV HAS BEEN IN PLACE/PROGRAM EVALUATION
42
Business Challenge 2
Business Challenge 1
Introduction Recommendations Conclusion
DQP: HOW RTAV WORKS
SCALE OF THE RTAV RELEASE PROCESS SOLUTION (ENTERPRISE)
43
Business Challenge 2
Business Challenge 1
Introduction Recommendations Conclusion
DQP: REAL TIME ADDRESS VALIDATION (RTAV)
44
Business Challenge 2
Business Challenge 1
Introduction Recommendations Conclusion
E-Com
Platform 3
E-Com
Platform 2
E-Com
Platform 1
ETL
Global Postal
Directories
DQP Tool
ERP System
Traffic Router
Real Time Cleansing
Hourly Batch Cleansing Bad Addresses
Bad Addresses
Cleansed Addresses
Clean Addresses
Impact
assessment
Identification
IT Bus.
Clarification &
remediation
Monitoring
Business
Consumers/Owners
IT Owners,
Code
Owners,
Tech. SME’s
Data
Stewards
Countries covered
• N.America (2)
• W. Europe Bundle (16)
• LAM Bundle (1)
• APAC Bundle (2 Multi-byte,
1 single byte)
Future Expansion
• E.Europe
expansion
• APAC expansion
• LAM expansion
Data Quality &
Traffic Monitoring
Service
• 3 Data Center red.
solution
• Load balanced
• Code Promotion (Dev,
Sys)..
• Platform Release Cycle
Data Quality & Profiling Discovery
Tool
• 1 Data Center solution with backup
• Load balanced
• Code Promotion, Dev, Sys, Int,
Prod
• ERP Release Cycle
THE TEAM EVOLUTION: DATA MANAGEMENT AT DIGITAL RIVER (2008-13)
45
Business Challenge 2
Business Challenge 1
Introduction Recommendations Conclusion
Vice President
Operations
Vice President
Strategic
Technologies
Sr. Director
EDM
Data Steward Data Steward Data Steward
Enterprise Data Management Data Governance Steering Committee
Vice President
Operations
Vice President
Finance
Sr. Director
EDM
Vice President
Strategic
Technologies
Vice President
Strategic
Marketing
Vice President
Tax
Vice President
Enterprise Systems
and Data
Management
Vice President
Enterprise Systems
and Data
Management
CFO
Vice President
Strategic
Technologies
Data Steward
Manager
Data Quality
Data Steward
Enterprise Data Management Data Governance Steering Committee
Vice President
Finance
Vice President
Strategic
Technologies
Vice President
Tax
Vice President
Internal
Systems
CFO
Vice President
Internal
Systems
Vice President
Product
Manager
Data Quality
CIO
Vice President
Governance &
Compliance
Sr. Software
Engineer
Sr. Manager
Data Governance,
DQ Tool Product
Manager
Data Steward
ERP
Enterprise Data Management Data Governance Steering Committee
Vice President
Finance
Vice President
Tax
Vice President
Internal
Systems
CFO
Vice President
Internal
Systems
CIO
Vice President
Governance &
Compliance
Vice President
Product
Vice President
Development
CMO
Sr. Manager
Data Governance, DQ
Tool Product Manager
COO
2008
2010
2013
OVERALL BENEFITS OF THE DATA QUALITY PROGRAM
46
Business Challenge 2
Business Challenge 1
Introduction Recommendations Conclusion
 Data Quality provides - Single, independent environment manages all
business rules that ensures data quality for ERP
 DQ Traffic Routing Tool and DQ Tool provides the ability to conduct Real Time
Address validation for the Commerce platforms and other batch mode cleansing
functionality for the ERP
 DQP Tool Advantage: When new e-commerce platforms are integrated to the
ERP, existing business rules are reused, minimizing redundant development, and
centralized management of Business rules
 DQP: A 4-step process that requires People, Process and Technology to support
our Data Governance efforts
 2010 Pitney Bowes Software survey - 2/3 of organizations (revenues >
$1Billion), have Data Governance activities underway (including MDM projects)
http://www.information-management.com/newsletters/data_governance_MDM_maturity_ROI-10022164-1.html
WHAT OTHER CHANGES COULD POTENTIALLY WORK BETTER?
FURTHER
RECOMMENDATIONS
Recommendations
PEOPLE, PROCESS, TECHNOLOGY
48
Business Challenge 1 Business Challenge 2
Introduction Conclusion
>Data Governance need not be invented from scratch:
HR Governance Financial Governance Data Governance
People HR associates
Financial analysts;
accountants
Data Stewards
Process
Human Capital
Management
Finance & Accounting Data Management
Technology HR systems
Accounting systems
(G/L; Tax; Treasury)
Data Quality; MDM; MDR
systems
Functional Programs
Skill set mgmt
Recruiting
Benefits mgmt
Compensation framework
Contractor mgmt
Training
Budget & forecasting
Treasury
Financial reporting
Tax
Investment Mgmt
Data Quality Program
MDM Program
MDR Program
Managed asset Labor force
Financial assets &
liabilities
Data
Policies & Regulations HR policies
SOX, SAS 70, SEC, IFRS,
etc…
Privacy laws; HIPAA; SOX; DM
Policies; etc…
Functional leaders
Training Mgr
Recruitment Mgr
Benefits Mgr
Comptroller
Tax Mgr
Investment Mgr
DQP Mgr
MDM Mgr
MDR Mgr
Process owner VP of HR VP of Finance / CFO
VP of Data Management / CDO
(Chief Data Officer)
Recommendations
NEW ORG. ROLES CHIEF DATA OFFICER/VP OF DATA MGMT.
49
Business Challenge 1 Business Challenge 2
Introduction Conclusion
CIO / VP Technology
Manager / Director
CDO / VP Data Mgmt.
Data
Governance
+
IT
Governance
Focus: Process Mgmt Focus: Data Mgmt
 Data Governed as an Independent Asset
 Centralized authority: CDO / VP Data Mgmt.
 Improved control over compliance and
financial risks
 Clear accountability for all aspects of data
 Cost reductions from uniform DM processes
 Data scalable across the enterprise, and
over time (growth, acquisitions…)
 Data Management no longer dependent on
IT strategy
 Cannot be governed Independently
 Not managed as a Strategic Asset
 Conflict of interests between Technology
and Data Management
 Difficult to enforce Quality rules across
the enterprise
 High cost and low returns
 Data becomes silo-driven (like IT…)
 Responsibility without authority
Recommendations
EXPANSION OF THE EDM MATRIX ORGANIZATION
50
Business Challenge 1 Business Challenge 2
Introduction Conclusion
* Chief Data Officer (typically reports to CTO, CIO, CEO, CMO, CSO) http://en.wikipedia.org/wiki/Chief_data_officer
** Data Management Area: typically determined using a Data Consumption Matrix (regularly updated)
*** Data Stewards can either belong to the EDMO, remain in their respective DMA, or both.
CDO*
DQ MDR
MDM LDM . . .
Program Managers
Senior DM Executives
Data
Stewards
***
DMA** 1
DMA** 2
DMA** 4
DMA** 3
DM Council/
Steering Committee
Recommendations
DATA GOVERNANCE SCOPE OF CONTROL
51
Business Challenge 1 Business Challenge 2
Introduction Conclusion
© Copyright Baseline Consulting Group, 2013. Used with permission from SAS Institute.
WHAT ARE THE LESSONS LEARNED?
CONCLUSION
 Data Governance and the DQP: Managed process oversight to
ensure that data-related processes and controls are being followed
 Data Governance at Digital River
 Is a Strategic and Permanent investment to treat Data as a Strategic Asset
 It exists through a functional Enterprise Data Management program
 Data Quality Program (DQP)
 A 4-step process. Requires People, Process and Technology to support our Data Governance efforts
 Reduces Operational costs for order checkout and info. delivery processes
 Reduces Risk exposures (financial, regulatory, market and strategic)
 Both Require:-
 An organizational change to the Ternary model (Business / Data / IT)
 A “Data Governor Authority” (e.g. VP of Data Mgmt.) and a dedicated EDM team
 Effective use of Data Quality tools (for Profiling, Discovery, Cleansing etc.)
 Contrary to many beliefs the Data Quality Tool is NOT a Database
 It is a repository of business rules; Rules can be managed and reused.
DATA GOVERNANCE AT DIGITAL RIVER
53
Conclusion
Business Challenge 1 Business Challenge 2 Recommendations
Introduction
Impact
assessment
Identification
IT Bus.
Clarification &
remediation
Monitoring
54
DEEPAK BHASKAR
Sr. Manager, Data Governance, Trillium Product
Governance and Compliance
Digital River, Inc.
http://www.linkedin.com/in/dbhaskar1
DB_2008
dbhaskar03
dbhaskar2008

2013 Data Governance Information Quality (DGIQ) Conference session

  • 1.
    DATA GOVERNANCE & DATAQUALITY PROGRAMS BETTER OUTCOMES, WORTHWHILE CHANGE, FOR ANY ORGANIZATION 6/18/2013 + by Deepak Bhaskar
  • 2.
  • 3.
    AGENDA  Introduction  SpeakerBio  Company introduction  Data issues for our Business:  Challenge 1  Batch mode Data cleansing: Centralizing commerce data in an ERP DQP in ERP Implementation (Data Discover Profiling & DQ Tool)  Challenge 2  Real Time Data cleansing: Cloud Commerce Billing/Shipping Address Errors DQP in Real Time Address Validation & Cleansing (DQ Tool & Postal dir.)  Further Recommendations  Conclusion: Digital River Data Governance best practices 3
  • 4.
    SPEAKER BIO: 4 Introduction BusinessChallenge 1 Business Challenge 2 Recommendations Conclusion  At Digital River – 10 years  Other roles held:  Manager, Enterprise Data Quality, (2008-12)  Sr. Strategic Database Analyst, Strategic Marketing (2005-08)  Sr. Software Test Engineer, Quality Assurance (2003-05)  Roles held in prior to Digital River include:  Lead Test Consultant, (Gelco Info. Network, now Concur Technologies)  DBA, (Eschelon Telecom, now Integra Telecom)  DBA, Software Developer , Sr. Test Engineer (techies.com)  Retail Marketing Associate (Barnes and Noble Booksellers)  Outside of work:  Enjoy reading, gardening and DIY home projects, vacationing and foreign travels DEEPAK BHASKAR Sr. Manager, Data Governance, Trillium Product. Governance and Compliance.
  • 5.
  • 6.
    DIGITAL RIVER 6 Generating Revenuein Virtually Every Country on the Planet 38 Patents Issued in Commerce, Marketing and Payments Technology Pioneer, Founded in 1994 2012 FINANCIAL HIGHLIGHTS Revenue $386 MILLION R&D Investment $64 MILLION Strong Financial Balance Sheet NASDAQ: DRIV Invest 3 Million Hours Per Year Focused on Growing Our Clients Revenue Who We Are Our Focus Our Passion Experience Managing Over $22 Billion in Annual Online Transactions Innovation
  • 7.
    SIMPILFY THE COMPLEX ShoppingCart Export Compliance Global Capabilities Payments, Multi-lingual Advanced Business Models Subs, Rentals, Points, etc. Tax & Fraud Management Compliance (PCI, SOX, SAS, Export) Marketing and Demand Gen Store Front API’s & Integrations We manage the complexity and risk on a global scale to enable a great user experience Who We Are Our Focus Our Passion Experience Innovation 7
  • 8.
    UNMATCHED GLOBAL EXPERIENCEAND REACH 8 40 40 30 31 15 localized payment methods transaction currencies site display languages offices across the globe languages in customer service Minneapolis • Aliso Viejo • Pittsburgh • Portland • Provo • San Diego • Seattle • Cologne • London • Luxembourg • São Paulo • Shanghai • Shannon • Stockholm • Taipei • Tokyo • Vienna Who We Are Our Focus Our Passion Experience Innovation
  • 9.
    DIGITAL RIVER PROMISE 9 Unmatchedspeed to market 19 years of experience Why world class companies put their trust in Digital River 1,400+ e-commerce experts worldwide 3 million hours a year invested in our client success Deep understanding of consumer psychology and online behaviors Manage more than $22 billion in online transactions Global Demand marketing experts Over 100 third party relationships Most complete fraud detection tools in the industry Who We Are Our Focus Our Passion Experience “Digital River has been with us step-by-step as we’ve launched online stores. Their technology supports our online commerce capabilities in North America, Europe and Asia, and their marketing solutions help us acquire and retain new customers every day.” - Lance Binley, Logitech Vice President of Digital and E-Commerce Innovation
  • 10.
     Software andServices: We support the online businesses of some of the most recognized names in the software industry, including Microsoft, Adobe and SAP  Consumer Electronics: We Partner with global consumer electronic manufacturers to help them grow revenue through the direct to consumer channel—Our customers include Samsung, Lenovo, Logitech and others  Games & Entertainment: Enabling consumers across the globe to access their favorite titles immediately through e-commerce customers include Electronic Arts, Ubisoft and Ticketmaster  Education: We help learners take advantage of the benefits associated with online education—customers include University of Phoenix, Kaplan and Barnes & Noble, and many others  Travel: We support some of the travel industry’s leading online sites including Orbitz, Hotels.com and Expedia.  E-tail: Online retailers such as eBay, American Apparel and Mary Kay rely on Digital River to take their products to the online market. 10 Digital River has helped some of the world’s leading brands build successful online businesses. We focus on global enterprises and SMBs in industries that include: Who We Are Our Focus Our Passion Experience MARKETS WE SERVE Innovation
  • 11.
  • 12.
    PERFORMANCE MARKETING Who WeAre Our Focus Our Passion Experience 12 Marketing expertise to acquire and retain customers. • Search Engine Marketing services to help create a strategy that maximizes your pay-per-click ad spend • Display Advertising to drive “eyeballs” to your sites and create the brand awareness needed to compete for market share • Affiliate Programs and Networks to drive revenue through a community of pay-for- performance publishers • Site Optimization to make sure customers find their way to your site • Email Programs that match messages to your customers digital body language • Advanced Analytics to provide the data points needed to manage key performance indicators Innovation
  • 13.
    SOFTWARE & SERVICES GAMES AND ENTERTAINMENT WORLD-CLASSCUSTOMERS 13 TRAVEL E-TAIL EDUCATION Who We Are Our Focus Our Passion Experience Consumer Electronics Innovation
  • 14.
    OPEN. MODULAR. ECOSYSTEM 14 WhoWe Are Our Focus Our Passion Experience Innovation
  • 15.
    BATCH MODE DATACLEANSING: CENTRALIZING COMMERCE DATA BUSINESS CHALLENGE 1
  • 16.
    EARLY YEARS (MID-90’S):SINGLE E-COMMERCE PLATFORM 16 Introduction Business Challenge 1 Business Challenge 2 Recommendations Conclusion  At the heart of the web hosting business:  The order checkout workflow, which consists of:  Store homepage  Product detail Page  Shopping cart page  Bill to page  Ship to page  Payment processing page  Order confirmation page  Thank you page  Invoice page
  • 17.
    TODAY: MANY CLOUDCOMMERCE PLATFORMS (A RESULT OF ACQUISITIONS) 17 Introduction Business Challenge 1 Business Challenge 2 Recommendations Conclusion E-Com1 E-Com2 E-Com3 E-Com4 E-Com5 E-Com6 E-Com7 E-Com8
  • 18.
    BATCH MODE DATACLEANSING: CENTRALIZING COMMERCE DATA Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion  In 2008 Digital River was dealing with Multiple commerce platforms  Cons:  Inefficient use of Developers and Functional teams  Confusion around definition of common terms  Inaccurate data being propagated across the systems  Longer times to close our books at the end of the month  Many manual work efforts  Digital River Solution:  Align all of the platform transaction data, as a Business Imperative with the aid of a Data Governance Program, to support creating a single source of truth (ERP)  Challenges:  Different source data capture points and multiple workflows  Different payments methods and fraud rates  Similar technology processes performed by different systems  Similar business concepts that used many terminologies 18
  • 19.
    DATA MANAGEMENT ASSOCIATION(DAMA) Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion - Data Architecture: as an integral part of the enterprise architecture - Data Modeling & Design: analysis, design, build, test, deployment and maintain - Data Storage: structured physical data assets storage management - Data Security– support ensuring privacy, confidentiality and appropriate access - Data Integration & Interoperability – support data acquisition, transformation and movement (ETL), federation, or virtualization - Documents and Content – store, protect, index, and enable access to data found in unstructured sources (electronic files and physical records), and make data available for integration and interoperability with structured (database) data. - Reference & Master Data – manage gold versions and replicas - Data Warehousing and Business Intelligence – support managing analytical data processing and enable access to decision support data for reporting and analysis - Meta-data: integrate, control and deliver meta-data - Data Quality: define, monitor and improve data quality DATA MANAGEMENT BODY OF KNOWLEDGE (DMBOK) GOVERNANCE FRAMEWORK © DAMA-DMBOK2 (Apr 2012) 19
  • 20.
    DATA MANAGEMENT ASSOCIATION(DAMA) Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion DATA MANAGEMENT BODY OF KNOWLEDGE (DMBOK) GOVERNANCE FRAMEWORK Data Governance: Involves planning, oversight, and control over data management and use of data © DAMA-DMBOK2 (Apr 2012) 20
  • 21.
    DATA MANAGEMENT ASSOCIATION(DAMA) Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion © DAMA-DMBOK2 (Apr 2012) Data Management Functions Environmental Elements 21
  • 22.
    WHAT IS DATAGOVERNANCE? Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion Data Governance has all the characteristics of any Strategic governance process Process People Technology Programs Management Governing body Procedures Plan Decision -making Business needs support Strategy Assets Digital River’s definition of Data Governance:- A set of processes that treats Data as a Strategic Area within the enterprise (just like Sales, Finance, HR, Sourcing, etc…) 22
  • 23.
    BUSINESS IMPACT/BENEFITS ANDRETURN ON OBJECTIVE Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion  A mechanism to convert raw Order/Transaction, Customer, Client, Vendor, Product and Other data collected from the shopper websites that we host for our clients, to 2 categories.  Clean Data (passed on to the ERP)  Dirty Data (requiring some clarification and remediation)  Digital River’s definition of Data Governance:-  A set of processes that treats Data as a Strategic Area within the enterprise 23
  • 24.
    THE DATA MANAGEMENTWHEEL: BINARY VS. TERNARY Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion  In 2008 embraced DM which meant fundamentally changing the organizational structure of Digital River: IT Bus IT Bus DM Binary model: No Data Mgmt IT and Business frictions Ternary model: Data Mgmt No IT and Business frictions DM deployment  The DM is a process “wheel” owned by the Data Stewards  Data Stewards interface with Business and IT Stewards to carry out Data Management activities around remediating the Dirty Data 24
  • 25.
    ENTERPRISE DATA MANAGEMENTMATRIX ORGANIZATION & ACTIVITIES Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion Data Management Data Governance Policies and processes governing the management of the data environment Data Quality People, Processes and Tools involved in enhancing, measuring, and monitoring data quality Master Data Management People, Processes and Tools controlling the body of master data Meta Data Management Centralization of all data definitions, relationships, ownership and identification ERP & Data Warehousing Integrated environment enabling the implementation of all data rules and processes Data Stewardship Organizational resources carrying out and supporting all Data Management activities 25
  • 26.
    SIMPLIFYING PLATFORMS DOINGSIMILAR THINGS Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion E-Com1 E-Com2 - Accounting - Reporting - Billing - Client Management - Tax - Compliance - Accounting - Reporting - Billing - Client Management - Tax - Compliance - Accounting - Reporting - Billing - Client Management - Tax - Compliance  Challenge:  How can we centralize all of our platforms, creating one true source for all Accounting, Reporting, Billing, etc? . . . E-Com8  Business functions spread across each platform  Decentralized structure 26
  • 27.
    SOLUTION: ERP Business Challenge1 Introduction Business Challenge 2 Recommendations Conclusion  Commerce would continue to happen on platforms, and transmit to the ERP system in batches of data  Implement an ERP system, sourced from each of the separate e-commerce platforms E-Com1 E-Com2 E-Com8 SAP - ERP . . . 27
  • 28.
    SOLUTION: ERP SYSTEMFED BY COMMERCE PLATFORM DATA Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion ERP ETL E-Com1 E-Com2 E-Com3 DATA QUALITY ERP ERP Integration Structure (ETL) • Extract • Transform • Load Content (Data Quality Tool) • Quality Rules • Governance • Certification ERP DW BI REPORTING Process (ERP) • Integration • Productivity • Controls Reporting • Accuracy • Flexibility • Scalability Ancillary systems ERP MDM ETL drop zone TSS ® Stage . . . > Commerce occurs on platforms, batches of data transmitted to ERP > DQP RFP: DQP Tool became an integral Technology component of the ERP Implementation 28
  • 29.
    THE DATA QUALITYPROGRAM (DQP): PROCESS COMPONENT Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion Identification Impact assessment Clarification & remediation Monitoring IT Bus. 1. Identification: > Top Data Areas of importance > Top 5 issues/concerns in Data Areas > Provide unfiltered dataset to EDM 2. Impact assessment: > EDM loads dataset to TSS for Profiling > EDM writes up potential Business Rule > EDM sets up a workshop 3. Clarification & remediation > Data Steward attends Business Rules workshop > Data Steward clarifies and sign-off Business Rules > EDM Implement Business Rules 4. Monitoring > EDM builds the Data Quality dashboard > EDM conducts regular Data Quality compliance monitoring > Objective: > Improving the Quality of your Data through a strategic framework and a tactical methodology 29
  • 30.
    DATA QUALITY PROGRAM(DQP FOR ERP): PEOPLE COMPONENT Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion >Roles & responsibilities: >Data Management (DQP Manager, Data Stewards) >Handle the implementation and regular review of their assigned rules (monthly data quality meetings, rules sign off, Data Quality policy enforcement, etc…) >Business Owners: >Own the determination of Business rules. Engage their Data Stewards when an update/new rule is required. >IT SMEs: >Build and maintain the interfaces between data consuming systems and the DQP application Identification Impact assessment Clarification & remediation Monitoring IT Bus. > Objective: > Centralize the management of quality rules for all enterprise data elements 30
  • 31.
    DQP ROLES Business Challenge1 Introduction Business Challenge 2 Recommendations Conclusion 31
  • 32.
    DQP: ERP IMPACTASSESSMENT Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion Attribute Unique Values Min Max Null Dist % Business Rules Platform Id 1 GAT GAT 0 Permissible values are GAT, TLA, or GNT. Nulls are not allowed. When the value is TLA, it must be recoded to TA. Customer Id 37216 742328 2789613 0 Nulls are not allowed. When a value is present, this field is a pass through. Bill To Address Id 39044 4293408 5749721 0 Nulls are not allowed. When a value is present, this field is a pass through. Ship To Address Id 39044 4293408 5749721 0 Nulls are not allowed. When a value is present, this field is a pass through. Site Id 216 bhaute zitvee 0 No Nulls Allowed. Permissible Value set are determined within ERP (location of master list to be determined) Site Owner Id 151 bhaute zitvee 0 No Nulls Allowed. Permissible Value set are determined within ERP (location of master list to be determined) DQP: ERP Clarification & Remediation > DQ Tool Business Rules were recorded in a Business Rule Book > Each rule was approved and signed off by a Business Steward > DQ Workshop Document 32
  • 33.
    DQP: ERP CLARIFICATION& REMEDIATION Business Challenge 1 Introduction Business Challenge 2 Recommendations Conclusion  Where do we implement the Business rules? E-Com1 E-Com2 E-Com3 ERP DATA QUALITY ETL drop zone TSS ® payment_type varchar2 (32 byte) Visa payment_id number (2) 1 pay_method char (2 byte) VS payment_method varchar2 (32 byte) VISA payment_method Visa 1 VS payment_method VISA Impact assessment Identification IT Bus. Clarification & remediation Monitoring . . . Staging Each Business Rule is against a column: > If the Payment method column value is: ‘Visa’ , ‘1’ , ‘VS’ > Then recode the Payment Method column value to ‘VISA’ 33
  • 34.
    DQP: ERP MONITORING BusinessChallenge 1 Introduction Business Challenge 2 Recommendations Conclusion  Measures the level of data quality = rate of compliance with business rules (DQ Tool output)  Data Quality is measured monthly, after updates in Business Rules from previous report  Data Stewards responsible for acting on DQ Dashboard metrics  Over 400+ attributes have business rules fired.  Consistently achieving 15-20% increase in the quality of data as a result of data cleansing 34
  • 35.
    REAL TIME ADDRESSVALIDATION FOR COMMERCE STORES BUSINESS CHALLENGE 2
  • 36.
    THE ON-DEMAND TECHNOLOGYADVANTAGE 36 Who We Are Our Focus Our Passion Experience Innovation An Average Day, We Support: • 1.5+ billion API calls • Serve 60 million pages • Send 3+ million emails • Process 300,000 orders • Create 5 authorizations/sec • Host 6+ terabytes of digital content Industry Leading 99.997% Uptime Managed to < 40% Utilization 7 Triple Redundant Servers Worldwide
  • 37.
    E-COMMERCE TAILORED TOYOUR NEEDS 37 Our partners complement existing systems, address specific technology requirements, and evolve with the market and your growing business over time. Who We Are Our Focus Our Passion Experience Innovation
  • 38.
    API FIRST METHODOLOGY 38 WhoWe Are Our Focus Our Passion Experience Innovation APIs
  • 39.
    CLOUD COMMERCE BILLING& SHIPPING ADDRESS ORDER ERRORS 39 Business Challenge 2 Business Challenge 1 Introduction Recommendations Conclusion  Incorrect Cloud Commerce Billing and Shipping Address Order Errors  Challenges:  Increased Lost / Returned Package costs  Incorrect taxation on orders  Cons:  Increased customer service costs  Unsatisfied customers  Loss of products and sales  Potential for undetected fraud  Many manual work efforts to go around the challenge  Digital River Solution:  Digital River implemented Real-Time Address validation (RTAV). A Data Quality Traffic Monitor/Router and a Data Quality Tool were selected for the RTAV.  Enterprise Software licenses were acquired and Country Postal Templates and Country Postal Subscriptions were subscribed to.  Data Management team was made responsible for the and Data Governance and Data Quality efforts pertain Addresses.  And DQ efforts moved upstream from ERP batch to real-time.
  • 40.
    BUSINESS IMPACT/ BENEFITSAND RETURN ON OBJECTIVE FOR RTAV 40 Business Challenge 2 Business Challenge 1 Introduction Recommendations Conclusion
  • 41.
    DUE DILIGENCE: ADDRESSDATA QUALITY VENDOR REVIEW 41 Business Challenge 2 Business Challenge 1 Introduction Recommendations Conclusion
  • 42.
    LENGTH OF TIMERTAV HAS BEEN IN PLACE/PROGRAM EVALUATION 42 Business Challenge 2 Business Challenge 1 Introduction Recommendations Conclusion DQP: HOW RTAV WORKS
  • 43.
    SCALE OF THERTAV RELEASE PROCESS SOLUTION (ENTERPRISE) 43 Business Challenge 2 Business Challenge 1 Introduction Recommendations Conclusion
  • 44.
    DQP: REAL TIMEADDRESS VALIDATION (RTAV) 44 Business Challenge 2 Business Challenge 1 Introduction Recommendations Conclusion E-Com Platform 3 E-Com Platform 2 E-Com Platform 1 ETL Global Postal Directories DQP Tool ERP System Traffic Router Real Time Cleansing Hourly Batch Cleansing Bad Addresses Bad Addresses Cleansed Addresses Clean Addresses Impact assessment Identification IT Bus. Clarification & remediation Monitoring Business Consumers/Owners IT Owners, Code Owners, Tech. SME’s Data Stewards Countries covered • N.America (2) • W. Europe Bundle (16) • LAM Bundle (1) • APAC Bundle (2 Multi-byte, 1 single byte) Future Expansion • E.Europe expansion • APAC expansion • LAM expansion Data Quality & Traffic Monitoring Service • 3 Data Center red. solution • Load balanced • Code Promotion (Dev, Sys).. • Platform Release Cycle Data Quality & Profiling Discovery Tool • 1 Data Center solution with backup • Load balanced • Code Promotion, Dev, Sys, Int, Prod • ERP Release Cycle
  • 45.
    THE TEAM EVOLUTION:DATA MANAGEMENT AT DIGITAL RIVER (2008-13) 45 Business Challenge 2 Business Challenge 1 Introduction Recommendations Conclusion Vice President Operations Vice President Strategic Technologies Sr. Director EDM Data Steward Data Steward Data Steward Enterprise Data Management Data Governance Steering Committee Vice President Operations Vice President Finance Sr. Director EDM Vice President Strategic Technologies Vice President Strategic Marketing Vice President Tax Vice President Enterprise Systems and Data Management Vice President Enterprise Systems and Data Management CFO Vice President Strategic Technologies Data Steward Manager Data Quality Data Steward Enterprise Data Management Data Governance Steering Committee Vice President Finance Vice President Strategic Technologies Vice President Tax Vice President Internal Systems CFO Vice President Internal Systems Vice President Product Manager Data Quality CIO Vice President Governance & Compliance Sr. Software Engineer Sr. Manager Data Governance, DQ Tool Product Manager Data Steward ERP Enterprise Data Management Data Governance Steering Committee Vice President Finance Vice President Tax Vice President Internal Systems CFO Vice President Internal Systems CIO Vice President Governance & Compliance Vice President Product Vice President Development CMO Sr. Manager Data Governance, DQ Tool Product Manager COO 2008 2010 2013
  • 46.
    OVERALL BENEFITS OFTHE DATA QUALITY PROGRAM 46 Business Challenge 2 Business Challenge 1 Introduction Recommendations Conclusion  Data Quality provides - Single, independent environment manages all business rules that ensures data quality for ERP  DQ Traffic Routing Tool and DQ Tool provides the ability to conduct Real Time Address validation for the Commerce platforms and other batch mode cleansing functionality for the ERP  DQP Tool Advantage: When new e-commerce platforms are integrated to the ERP, existing business rules are reused, minimizing redundant development, and centralized management of Business rules  DQP: A 4-step process that requires People, Process and Technology to support our Data Governance efforts  2010 Pitney Bowes Software survey - 2/3 of organizations (revenues > $1Billion), have Data Governance activities underway (including MDM projects) http://www.information-management.com/newsletters/data_governance_MDM_maturity_ROI-10022164-1.html
  • 47.
    WHAT OTHER CHANGESCOULD POTENTIALLY WORK BETTER? FURTHER RECOMMENDATIONS
  • 48.
    Recommendations PEOPLE, PROCESS, TECHNOLOGY 48 BusinessChallenge 1 Business Challenge 2 Introduction Conclusion >Data Governance need not be invented from scratch: HR Governance Financial Governance Data Governance People HR associates Financial analysts; accountants Data Stewards Process Human Capital Management Finance & Accounting Data Management Technology HR systems Accounting systems (G/L; Tax; Treasury) Data Quality; MDM; MDR systems Functional Programs Skill set mgmt Recruiting Benefits mgmt Compensation framework Contractor mgmt Training Budget & forecasting Treasury Financial reporting Tax Investment Mgmt Data Quality Program MDM Program MDR Program Managed asset Labor force Financial assets & liabilities Data Policies & Regulations HR policies SOX, SAS 70, SEC, IFRS, etc… Privacy laws; HIPAA; SOX; DM Policies; etc… Functional leaders Training Mgr Recruitment Mgr Benefits Mgr Comptroller Tax Mgr Investment Mgr DQP Mgr MDM Mgr MDR Mgr Process owner VP of HR VP of Finance / CFO VP of Data Management / CDO (Chief Data Officer)
  • 49.
    Recommendations NEW ORG. ROLESCHIEF DATA OFFICER/VP OF DATA MGMT. 49 Business Challenge 1 Business Challenge 2 Introduction Conclusion CIO / VP Technology Manager / Director CDO / VP Data Mgmt. Data Governance + IT Governance Focus: Process Mgmt Focus: Data Mgmt  Data Governed as an Independent Asset  Centralized authority: CDO / VP Data Mgmt.  Improved control over compliance and financial risks  Clear accountability for all aspects of data  Cost reductions from uniform DM processes  Data scalable across the enterprise, and over time (growth, acquisitions…)  Data Management no longer dependent on IT strategy  Cannot be governed Independently  Not managed as a Strategic Asset  Conflict of interests between Technology and Data Management  Difficult to enforce Quality rules across the enterprise  High cost and low returns  Data becomes silo-driven (like IT…)  Responsibility without authority
  • 50.
    Recommendations EXPANSION OF THEEDM MATRIX ORGANIZATION 50 Business Challenge 1 Business Challenge 2 Introduction Conclusion * Chief Data Officer (typically reports to CTO, CIO, CEO, CMO, CSO) http://en.wikipedia.org/wiki/Chief_data_officer ** Data Management Area: typically determined using a Data Consumption Matrix (regularly updated) *** Data Stewards can either belong to the EDMO, remain in their respective DMA, or both. CDO* DQ MDR MDM LDM . . . Program Managers Senior DM Executives Data Stewards *** DMA** 1 DMA** 2 DMA** 4 DMA** 3 DM Council/ Steering Committee
  • 51.
    Recommendations DATA GOVERNANCE SCOPEOF CONTROL 51 Business Challenge 1 Business Challenge 2 Introduction Conclusion © Copyright Baseline Consulting Group, 2013. Used with permission from SAS Institute.
  • 52.
    WHAT ARE THELESSONS LEARNED? CONCLUSION
  • 53.
     Data Governanceand the DQP: Managed process oversight to ensure that data-related processes and controls are being followed  Data Governance at Digital River  Is a Strategic and Permanent investment to treat Data as a Strategic Asset  It exists through a functional Enterprise Data Management program  Data Quality Program (DQP)  A 4-step process. Requires People, Process and Technology to support our Data Governance efforts  Reduces Operational costs for order checkout and info. delivery processes  Reduces Risk exposures (financial, regulatory, market and strategic)  Both Require:-  An organizational change to the Ternary model (Business / Data / IT)  A “Data Governor Authority” (e.g. VP of Data Mgmt.) and a dedicated EDM team  Effective use of Data Quality tools (for Profiling, Discovery, Cleansing etc.)  Contrary to many beliefs the Data Quality Tool is NOT a Database  It is a repository of business rules; Rules can be managed and reused. DATA GOVERNANCE AT DIGITAL RIVER 53 Conclusion Business Challenge 1 Business Challenge 2 Recommendations Introduction Impact assessment Identification IT Bus. Clarification & remediation Monitoring
  • 54.
    54 DEEPAK BHASKAR Sr. Manager,Data Governance, Trillium Product Governance and Compliance Digital River, Inc. http://www.linkedin.com/in/dbhaskar1 DB_2008 dbhaskar03 dbhaskar2008

Editor's Notes

  • #2 After conducting an internal Cultural/Social survey, most folks identified that they have purchased something on the internet (software, hardware, travel tickets etc.). Today the processes of purchasing products online is making the leap to purchases via mobile devices (such as smartphones, tablets, smart TV’s etc.)Digital River is in the payment processing business and the markets are going Global and in the Mobile/Social direction today and in the future!I am here to present the Data Governance Practices at Digital River and how we are cleansing the Quality of Data getting into our systems at the source platform with a Data Quality Program (DQP).Bottom line, I’m here to talk about Data Governance and Data Quality programs: Better Outcomes, Worthwhile Change, for any Organization.
  • #4 The Agenda includes:An Introduction to Digital RiverReview of 2 main challengesDigital River faces from a Data Management perspectiveHow the challenges relates to People, Process and Technology. Review key Data Management programs solutions that we’ve put in placeConclusion of Digital Rivers DG best practices
  • #5 With Digital River - 10 years, the past 5.5 years in a Governance role.
  • #6 Who is Digital River? What do we do?At Digital River, we see opportunity around every corner.Our unique combination of global expertise and Innovative technology gives your business the freedom to realize its greatest potentialWe believe in Greater Possibilities. It was founded in 1994 and is headquartered in Minnetonka, Minnesota. It has been publically traded since August 1998 (NASDAQ:DRIV). As a US public company we adhere to SOX and SAS 70 standards. In the Nov 2011 Gartner Magic Quadrant for e-Commerce Digital River was placed in the Challenger’s quadrant. Digital River was also listed in the 2012 Q3 Forrester Wave B2C Commerce Suite as a St­­rong performer.Gartner and Forrester are a think tanks and they review companies annually in various industry segments.Gartner rates vendors upon two criteria: completeness of vision and ability to execute. Digital River’s continues to be recognized in the challengers quadrant. Position in 2011 is better because we are ‘higher’ in the ‘challengers’ quadrant, and fewer competitors are grouped near Digital River in the Magic Quadrant.
  • #7 Here are some Key Metrics of where we’ve achieved:For one we are now Global – We manage over $22 Billion in Annual Online TransactionsThere’s Growing complexity in doing business in global online markets. The Good news is – complexity has always been our friend 38 Patents have been issued that help solve the tricky issues of e-commerce. Something we do extremely well. Companies we work with, really value thisGenerating Revenue in Every Country. And to be successful in Going global, We have to Work localInvest 3 Million hours per year focused on Growing our clients revenueOther stats:We offer 168 display currenciesContinually expanding our global capabilities to support our clients growing global businessesCS answers the phone and email in 15 languagesCustomer care centers in: Manila, Philippines; Kingston, UK; Minnetonka, MN; and Shannon, IrelandCustomer care 24X7Offer more than 40 localized payment methodsWe can transact in 40 currencies, but sites can display in 185 currenciesSites display in more than 30 languages.We have a global footprint with offices in numerous cities around the world
  • #9 Key MetricsUnrivalled global footprint; offices across the U.S. as well as Austria, Brazil, China, England, Germany, Ireland, Japan, Luxembourg, Sweden and Taiwan.Globalocity is the Digital River Annual conference with 500 participants - we bring a wealth of knowledge and true payment expertise to your organization and network opportunities with our client base (Microsoft, SAP, VMware, Citrix, Adobe, EA, Trend Micro)Digital River is Invested in our clients’ Global successIn 2010, 46% of revenue came from overseas. In 2012 we opened an office in India and in 2013 we opened one in Russia. We continue to expand our global footprint in order to meet our client needs of doing business in other countries.
  • #10 Our Mission: (Who we are, What we do, How we plan to do it) We Drive Client Growth Through our Global Commerce ExpertiseWorldwide Commerce – Everything you need to build, manage and grow your business anywhere in the world.Worldwide Marketing – Best in class summer acquisition and retention solutions that maximize your ROI.Worldwide Payments – Stay local or go global with customizable payment services perfect for any size business.Our Vision: (What we aspire to be. Set’s the clarity to where we are, who we are, what we want to do) We set the Standard for Global Commerce Technology and ServicesWhat does this mean:- Global Reach. Global Solutions. Offering Worldwide Commerce Solutions. - We invest 3 million hours/year to ensure your e-commerce successWe use Proven Tools and top Notch talent. Offering Worldwide marketing Solutions. - Our performance marketing solution and experts generate real resultsWe Payments without Borders - Offer 170 currents across virtually every country, give you global reach, a local touch and hire close ratios
  • #12 Digital River partners with leading global brands and SMBs to help them maximize the revenue potential of the Internet.Technology. We offer a cloud-based e-commerce technology solution that serves as the foundational platform of your online business.Marketing. We offer a rich suite of e-marketing services to help you acquire and retain new customers. Payments and Operations. We relieve you of the burden of managing your online business through back-end online operations management services.
  • #13 Driving more value to our customers in our No. 1 priorityCompetencies:Digital River’s competencies include a multi-vendor unified approach for a well managed relationship that meets numerous criteriaWe provide end-to-end Global Cloud-commerce and marketing solutions and offers a range of services that enables its customers to establish an online sales channel. These services include:Design, development, and hosting of online stores and shopping carts; Store merchandising and optimizationOrder managementDenied parties screeningExport controls and managementTax compliance and managementFraud managementDigital product delivery via downloadPhysical product fulfillmentSubscription managementOnline marketing, including email marketingManagement of affiliate programsPaid search programsPayment processing servicesWeb site optimization, analytics, and reportingCD production and Delivery services  The company also provides Marketing services such as:Paid search advertisingSearch engine optimizationAffiliate marketingStore optimizationMulti-variant testingWeb analytics andEmail optimization servicesIn addition, it offers a range of Payment processing services, such as Multiple payment methods Fraud managementTax managementCloud-based billing and Other payment optimization servicesToday, Digital River provides end-to-end Global Cloud-commerce and marketing solutions. The company offers a range of services that enables its customers to establish an online sales channel. We handle a lot of tricky issues in Global e-Commerce for our clients and companies. They like to work with us as a result of that. On this slide we identify some of the approaches taken to simplify complexity
  • #14 SELLING PARTNER FOR LEADING GLOBAL COMPANIES60 Clients identified hereDigital River expanded our Expertise to New market segments:Consumer Electronics (Lenovo, Seagate, Logitech, Western Digital, etc.), Travel (Orbitz, Expedia, travelocity etc.), Games and Entertainment (EA, Wizards of the Coast, Capcom, etc.),E-tail (e-Bay, American Apparel, Euro Florist, etc.),Software (Microsoft, Autodesk, Trend Micro, Nuance, Sonic, VMware, etc.), Education (e-follett, Kaplan, University of Phoenix, etc.) Digital River sells its products and services through Internet and a direct sales force. It serves software, consumer electronics, computer/video game product manufacturers, and online channel partners, who including retailers and affiliates in the United States, Austria, Brazil, China, Germany, Korea, Ireland, Japan, Luxembourg, Mexico, Singapore, Sweden, Taiwan, and the United Kingdom. And expanded our client base - There‘s around 60 brands identified on this slide alone, some of them are big names in the future of technology
  • #15 DG and DQ real time activities are focused on - Payments and Fraud - Fulfillment and Logistics - Security and Compliance
  • #17 Digital River and subsidiaries were founded in 1994We specialized in e-commerce outsourcing. At the heart of this business is - order checkout workflow. Typical e-commerce pages touch - Products/Catalogs/Categories/ - Ship-to/Bill-to Addresses - Payment Types etc.In the Shopping cart - Customer data becomes important. Orders taken are stored in Commerce platform. And that order info eventually flows to a Data Warehouse for reportingThat was in the 90’s, more recently we’ve became Revenue Growth Experts in Global Cloud Commerce.
  • #18 Our Data challenges/issuesOver the years, with globalization of commerce, Digital River acquired numerous smaller companies in the e-commerce space. Some prominent acquisitions are listed here: RegNow (1999), BlueHornet Networks (2004), Element 5 (2004), SWREG (2005), NetGiro System (2007) and LML Payment Systems (2013). Today we have Many commerce platforms. Our Core Business has a focus on Commerce Transaction Processing. Shopping cart order check-out work flow becomes critical (to avoid cart abandonment) However, this includes repetitive events of carts, postal validation, fraud checks, payment processing much of which are/will be served from the cloud(s)With Digital River’s acquisitions, the number of platforms we supported grew. The core business is transaction processing. For one we became Global. There’s a lot of complexity in managing e-Commerce globally. And the volume of transactions going through Digital River grew. And the order checkout workflow has become critical to all these platforms. In 2012 manages over $10 Billon in global online transaction sales for our clients.
  • #19 So lets look at the 1st Challenge and How it relates to Data GovernanceThe challenges are that There are many workflows using similar processes with many terminologiesThe Cons include: - Inefficiencies - Confusion - Inaccuracies - And involve manual work effortsSo the Solution we determined was:- To align all data to single source of truth with the aid of the Data Governance Program. But Data Governance was new to Digital River
  • #20 As is typical to the industry, we acquired and consolidated systems. Many of these platforms have similar and repetitive process, among them; the shopping cart, postal validation, fraud checks, payment processing, taxation, inventory and fulfillment etc. So getting back to our Business Challenge. We had a Decentralized Structure with many platforms. There were similar Business functions spread across each platform. So the challenge was to Create a Centralized True Source, for all of the data consumed by accounting, reporting, billing etc.
  • #21 As is typical to the industry, we acquired and consolidated systems. Many of these platforms have similar and repetitive process, among them; the shopping cart, postal validation, fraud checks, payment processing, taxation, inventory and fulfillment etc. So getting back to our Business Challenge. We had a Decentralized Structure with many platforms. There were similar Business functions spread across each platform. So the challenge was to Create a Centralized True Source, for all of the data consumed by accounting, reporting, billing etc.
  • #22 As is typical to the industry, we acquired and consolidated systems. Many of these platforms have similar and repetitive process, among them; the shopping cart, postal validation, fraud checks, payment processing, taxation, inventory and fulfillment etc. So getting back to our Business Challenge. We had a Decentralized Structure with many platforms. There were similar Business functions spread across each platform. So the challenge was to Create a Centralized True Source, for all of the data consumed by accounting, reporting, billing etc.
  • #23 As is typical to the industry, we acquired and consolidated systems. Many of these platforms have similar and repetitive process, among them; the shopping cart, postal validation, fraud checks, payment processing, taxation, inventory and fulfillment etc. So getting back to our Business Challenge. We had a Decentralized Structure with many platforms. There were similar Business functions spread across each platform. So the challenge was to Create a Centralized True Source, for all of the data consumed by accounting, reporting, billing etc.
  • #24 Business impact/ benefits and return on ERP objectiveIn 2007 an independent consulting firm conducted and presented an ROI study to Executive staff and Board. It became evident that the ERP batch mode cleansing effort was a Business Imperative the organization had to accomplish. The effort would have master and transactional data objects that would be migrated to the ERP. Some of these data objects would be required to be transformed in near real time through interface programs. Integrity was maintained of the data objects by cleansing the records outside of the ERP before load into the ERP. A mechanism would convert raw Order/Transaction, Customer, Client, Vendor, Product and Other data that Digital River collects from the tens of thousands of shopper websites that we host for our clients, to 2 categories. Clean Data and Dirty data. And a Data Quality program would be implemented to remediate the Dirty data. So what is Data Governance at Digital River? We’ve seen DG typically involves common attributes such as: People, Strategy, Assets, Programs, Process, Plan, Procedures, Management, Governing Body, Technology and Decision Making. These Commonalities have characteristics of any Strategic Governance processSo Digital River came up with a definition of Data Governance: A set of processes that treats Data as a Strategic Area within the enterpriseIn mid-2008, full blown Technology request for proposals (RFP’s) were initiated for ETL, Data Quality, ERP and BI. 4 top vendors were selected for each tool. By mid-2008 the RFP winners were identified. Strategy blueprinting was underway and Business, Technology and Data Governance strategy was set in motion.
  • #25 Length of time the ERP batch mode cleansing solution has been in place/program evolutionData cleansing of master/transactional data for the ERP has been in use since 2008Cultural and Organization ChangeHistorically data has fallen between the cracks. Business and Technology folks have predominantly focused on code related functionalities and requirements. This has typically been a Binary modelOne of the challenges was to convert the Digital River Business and IT/Dev. binary working groups by the introduction of a Data Management Wheel . This DM team would help interface between Business and IT/Dev. wheels from a data perspective. But, the volumes of data we deal with, identified that we need to change that. That meant A Fundamental change was needed in how things work . So, with the DM Deployment, a Ternary model is in play. The data Management wheel was owned by Data Stewards, who work with Business &amp; IT Stewards.This DM wheel Required new roles and processes
  • #26 What Data Management function was set up for the ERP implementation?An Enterprise Data Management Team (EDM) was started in Jan of 2008. A Sr. Director for Data Management was hired to manage a team of 3 Data stewards, who were hired to assist with the data cleansing effort. A Data Management Charter was written up along with Data Management, Data Quality policies to provide oversight and controls on management and use of the data in support of the ERP.The idea was that cleansing solutions would eventually move upstream to source data on commerce platforms.It became evident that Data Management was a Process, which involved Stewardship of Programs, Data Governance, Data Quality, Master Data and Meta data To support Data WarehousingData Management was a process supported by programs such as the DQP
  • #27 As is typical to the industry, we acquired and consolidated systems. Many of these platforms have similar and repetitive process, among them; the shopping cart, postal validation, fraud checks, payment processing, taxation, inventory and fulfillment etc. So getting back to our Business Challenge. We had a Decentralized Structure with many platforms. There were similar Business functions spread across each platform. So the challenge was to Create a Centralized True Source, for all of the data consumed by accounting, reporting, billing etc.
  • #28 The solution involved implementing an ERP system which we did with SAPWhere platforms would take the commerce and transmit the data in batches to the ERPBatches of data means the orders and other transactions such as settlement/fulfillment for a period of time
  • #29 Scale of the solution (Enterprise wide)The scale of the ERP solution was Enterprise wide, and took 18 months to complete. For data to be managed as an asset, Data Stewards gathered business rules for terms that were critical to Accounting/Finance/Marketing teams. They would then use the Business rules to enhance, cleanse and remediate the data issues. Commerce would continue to occur on the e-Commerce platforms, and ETL would move it to the ERP in batches. Batches of data means the orders and other transactions such as settlement/fulfillment for a period of time. The decentralized structure of Digital River was to be eventually changed to a Single Source of Truth via the ERP, and the Data Quality Tool becomes an integral part of the effort. The strategy was:ETL would Extract transactions from the platforms, Transform the attributes to a Staging environment and call the Data Quality tool to fire Business Rules to cleanse the data before the Load to ERP.Data Quality would manage the Governance and certification of business rules of attributes and set up cleansed attributes that ETL would load to ERP.ERP provided Integrity of the data and included process controls to ensure productivity.BI Reporting would provide flexibility and scalability for accurate reports to be presented to the various groups at an efficient pace.The Data Quality tool was selected as a result of an RFP process that evaluated 4 industry vendors in the DG, DQP space (and as a reference we used Gartner Magic Quadrant vendors in this space)
  • #30 A simple 4-step Data Quality Program (DQP) was incorporated to support the remediation and cleansing effort that was required around the Dirty Data. Data Stewards were to work with IT and Business Stewards to help clarify Business rules.The 4-step Data Quality program was the Process component, by which, Data Stewards would improve the Quality of the Data through a strategic framework and a tactical methodology using the steps above: - Identification of the issues, - Impact assessment of the issue, - Clarification &amp; Remediation of the issue and finally - Monitoring for future potential issuesThe 4-step Data Quality program also has a People Component with the goal of Centralizing Management of Quality Rules for all Enterprise Data Elements. The greater roles and responsibilities included:Data management (the DG Director, DQ Program Manager, Data Stewards): They handle the implementation and regular review of the assigned rules (data quality meetings, business rules sign offs, Data Quality policy enforcement, monthly dashboards etc.)Business owners (leads in various departments e.g. Accounting, Marketing): They will own the determination of the business rules. Engage their Data Stewards when an update/new rule is requiredIT Subject Matter Experts (technical SME’s due to Digital River’s tribal knowledge culture): Build and maintain the interface between data consuming systems and DQP Tool
  • #31 So who would be responsible for the work? Various stewards were set up to be custodians for the department, Business/Technical area they represented. Business Owners were identified to help set up the business rules and definitions. A Business Rule Book identified the business terms and rules. If business owners couldn’t identify the rules, then technical SME’s would help provide coverage. The following matrix identified the roles typically responsible for various activities in the Data Quality Program.This was the DQP would be supported by a Resource component We needed people in the form of Data Managers/Data Stewards, Business Stewards and IT Stewards (even if they belonged to other Departments)The Resource Component included the Objective to:- - Centralize management of Quality Business RulesTo make this work roles and responsibilities were set up or leveraged from the rest of the organization
  • #33 Number and breadth of Business and Technical communities being served by the solution With the ERP implementation at Digital River, Data Governance became a strategic process by which data was treated as a strategic area within the Enterprise (as is the case with other strategic enterprise processes such as Sales, Finance, HR and Sourcing etc.) Here’s how successes were achieved in deploying Data Governance for ERP:Cultural barriers and a lack of senior-level sponsorship. In 2006, Gartner predicted that less than 10% of organizations will succeed at their first attempts at data governance. This was overcome by getting the Executive leadership and Board of Directors to understand that Data Governance and the Data Quality were necessary for the ERP initiative to be successfulLack of Data Management ownership. The concept of enterprise data governance is new to many organizations and key components of data management are not well established for immediate adoption.An organization structure where a Data management wheel (mentioned on slide 13) was established and managed by Data Stewards.Lack of Data Management knowledge. Data quality (including profiling analysis), master data management and metadata management skills are still hard to find (not the systems knowledge/management, but the underlying programs).A Data Quality Tool was selected as a result of the RFP. Data Stewards were trained to manage the tool and Professional Services contractors brought in during the implementation phase.Fear of required organizational structure changes. Assigning Data Governance responsibility to an independent executive “data governor” (who is NOT IT-dependent) requires significant changes to existing work flows and policies.Hiring a Sr. Director for Data Governance, a Data Quality Manager and Data Stewards helped with overcoming the fear. A Data Governance Steering committee made up of Senior Executives was also set up to help facilitate some of the work direction. Many internal Digital River teams and external Clients benefit from the centralization effort with the ERP, standardization and cleansing of the data. Our Accounting/ Finance/ Marketing month end close activities takes a few days.  Client reports have limited reconciliation requirements (unlike the past). Many now understand the value of Data Governance and the Data Quality programs.The Impact assessment Phase involves Profiling the data using the Data Quality Tool to gather key pieces of informationFrom which Business rules are derived in a Workshop with Bus. StewardsThe Clarification and Remediation applies the business rule within the Data Quality Tool itselfSo lets take a look at an example of this
  • #34 Innovative solutions and Problem solvingTypically, Commerce platforms take orders and we need to load them into ERPWe stage the attribute before loading the information in ERP. But where do we implement the Business rules? The Data Quality Tool is inserted in the process using an ETL drop zone – to manage the ‘Business rule’For Example: you have 3 formats of the payment method coming through to the Staging areaIf the business rule is to recode it to VISA for these formats, then Data Quality Tool does that and sends it back to the staging environment for load to the ERPNow lets look at the Monitoring stepOnce a business rule is identified, ETL transforms records pertaining the column. In the staging environment, the ETL calls DQ to fire the business rule. This would standardize the data for load into the ERP based on a certified business rule. A Data Steward tracks an ERP BatchError Queue on a daily basis. The Data Steward initiates Remediation paths for errors that are non-compliant to business rules.
  • #35 The Monitoring step is about measuring the rate of compliance to a business ruleWe’ve been historically been able to show Data Quality improvement as a metric (as shown here)You see a increase in Data Quality as a result in application of business rules to various ETL Processes for various platformsHence Data Quality for the batches is measurable against the business rules that were signed offAnd Data Stewards are responsible for the monitoringERP Data Quality Reporting and MonitoringData Quality Dashboards for the ERP are gathered regularly: These Dashboard measure the level of data quality which is equal to the rate of compliance with business rules (Data Quality tool output). Data Quality is measured monthly, with updates in Business Rules. These are then compared from previous month’s report to see if there are any adverse trends and changes. Data Stewards are responsible for acting on the DQ Dashboard metrics which may require a re-validation of the business rule with the Business owner/Technical owner OR which may require changing the Business rule to a newly certified Business rule.Overall, on a monthly basis, we track and monitor Data Quality business rules for over 400+ attributes that are required for the ERP. The DQP increases the Data Quality level by approximately 15-20%. Both internal users and external Clients who use the Business Intelligence reports benefit from the Data Quality program. And thanks to the ERP, ETL, BI, the Data Governance and Data Quality efforts, Digital River is now able to close its Accounting/Financial/Marketing books shortly after a Month end, Quarter end or Year end! 
  • #37 SaaS AdvantageChallenge 2: Cloud Commerce Billing &amp; Shipping Address Order ErrorsIn 2010 Digital River was facing transaction challenges as we expanded physical shipments in the US and Globally for our Digital Software/Games and Physical Consumer Electronics segments. Digital River offers an on-demand Software as a Service (SaaS) technology advantage to our clients and customers. These include:Reduced upfront costs of operationsAccelerated technology adoptionRegular and Automatic feature updatesThe choice between remote control or fully manages servicesCommerce platforms SLA’s of 99.997% up time30+ API’s and 300+ integrations PCI level 1 certificationTriple-Redundant global data centers managing platforms operate at 99.997% uptime. Some of the AverageDaily Stats include:20 million client store pages served30 million emails sent as part of marketing campaigns175,000 orders taken5 terabytes of digital content20,000 physical shipments and2 second page loadsDigital River’s solutions are constantly upgraded, tested and maintained to ensure client commerce is always up and running. We operate 24x7x365.Physical fulfillment throughout the world in consumer electronicsDigital River’s worldwide physical fulfillment for the CE segment entails: 65+ warehouse locations5 million+ shipments annuallyReduced costs through automation andContinued Global expansion and Global fulfillment warehouse integrations
  • #38 DG and DQ real time activities are focused on - Payments and Fraud - Fulfillment and Logistics - Security and Compliance
  • #39 Web BrowserDesktopIn ApplicationMobileApp-StoreHosted Services and Subscriptions
  • #40 So with the Real Time Address Validation Challenge, the commerce billing/shipping address were resulting in error/correction challenges.This relates to Data Governance in that, if we don’t get the billing/shipping address correct we get Increased lost packages and incorrect taxation on ordersThe cons:Are Operating costs go upCustomers are not satisfiedThere’s a potential for fraudAnd Manual efforts are required to resolve these.So the Digital River solution was to implement RTAV but for that we had to go through an ROI process to justify the business case
  • #41 Business impact/ benefits and return on RTAV objectiveIn Q4 2009 an ROI study similar to the one above was conducted for the Real Time Address validation (RTAV) effort. We repeated using a 4-block template similar to the one conducted for the ERP DQ tool ROI effort. It summarizes Revenue retention, Shipping cost savings, a 3-5 year ROI analysis (Capital expenses vs. Operational expenses) and other soft benefits. Postal address formats/templates vary by country. If 5-7% of a country’s postal addresses change monthly as a result of People moving, New streets being built, Companies going bankrupt etc., it makes sense to purchase the postal directory regularly; monthly, quarterly, semi-annually, etc. depending on the country. We identified specific countries that were resulting in the most postal challenges for Digital River. US, Canada and Western European countries (Austria, Belgium, Denmark, Finland, France, Germany, Ireland, Italy, Luxembourg, Netherlands, Norway, Portugal, Spain, Sweden, Switzerland and the United Kingdom) were first targeted for Postal Directory subscription purchases.The Digital River executive staff and board reviewed the ROI for pros and cons of getting RTAV in place for our shopper stores and approved Data Management to proceed with a request for proposal (RFP).
  • #42 6 months later, in 2010 Q2, a full blown RFP was initiated and 4 vendors in the Real Time Address Validation and Postal Address subscription space were selected for review using a template similar to the one above. After vendor presentations and internal review, a Vendor score card was used to identify the winning vendor. The RTAV DQ tool procurement process was initiated and enterprise contracts for Product licenses and Country postal directory subscriptions acquired. Hardware was procured and set up in our multi datacenter redundant architecture. Vendor professional services contractors were brought in to assist with the software install and production deployment.
  • #43 Length of time the RTAV solution has been in place/program evolutionThe Goal was to have a single source of truth for all Country Postal Address information. The Data Quality Tool and Postal Directories were the ideal solution we had hoped for in an ideal enterprise license model. The Data Quality Shopper Store Real Time Address Validation Service (RTAV) was initiated at Digital River in Q1 2010. It took a year to deploy to our production environments. It has been successfully used the past 3 years. And the client base using RTAV is expanding.Coming back to the Order Check out workflow at the source platformWe tore up the order checkout process and inserted Data Quality Tool calls for RTAV checksThe Data Quality Tool is integrated into the process to enhance the quality of the data about to be distributed and consumed across internal systemsData Cleansing at the source before consumption into Digital River’s ecosystemJason manages the Postal Directory Updates, Software upgrades to the Servers, Involved in constant monitoring and notification of processing issuesAs the Business lead I manage the - Data Quality Tool Product business relationship - Purchases of any necessary Data Quality Tool software, Country Templates and Country Postal Directories and - Build internal relationships to expand the use of the DQP internally`The checkout workflow starts when a product is place in a shopping cart and an order number gets assigned. At that point the shopper is invoked to supply their Billing/Shipping Address for verification (which is validated against the DQ tool address for the particular country). During the Address validation check with the country postal directories, the DQ tool provides a match level code to flag certain address text lines for further correction. These extend from match code 1 to 6: 0. Exact match: Input data successfully matched to directory1. City/Province or postcode fail: No city/Postcode found/City misspelled2. Street name failure: No street name on input, either misspelled/missing3. House number range failure: Range doesn’t match the postal directory4. Street components failure: Avg. score lower than the acceptable score5. Multiple possible matches to directory: Input data incomplete6. Ambiguous Match: a match exists, but too many corrections are required to make the match viable. e.g. Rural Record Failure. Once addresses have been corrected/ validated, the shopper proceeds to enter their payment information (credit card, wire transfer or other) and complete the order.
  • #44 Scale of the solution (Enterprise wide)The RTAV is set up as a scalable Enterprise service to cover each of our Data Centers and client stores. The RTAV using the DQ Tool corrects a Postal Address when a postal address is sent to it for validation from the shopper store. Site level attributes and settings are used to control which client sites get to use the feature and allow for custom configurations of the shopper store. Our platform developers set up XML-over-HTTP as the protocol to transmit the API calls.Using some axioms, the Real Time Address Validation goal was to build an architecture that would have an average throughput of approximately 100 orders/sec. with an average address validation invocation latency of 10ms at 99.99 percentile per page. Our Performance Engineering team tests have identified that we are at that Service Level Agreement (SLA) for the Platform-RTAV service.The RTAV data quality solution is on a 3 Data Center redundant and failover protected footprint. A release process has been put in place to help sustain new Data Quality tool code development for address parsing and matching and postal directory deployments. The Code releases are regularly scheduled. It allows enough time for Development, System testing, Integration testing, before production deployment. Implementation was against 3 Data Centers. The Data Quality Tool has a Traffic Resource Manager that interfaces with our applicationIt is designed to keep pace with changing workloads, the Director regulates traffic between calling applications and the cleansing and matching servers (multi-threaded, server processes management, stats reporting etc.).It was load balance and set up in Active/Active configuration – this is where our cleansing and matching servers are in ProductionData Quality Tool code deployment process was put in place, in concert with the production commerce platform release process
  • #45 Number and breadth of Business and Technical communities being served by the RTAV solutionEvolution of RTAVThe evolution of the Enterprise Data Management program at Digital River was initially focused to the ERP Batch mode activities (between 2008-09). We used ETL to validate addresses against Country Postal directories in the Data Quality Tool, and passing it back to ETL to load into ERP. We started off with around 18 countriesIn 2010, we engaged to bring Real Time Address validation to our shopper stores. Then we decided to move upstream and do the cleansing in Real-Time on our commerce applications. The commerce platforms make a call directly to Data Quality Tool through Traffic Monitoring Service in a multi-data center redundant solution with a 99.95% availability SLAIn the near future we plan to further expand on the available Country Postal Templates and Country Postal Directories that our Enterprise client stores can validated against
  • #46 Innovative RTAV solutions and Problem solvingRTAV is catering to multiple groups identified the Data Governance Steering committees. We continued to make progress even as corporate org-charts were changing over the years. We leveraged the same DQ Tool for batch mode cleansing and real-time cleansing. In 2012 we acquired the world wide Country  template bundle after we realized it made financial sense to do that rather than continue buy only a few countries postal address templates  as a time. We are going Global with the solution for our clients to benefit from it. We also acquired additional Postal Directory subscriptions for countries in Asia. We will acquire additional Postal Directory subscriptions as the business  need arises.This RTAV service and Data quality solution is capable of managing various language and country combinations that we have to provide Real Time Address Validation coverage against. For some Asian countries we are still working out the details around double byte character Web Storefronts and RTAV formats.By providing Real Time Address Validation to our clients on their multi-lingual shopper stores we have added a highly scalable feature solution. It is a remarkable achievement that we can flag items as having been cleansed in real-time that we do NOT need to cleanse a second time as part of the ERP batch mode cleansing. As our clients expand their Global businesses to new countries, we’ll continue to support the shopper purchases via RTAV subscriptions to postal directories from new countries.Monthly dashboards and reporting have been set up to track clients benefiting from RTAV and the order volumes of addresses cleansed. We are also tracking the number of countries covered by our RTAV solution. In Dec 2012 alone, during our most busy quarter of the year, Digital River had approximately 200,000 orders go through RTAV, against around 20 Country postal directories, where we do a large volume of business, for approximately 20% of our clients.The evolution of the Data Management team, our Data Quality tools used, organizational reporting structure and dashboards created over the years show that we have consistently proved our successes in this topic. Our systematic approach and innovation culture allow us to deliver new Data Governance and Data Quality related capabilities
  • #47 Scale of the solution (Enterprise wide)The RTAV is set up as a scalable Enterprise service to cover each of our Data Centers and client stores. The RTAV using the DQ Tool corrects a Postal Address when a postal address is sent to it for validation from the shopper store. Site level attributes and settings are used to control which client sites get to use the feature and allow for custom configurations of the shopper store. Our platform developers set up XML-over-HTTP as the protocol to transmit the API calls.Using some axioms, the Real Time Address Validation goal was to build an architecture that would have an average throughput of approximately 100 orders/sec. with an average address validation invocation latency of 10ms at 99.99 percentile per page. Our Performance Engineering team tests have identified that we are at that Service Level Agreement (SLA) for the Platform-RTAV service.The RTAV data quality solution is on a 3 Data Center redundant and failover protected footprint. A release process has been put in place to help sustain new Data Quality tool code development for address parsing and matching and postal directory deployments. The Code releases are regularly scheduled. It allows enough time for Development, System testing, Integration testing, before production deployment. Implementation was against 3 Data Centers. The Data Quality Tool has a Traffic Resource Manager that interfaces with our applicationIt is designed to keep pace with changing workloads, the Director regulates traffic between calling applications and the cleansing and matching servers (multi-threaded, server processes management, stats reporting etc.).It was load balance and set up in Active/Active configuration – this is where our cleansing and matching servers are in ProductionData Quality Tool code deployment process was put in place, in concert with the production commerce platform release process
  • #49 Some companies have Data Governance as part of their IT GovernanceHere you see an image from Baseline Consulting (a premier data governance consulting firm). They’ve broken it down to 2 sections Governance and ManagementWith a Tactical approach being taken in the Data Quality end and things get more strategic on the Governance endNotice the scope of control gets larger on the strategic side
  • #50 Some companies have Data Governance as part of their IT GovernanceHere you see an image from Baseline Consulting (a premier data governance consulting firm). They’ve broken it down to 2 sections Governance and ManagementWith a Tactical approach being taken in the Data Quality end and things get more strategic on the Governance endNotice the scope of control gets larger on the strategic side
  • #51 Ownership of such a Data Management team lies with a CDO (e.g Bank of America, Yahoo, Federal Communications Commission etc.)Who works closely with a Data Management Steering committeeProgram managers are identified for the DQP, MDM, MDR, LDM, DRDP etc.EDM Matrix Org. with Program leaders, Data Stewards and Data Management Areas (such as Accounting, MarketForce, Affiliate, BlueHornet, Payments or other)
  • #52 Some companies have Data Governance as part of their IT GovernanceHere you see an image from Baseline Consulting (a premier data governance consulting firm). They’ve broken it down to 2 sections Governance and ManagementWith a Tactical approach being taken in the Data Quality end and things get more strategic on the Governance endNotice the scope of control gets larger on the strategic side
  • #54 Since 2008 the Data Governance, Data Quality programs and the Data Stewardship programs at Digital River have been rolled out and expanded. The Data Governance Steering Committee continues to allow the Data Management operations to operate independently even while being engaged to meet immediate Business needs that typically take multiple years to get in place e.g. the ERP project, RTAV activities. Thus far, the Data Management team has operated on a small footprint; however, as Global commerce expands in our hyper-connected world via Social Media, Cloud, and Mobile, we expect to continue to manage data quality in our enterprise systems via batch cleansing mode or real time cleansing mode. We also expect to be engaged in Big Data cleansing.  As Digital River continues to re-organize and make adjustments to strategy, we expect Data Governance and Data Quality to be part of various Steering committees  that the Executive team is setting up for collaborative engagement across the enterprise. Overall, we continue to treat data as a strategic and valued asset to Digital River even as we adapt to business/technological disruptions in the market, internal cultural changes and corporate re-orgs. These are the reasons for continued DG, DQ, EDM best practices, progress and change at Digital River.