Grab some
coffee and
enjoy the
pre-show
banter
before the
top of the
hour!
Metadata Mastery: A Big Step for BI
Modernization
Eric Kavanagh
CEO, Inside Analysis
Amnon Drori
CEO, Octopai
Dave Wells
Research Director, Eckerson
Group
© Eckerson Group 2018 www.eckerson.com© Eckerson Group 2019© Eckerson Group 2018 www.eckerson.com
From Metadata Muddle to Metadata Magic:
A Big Step for BI Modernization
Dave Wells
dwells@eckerson.com
© Eckerson Group 2018 www.eckerson.com© Eckerson Group 2019
The BI Technology Myth
5
LEGACY
Legacy
Systems
ERP Systems
SaaS
SaaS
Applications
MDM / RDM
ETL
Processing
Dashboards
Reports
Scorecards
OLAP
ETL Database
Analysis
&
Reporting
© Eckerson Group 2018 www.eckerson.com© Eckerson Group 2019
The BI Technology Realities
6
LEGACY
Legacy
Systems
ERP Systems
SaaS
SaaS
Applications
MDM / RDM
ETL
Processing
Dashboards
Reports
Scorecards
OLAP
© Eckerson Group 2018 www.eckerson.com© Eckerson Group 2019
The BI Technology Realities
7
LEGACY
Legacy
Systems
ERP Systems
SaaS
SaaS
Applications
MDM / RDM
ETL
Processing
Dashboards
Reports
Scorecards
OLAP
IBM Datastage
Microsoft SSIS
Informatica Powercenter
Oracle Data Integrator
etc.
Oracle Database
Teradata
Microsoft SQL Server
etc.
IBM Cognos
Tableau
Microsoft Power BI
Microstrategy
etc.
© Eckerson Group 2018 www.eckerson.com© Eckerson Group 2019
The Metadata Muddle
8
IBM Datastage
Microsoft SSIS
Informatica Powercenter
Oracle Data Integrator
etc.
Oracle Database
Teradata
Microsoft SQL Server
etc.
IBM Cognos
Tableau
Microsoft Power BI
Microstrategy
etc.
source schema & definitions
source-to-target mapping
data transformation logic
data lineage
warehouse data inventory
warehouse data definitions
database schema
data constraints
analysis workbooks inventory
business data definitions
business metrics definitions
data lineage
© Eckerson Group 2018 www.eckerson.com© Eckerson Group 2019
The Metadata Muddle Compounded
9
Assume that your organization has:
• 4 data warehouses as a result of mergers & acquisitions
• 3 different ETL tools used across the 4 warehouses
• 2 SQL Server warehouses, 1 Teradata, and 1 Oracle
• Cognos, Business Objects, SSRS, Power BI and Tableau
used in various combinations across the 4 warehouses
How many pockets of disparate metadata do you have?
4 data warehouses
x 3 ETL tools
x 3 database management systems
x 5 reporting and analysis tools
= 180 metadata pockets may exist
© Eckerson Group 2018 www.eckerson.com© Eckerson Group 2019
The Need for BI Modernization
10
Legacy BI Modern BI and Analytics
© Eckerson Group 2018 www.eckerson.com© Eckerson Group 2019
Modernization Projects
11
Migrate to Cloud
Migrate to Self-Service
Update Data
Architecture
© Eckerson Group 2018 www.eckerson.com© Eckerson Group 2019
More (and more complex) Modernization Projects
12
Consolidate Data Warehouses
and Migrate to Cloud
Update Architecture
and Migrate to Cloud
© Eckerson Group 2018 www.eckerson.com© Eckerson Group 2019
Data Knowledge – The #1 Barrier to Modernization
13
METADATA
MUDDLE
© Eckerson Group 2018 www.eckerson.com© Eckerson Group 2019
From Muddle to Magic – What We Need
14
METADATA
MUDDLE
Metadata Automation
• Crawl tools to collect metadata
• Store metadata in one repository
• Index metadata and see connections
• Fast, efficient metadata searching
• Visual mapping of data lineage
• Drill from summary to detail
• Export for external uses
• Inject into data catalogs
www.octopai.com
More companies are looking to modernize:
On-Prem to Cloud: Moving metadata management from On Prem to the Cloud
BI Systems
metadata
www.octopai.com
More companies are looking to modernize:
Migrating Legacy BI systems to Modern BI systems
BI Systems
DB Sources
Marketing
CRM
ERP
Finance
HR
Other Sources
ETL Tools
Informatica
DataStage (IBM)
SSIS (MS)
Others
(Talend, etc’)
OCTOPAI AUTOMATED METADATA MANAGEMENT
Data Warehouse
Oracle
Others
(Hadoop, etc’)
SQL Server(MS)
Teradata
Vertica(Big Data)
Reporting & Analysis
Tools
Cognos (IBM)
BO (SAP)
QlikView
Tableau
OBIEE (Oracle)
Others (Sisense, etc’)
www.octopai.com
SSAS (OLAP),
TABULAR
Complete data lineage to and from reports
Get in touch for a free trial!
amnond@octopai.com
www.octopai.com
Metadata Mastery: A Big Step for BI Modernization

Metadata Mastery: A Big Step for BI Modernization

  • 1.
    Grab some coffee and enjoythe pre-show banter before the top of the hour!
  • 2.
    Metadata Mastery: ABig Step for BI Modernization
  • 3.
    Eric Kavanagh CEO, InsideAnalysis Amnon Drori CEO, Octopai Dave Wells Research Director, Eckerson Group
  • 4.
    © Eckerson Group2018 www.eckerson.com© Eckerson Group 2019© Eckerson Group 2018 www.eckerson.com From Metadata Muddle to Metadata Magic: A Big Step for BI Modernization Dave Wells dwells@eckerson.com
  • 5.
    © Eckerson Group2018 www.eckerson.com© Eckerson Group 2019 The BI Technology Myth 5 LEGACY Legacy Systems ERP Systems SaaS SaaS Applications MDM / RDM ETL Processing Dashboards Reports Scorecards OLAP ETL Database Analysis & Reporting
  • 6.
    © Eckerson Group2018 www.eckerson.com© Eckerson Group 2019 The BI Technology Realities 6 LEGACY Legacy Systems ERP Systems SaaS SaaS Applications MDM / RDM ETL Processing Dashboards Reports Scorecards OLAP
  • 7.
    © Eckerson Group2018 www.eckerson.com© Eckerson Group 2019 The BI Technology Realities 7 LEGACY Legacy Systems ERP Systems SaaS SaaS Applications MDM / RDM ETL Processing Dashboards Reports Scorecards OLAP IBM Datastage Microsoft SSIS Informatica Powercenter Oracle Data Integrator etc. Oracle Database Teradata Microsoft SQL Server etc. IBM Cognos Tableau Microsoft Power BI Microstrategy etc.
  • 8.
    © Eckerson Group2018 www.eckerson.com© Eckerson Group 2019 The Metadata Muddle 8 IBM Datastage Microsoft SSIS Informatica Powercenter Oracle Data Integrator etc. Oracle Database Teradata Microsoft SQL Server etc. IBM Cognos Tableau Microsoft Power BI Microstrategy etc. source schema & definitions source-to-target mapping data transformation logic data lineage warehouse data inventory warehouse data definitions database schema data constraints analysis workbooks inventory business data definitions business metrics definitions data lineage
  • 9.
    © Eckerson Group2018 www.eckerson.com© Eckerson Group 2019 The Metadata Muddle Compounded 9 Assume that your organization has: • 4 data warehouses as a result of mergers & acquisitions • 3 different ETL tools used across the 4 warehouses • 2 SQL Server warehouses, 1 Teradata, and 1 Oracle • Cognos, Business Objects, SSRS, Power BI and Tableau used in various combinations across the 4 warehouses How many pockets of disparate metadata do you have? 4 data warehouses x 3 ETL tools x 3 database management systems x 5 reporting and analysis tools = 180 metadata pockets may exist
  • 10.
    © Eckerson Group2018 www.eckerson.com© Eckerson Group 2019 The Need for BI Modernization 10 Legacy BI Modern BI and Analytics
  • 11.
    © Eckerson Group2018 www.eckerson.com© Eckerson Group 2019 Modernization Projects 11 Migrate to Cloud Migrate to Self-Service Update Data Architecture
  • 12.
    © Eckerson Group2018 www.eckerson.com© Eckerson Group 2019 More (and more complex) Modernization Projects 12 Consolidate Data Warehouses and Migrate to Cloud Update Architecture and Migrate to Cloud
  • 13.
    © Eckerson Group2018 www.eckerson.com© Eckerson Group 2019 Data Knowledge – The #1 Barrier to Modernization 13 METADATA MUDDLE
  • 14.
    © Eckerson Group2018 www.eckerson.com© Eckerson Group 2019 From Muddle to Magic – What We Need 14 METADATA MUDDLE Metadata Automation • Crawl tools to collect metadata • Store metadata in one repository • Index metadata and see connections • Fast, efficient metadata searching • Visual mapping of data lineage • Drill from summary to detail • Export for external uses • Inject into data catalogs
  • 16.
    www.octopai.com More companies arelooking to modernize: On-Prem to Cloud: Moving metadata management from On Prem to the Cloud BI Systems metadata
  • 17.
    www.octopai.com More companies arelooking to modernize: Migrating Legacy BI systems to Modern BI systems BI Systems
  • 18.
    DB Sources Marketing CRM ERP Finance HR Other Sources ETLTools Informatica DataStage (IBM) SSIS (MS) Others (Talend, etc’) OCTOPAI AUTOMATED METADATA MANAGEMENT Data Warehouse Oracle Others (Hadoop, etc’) SQL Server(MS) Teradata Vertica(Big Data) Reporting & Analysis Tools Cognos (IBM) BO (SAP) QlikView Tableau OBIEE (Oracle) Others (Sisense, etc’) www.octopai.com SSAS (OLAP), TABULAR Complete data lineage to and from reports
  • 19.
    Get in touchfor a free trial! amnond@octopai.com www.octopai.com