SlideShare a Scribd company logo
1 of 32
Download to read offline
Jacqueline Bloemen, Senior Analyst Data & Analytics, BARC
The Future of Data Architecture
Has the Data Warehouse Had Its Day?
4
The Future of
Data Architecture:
Has the Data Warehouse
Had Its Day?
Global survey
Wide coverage
of industries…
…and company
sizes
> 250 participants
26%
22%
17%
13%
10%
9%
2%
Industry
Services
Public sector
IT
Banking and finance
Retail / Wholesale / Trade
Other
30%
39%
31%
Less than 500 500 - 4,999 5,000 or more
What challenges do data users in your company face?
5
48%
43%
41%
37%
37%
30%
24%
3%
3%
Business users cannot implement new requirements themselves
Data for analyses must be tediously gathered from various sources
IT cannot react quickly enough to new requirements
Data landscape is difficult to understand
A lack of technical support and data management personnel
Data warehouse/data lake does not cover our requirements
Tools are too technical
Other
No challenges
Is Data Democracy Equal to Self-Service Analytics for Business Users?
Source: BARC Topical Survey „The Future of Data Architecture“ 2022
Data & Analytics Lab
Smart Process Factory Information Factory
CRM
Daten
FI/CO
Daten
SCM
Daten
BI App
ETL
Daten
BI App
Daten
Daten Daten
Daten
Daten
Daten
Daten
Daten
Daten
Daten
Daten
Daten
Reports, dashboards, classic analysis
Embedded & real-time analytics,
decision automation
Data discovery, advanced analytics,
AI/ML
ERP
Daten
...are giving business
users more freedom in
the use of data &
analytics (BIC: 90%)
71%
...are introducing
analytics tools suitable
for business users
(BIC: 90%)
74%
... are introducing data
preparation
tools suitable for
business users
(BIC: 74%)
48%
What challenges do data users in your company face?
7
48%
43%
41%
37%
37%
30%
24%
3%
3%
Business users cannot implement new requirements themselves
Data for analyses must be tediously gathered from various sources
IT cannot react quickly enough to new requirements
Data landscape is difficult to understand
A lack of technical support and data management personnel
Data warehouse/data lake does not cover our requirements
Tools are too technical
Other
No challenges
LoB: 61%
Fragmented Data Landscape – Regardless of the Data Warehouse
Data & Analytics Lab
Smart Process Factory Information Factory
ERP
Daten
CRM
Daten
FI/CO
Daten
SCM
Daten
BI App
ETL
Daten
BI App
Daten
Daten Daten
Daten
Daten
Daten
Daten
Daten
Daten
Daten
Daten
Daten
Reports, dashboards, classic analysis
Embedded & real-time analytics,
decision automation
„Data warehouse /
data lake does not
cover our
requirements“
„Existing data is not
suitable for the
necessary analyses“
Data discovery, advanced analytics,
AI/ML
What challenges do data users in your company face?
9
48%
43%
41%
37%
37%
30%
24%
3%
3%
Business users cannot implement new requirements themselves
Data for analyses must be tediously gathered from various sources
IT cannot react quickly enough to new requirements
Data landscape is difficult to understand
A lack of technical support and data management personnel
Data warehouse/data lake does not cover our requirements
Tools are too technical
Other
No challenges
LoB: 61%
Data & analytics
functional team
Domain-oriented cross-
functional teams
(business, dev, ops)
Challenges for central data & analytics
functional teams:
• Limited scalability
• Limited business domain expertise
10
Customer
Sales
Product
Data
Lake
Data
Warehouse
Analytics
Apps
Data
pipelines
Operational organization
& architecture
Data & analytics organization
& architecture
73%
of managers /
process experts
in business
units
„Business domain
expertise in IT/data &
analytics teams is
insufficient“
70%
of managers /
process experts
in business
units
„Implemented data &
analytics applications
do not cover our
requirements“
Which concepts and technologies will be important for your future data &
analytics landscape?
11
Source: BARC Survey “The Future of Data Architecture”, n=250
„Introduction of a data
catalog and/or metadata
management “ (approaches
to modernizing, n=260)
28%
„Overarching semantic data
layer“ (important concept for
landscape)
17%
How relevant are the following business-related/organizational measures for
your company (top 5)?
12
Source: Source: BARC Survey “The Future of Data Architecture”, n=253
Data Intelligence
Data Mesh
Future of Data Architecture: Can I Build a Data Mesh on my Data Lakehouse?
Data & Analytics Lab
Smart Process Factory Information Factory
Customer
Data
Product
Owner
Sales
Data
Product
Owner
Sales KPIs
Data
Product
Owner
Basic
Consu-
mer
Data
Analyst
Sales KPIs
Customer
Sales Order Sales Dashb.
Data Archive
Data Catalog
Enterprise KPIs Labs/Sandboxes
Data
Foundation
Data Lakehouse
Future of Data Architecture: Can I Build a Data Mesh on my Data Lakehouse?
Data & Analytics Lab
Smart Process Factory Information Factory
Customer
Data
Product
Owner
Sales
Data
Product
Owner
Sales KPIs
Data
Product
Owner
Basic
Consu-
mer
Data
Analyst
Sales KPIs
Customer
Sales Order Sales Dashb.
Data Archive
Data Catalog
Enterprise KPIs Labs/Sandboxes
Data
Foundation
Data Lakehouse
Operational
Analytical Apps
Departmental
Analytical Apps
Legacy
Data Warehouses
IoT Platform
Data Fabric is a concept and architecture principle to better utilize data
independent of usage and deployment type, and regardless of location.
Data & Analytics Lab
Smart Process Factory Information Factory
Data Archive
Data Catalog
Enterprise KPIs Labs/Sandboxes
Data
Foundation
Data Lakehouse
Operational
Analytical Apps
Departmental
Analytical Apps
Legacy
Data Warehouses
IoT Platform
Data Producers & Consumers
LoB
Expert
Technical
Expert
LoB
Expert
Technical
Expert
Different business
domains
Different technical
domains
Breaking Down Data Silos:
Metadata-infused Data Virtualization & Distributed Data Pipelines
From Logical Data Warehouse to Data Fabric
Logical Data Warehouse and Data Fabric are of growing relevance, especially for best-in-class companies
Wrap-up &
Recommendation
16
Consider logical data concepts when shaping the future
of your data landscape:
1. Data Intelligence: Intelligence about data, not from data
2. Data Fabric: Architecture principle to integrate and utilize
disparate, distributed data silos
3. Data Mesh: Applying domain-oriented ownership &
product thinking to data
Let‘s keep in touch!
17
Jacqueline Bloemen
Senior Analyst Data & Analytics
BARC GmbH, Würzburg
jbloemen@barc.de
+49-931-8806510
One-Size Never Fits All: Cloud Vendors
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
25
SQL
Operational EDW
Data Lakes Files
SaaS APIs
REST GraphQL OData
Event
Product
Customer Location Employee
1. Each domain is given a
separate virtual schema.
A common domain may be
useful to centralized data
products common across
domains
2. Domains connect
their data sources
3. Metadata is mapped
to relational views.
No data is replicated
4. Domains can model their
Data Products.
Products can be used to
define other products
5. For execution, Products
can be served directly
from their sources, or
replicated to a central
location, like a lake
7. Products can be access
via SQL, or exposed as an
API. No coding is required
Common Domain Event Management Human Resources
6. A central team can set
guidelines and
governance to ensure
interoperability
8. Infrastructure can easily
scale out in a cluster
26
SQL
Operational EDW
Data Lakes Files
SaaS APIs
REST GraphQL OData
Event
Product
Customer Location Employee
1. Each domain is given a
separate virtualization
server. This gives them
full ownership of the
domain infrastructure
3. A central DV server that uses
domains as sources simplifies
governance and
interoperability (e.g. JOINs and
GraphQL queries across
domains)
Customer Management Event Management Human Resources
2. Data products
can be secured
and directly
exposed as APIs
from each domain
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
▪
Analyst Webinar: The Role of a Logical Architecture in Modern Data and Analytics
Analyst Webinar: The Role of a Logical Architecture in Modern Data and Analytics

More Related Content

Similar to Analyst Webinar: The Role of a Logical Architecture in Modern Data and Analytics

Future of Data Strategy (ASEAN)
Future of Data Strategy (ASEAN)Future of Data Strategy (ASEAN)
Future of Data Strategy (ASEAN)Denodo
 
Accelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and VisualizationAccelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and VisualizationDenodo
 
What is the future of data strategy?
What is the future of data strategy?What is the future of data strategy?
What is the future of data strategy?Denodo
 
Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...
Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...
Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...Denodo
 
How Data Virtualization Puts Enterprise Machine Learning Programs into Produc...
How Data Virtualization Puts Enterprise Machine Learning Programs into Produc...How Data Virtualization Puts Enterprise Machine Learning Programs into Produc...
How Data Virtualization Puts Enterprise Machine Learning Programs into Produc...Denodo
 
A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)Denodo
 
Why Your Data Science Architecture Should Include a Data Virtualization Tool ...
Why Your Data Science Architecture Should Include a Data Virtualization Tool ...Why Your Data Science Architecture Should Include a Data Virtualization Tool ...
Why Your Data Science Architecture Should Include a Data Virtualization Tool ...Denodo
 
How to make your data scientists happy
How to make your data scientists happy How to make your data scientists happy
How to make your data scientists happy Hussain Sultan
 
Webinar: BI Team Backlogged with Information Demands?
Webinar: BI Team Backlogged with Information Demands?Webinar: BI Team Backlogged with Information Demands?
Webinar: BI Team Backlogged with Information Demands?Balanced Insight, Inc.
 
Data-centric design and the knowledge graph
Data-centric design and the knowledge graphData-centric design and the knowledge graph
Data-centric design and the knowledge graphAlan Morrison
 
Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)Nathan Bijnens
 
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)Denodo
 
Unlock Your Data for ML & AI using Data Virtualization
Unlock Your Data for ML & AI using Data VirtualizationUnlock Your Data for ML & AI using Data Virtualization
Unlock Your Data for ML & AI using Data VirtualizationDenodo
 
Quicker Insights and Sustainable Business Agility Powered By Data Virtualizat...
Quicker Insights and Sustainable Business Agility Powered By Data Virtualizat...Quicker Insights and Sustainable Business Agility Powered By Data Virtualizat...
Quicker Insights and Sustainable Business Agility Powered By Data Virtualizat...Denodo
 
final oracle presentation
final oracle presentationfinal oracle presentation
final oracle presentationPriyesh Patel
 
DataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
DataOps - Big Data and AI World London - March 2020 - Harvinder AtwalDataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
DataOps - Big Data and AI World London - March 2020 - Harvinder AtwalHarvinder Atwal
 
Delivering Analytics at The Speed of Transactions with Data Fabric
Delivering Analytics at The Speed of Transactions with Data FabricDelivering Analytics at The Speed of Transactions with Data Fabric
Delivering Analytics at The Speed of Transactions with Data FabricDenodo
 
Big Data Analytics with Microsoft
Big Data Analytics with MicrosoftBig Data Analytics with Microsoft
Big Data Analytics with MicrosoftCaserta
 

Similar to Analyst Webinar: The Role of a Logical Architecture in Modern Data and Analytics (20)

Future of Data Strategy (ASEAN)
Future of Data Strategy (ASEAN)Future of Data Strategy (ASEAN)
Future of Data Strategy (ASEAN)
 
Accelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and VisualizationAccelerate Self-Service Analytics with Data Virtualization and Visualization
Accelerate Self-Service Analytics with Data Virtualization and Visualization
 
What is the future of data strategy?
What is the future of data strategy?What is the future of data strategy?
What is the future of data strategy?
 
Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...
Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...
Accelerating Data-Driven Enterprise Transformation in Banking, Financial Serv...
 
How Data Virtualization Puts Enterprise Machine Learning Programs into Produc...
How Data Virtualization Puts Enterprise Machine Learning Programs into Produc...How Data Virtualization Puts Enterprise Machine Learning Programs into Produc...
How Data Virtualization Puts Enterprise Machine Learning Programs into Produc...
 
A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)A Key to Real-time Insights in a Post-COVID World (ASEAN)
A Key to Real-time Insights in a Post-COVID World (ASEAN)
 
Why Your Data Science Architecture Should Include a Data Virtualization Tool ...
Why Your Data Science Architecture Should Include a Data Virtualization Tool ...Why Your Data Science Architecture Should Include a Data Virtualization Tool ...
Why Your Data Science Architecture Should Include a Data Virtualization Tool ...
 
How to make your data scientists happy
How to make your data scientists happy How to make your data scientists happy
How to make your data scientists happy
 
Just ask Watson Seminar
Just ask Watson SeminarJust ask Watson Seminar
Just ask Watson Seminar
 
Webinar: BI Team Backlogged with Information Demands?
Webinar: BI Team Backlogged with Information Demands?Webinar: BI Team Backlogged with Information Demands?
Webinar: BI Team Backlogged with Information Demands?
 
Bi orientations
Bi orientationsBi orientations
Bi orientations
 
Data-centric design and the knowledge graph
Data-centric design and the knowledge graphData-centric design and the knowledge graph
Data-centric design and the knowledge graph
 
Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)Data Mesh in Azure using Cloud Scale Analytics (WAF)
Data Mesh in Azure using Cloud Scale Analytics (WAF)
 
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
Bridging the Last Mile: Getting Data to the People Who Need It (APAC)
 
Unlock Your Data for ML & AI using Data Virtualization
Unlock Your Data for ML & AI using Data VirtualizationUnlock Your Data for ML & AI using Data Virtualization
Unlock Your Data for ML & AI using Data Virtualization
 
Quicker Insights and Sustainable Business Agility Powered By Data Virtualizat...
Quicker Insights and Sustainable Business Agility Powered By Data Virtualizat...Quicker Insights and Sustainable Business Agility Powered By Data Virtualizat...
Quicker Insights and Sustainable Business Agility Powered By Data Virtualizat...
 
final oracle presentation
final oracle presentationfinal oracle presentation
final oracle presentation
 
DataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
DataOps - Big Data and AI World London - March 2020 - Harvinder AtwalDataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
DataOps - Big Data and AI World London - March 2020 - Harvinder Atwal
 
Delivering Analytics at The Speed of Transactions with Data Fabric
Delivering Analytics at The Speed of Transactions with Data FabricDelivering Analytics at The Speed of Transactions with Data Fabric
Delivering Analytics at The Speed of Transactions with Data Fabric
 
Big Data Analytics with Microsoft
Big Data Analytics with MicrosoftBig Data Analytics with Microsoft
Big Data Analytics with Microsoft
 

More from Denodo

Enterprise Monitoring and Auditing in Denodo
Enterprise Monitoring and Auditing in DenodoEnterprise Monitoring and Auditing in Denodo
Enterprise Monitoring and Auditing in DenodoDenodo
 
Lunch and Learn ANZ: Mastering Cloud Data Cost Control: A FinOps Approach
Lunch and Learn ANZ: Mastering Cloud Data Cost Control: A FinOps ApproachLunch and Learn ANZ: Mastering Cloud Data Cost Control: A FinOps Approach
Lunch and Learn ANZ: Mastering Cloud Data Cost Control: A FinOps ApproachDenodo
 
Achieving Self-Service Analytics with a Governed Data Services Layer
Achieving Self-Service Analytics with a Governed Data Services LayerAchieving Self-Service Analytics with a Governed Data Services Layer
Achieving Self-Service Analytics with a Governed Data Services LayerDenodo
 
What you need to know about Generative AI and Data Management?
What you need to know about Generative AI and Data Management?What you need to know about Generative AI and Data Management?
What you need to know about Generative AI and Data Management?Denodo
 
Mastering Data Compliance in a Dynamic Business Landscape
Mastering Data Compliance in a Dynamic Business LandscapeMastering Data Compliance in a Dynamic Business Landscape
Mastering Data Compliance in a Dynamic Business LandscapeDenodo
 
Denodo Partner Connect: Business Value Demo with Denodo Demo Lite
Denodo Partner Connect: Business Value Demo with Denodo Demo LiteDenodo Partner Connect: Business Value Demo with Denodo Demo Lite
Denodo Partner Connect: Business Value Demo with Denodo Demo LiteDenodo
 
Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...
Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...
Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...Denodo
 
Drive Data Privacy Regulatory Compliance
Drive Data Privacy Regulatory ComplianceDrive Data Privacy Regulatory Compliance
Drive Data Privacy Regulatory ComplianceDenodo
 
Знакомство с виртуализацией данных для профессионалов в области данных
Знакомство с виртуализацией данных для профессионалов в области данныхЗнакомство с виртуализацией данных для профессионалов в области данных
Знакомство с виртуализацией данных для профессионалов в области данныхDenodo
 
Data Democratization: A Secret Sauce to Say Goodbye to Data Fragmentation
Data Democratization: A Secret Sauce to Say Goodbye to Data FragmentationData Democratization: A Secret Sauce to Say Goodbye to Data Fragmentation
Data Democratization: A Secret Sauce to Say Goodbye to Data FragmentationDenodo
 
Denodo Partner Connect - Technical Webinar - Ask Me Anything
Denodo Partner Connect - Technical Webinar - Ask Me AnythingDenodo Partner Connect - Technical Webinar - Ask Me Anything
Denodo Partner Connect - Technical Webinar - Ask Me AnythingDenodo
 
Lunch and Learn ANZ: Key Takeaways for 2023!
Lunch and Learn ANZ: Key Takeaways for 2023!Lunch and Learn ANZ: Key Takeaways for 2023!
Lunch and Learn ANZ: Key Takeaways for 2023!Denodo
 
It’s a Wrap! 2023 – A Groundbreaking Year for AI and The Way Forward
It’s a Wrap! 2023 – A Groundbreaking Year for AI and The Way ForwardIt’s a Wrap! 2023 – A Groundbreaking Year for AI and The Way Forward
It’s a Wrap! 2023 – A Groundbreaking Year for AI and The Way ForwardDenodo
 
Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...
Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...
Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...Denodo
 
Lunch and Learn ANZ: Achieving Self-Service Analytics with a Governed Data Se...
Lunch and Learn ANZ: Achieving Self-Service Analytics with a Governed Data Se...Lunch and Learn ANZ: Achieving Self-Service Analytics with a Governed Data Se...
Lunch and Learn ANZ: Achieving Self-Service Analytics with a Governed Data Se...Denodo
 
How to Build Your Data Marketplace with Data Virtualization?
How to Build Your Data Marketplace with Data Virtualization?How to Build Your Data Marketplace with Data Virtualization?
How to Build Your Data Marketplace with Data Virtualization?Denodo
 
Webinar #2 - Transforming Challenges into Opportunities for Credit Unions
Webinar #2 - Transforming Challenges into Opportunities for Credit UnionsWebinar #2 - Transforming Challenges into Opportunities for Credit Unions
Webinar #2 - Transforming Challenges into Opportunities for Credit UnionsDenodo
 
Enabling Data Catalog users with advanced usability
Enabling Data Catalog users with advanced usabilityEnabling Data Catalog users with advanced usability
Enabling Data Catalog users with advanced usabilityDenodo
 
Denodo Partner Connect: Technical Webinar - Architect Associate Certification...
Denodo Partner Connect: Technical Webinar - Architect Associate Certification...Denodo Partner Connect: Technical Webinar - Architect Associate Certification...
Denodo Partner Connect: Technical Webinar - Architect Associate Certification...Denodo
 
GenAI y el futuro de la gestión de datos: mitos y realidades
GenAI y el futuro de la gestión de datos: mitos y realidadesGenAI y el futuro de la gestión de datos: mitos y realidades
GenAI y el futuro de la gestión de datos: mitos y realidadesDenodo
 

More from Denodo (20)

Enterprise Monitoring and Auditing in Denodo
Enterprise Monitoring and Auditing in DenodoEnterprise Monitoring and Auditing in Denodo
Enterprise Monitoring and Auditing in Denodo
 
Lunch and Learn ANZ: Mastering Cloud Data Cost Control: A FinOps Approach
Lunch and Learn ANZ: Mastering Cloud Data Cost Control: A FinOps ApproachLunch and Learn ANZ: Mastering Cloud Data Cost Control: A FinOps Approach
Lunch and Learn ANZ: Mastering Cloud Data Cost Control: A FinOps Approach
 
Achieving Self-Service Analytics with a Governed Data Services Layer
Achieving Self-Service Analytics with a Governed Data Services LayerAchieving Self-Service Analytics with a Governed Data Services Layer
Achieving Self-Service Analytics with a Governed Data Services Layer
 
What you need to know about Generative AI and Data Management?
What you need to know about Generative AI and Data Management?What you need to know about Generative AI and Data Management?
What you need to know about Generative AI and Data Management?
 
Mastering Data Compliance in a Dynamic Business Landscape
Mastering Data Compliance in a Dynamic Business LandscapeMastering Data Compliance in a Dynamic Business Landscape
Mastering Data Compliance in a Dynamic Business Landscape
 
Denodo Partner Connect: Business Value Demo with Denodo Demo Lite
Denodo Partner Connect: Business Value Demo with Denodo Demo LiteDenodo Partner Connect: Business Value Demo with Denodo Demo Lite
Denodo Partner Connect: Business Value Demo with Denodo Demo Lite
 
Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...
Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...
Expert Panel: Overcoming Challenges with Distributed Data to Maximize Busines...
 
Drive Data Privacy Regulatory Compliance
Drive Data Privacy Regulatory ComplianceDrive Data Privacy Regulatory Compliance
Drive Data Privacy Regulatory Compliance
 
Знакомство с виртуализацией данных для профессионалов в области данных
Знакомство с виртуализацией данных для профессионалов в области данныхЗнакомство с виртуализацией данных для профессионалов в области данных
Знакомство с виртуализацией данных для профессионалов в области данных
 
Data Democratization: A Secret Sauce to Say Goodbye to Data Fragmentation
Data Democratization: A Secret Sauce to Say Goodbye to Data FragmentationData Democratization: A Secret Sauce to Say Goodbye to Data Fragmentation
Data Democratization: A Secret Sauce to Say Goodbye to Data Fragmentation
 
Denodo Partner Connect - Technical Webinar - Ask Me Anything
Denodo Partner Connect - Technical Webinar - Ask Me AnythingDenodo Partner Connect - Technical Webinar - Ask Me Anything
Denodo Partner Connect - Technical Webinar - Ask Me Anything
 
Lunch and Learn ANZ: Key Takeaways for 2023!
Lunch and Learn ANZ: Key Takeaways for 2023!Lunch and Learn ANZ: Key Takeaways for 2023!
Lunch and Learn ANZ: Key Takeaways for 2023!
 
It’s a Wrap! 2023 – A Groundbreaking Year for AI and The Way Forward
It’s a Wrap! 2023 – A Groundbreaking Year for AI and The Way ForwardIt’s a Wrap! 2023 – A Groundbreaking Year for AI and The Way Forward
It’s a Wrap! 2023 – A Groundbreaking Year for AI and The Way Forward
 
Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...
Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...
Quels sont les facteurs-clés de succès pour appliquer au mieux le RGPD à votr...
 
Lunch and Learn ANZ: Achieving Self-Service Analytics with a Governed Data Se...
Lunch and Learn ANZ: Achieving Self-Service Analytics with a Governed Data Se...Lunch and Learn ANZ: Achieving Self-Service Analytics with a Governed Data Se...
Lunch and Learn ANZ: Achieving Self-Service Analytics with a Governed Data Se...
 
How to Build Your Data Marketplace with Data Virtualization?
How to Build Your Data Marketplace with Data Virtualization?How to Build Your Data Marketplace with Data Virtualization?
How to Build Your Data Marketplace with Data Virtualization?
 
Webinar #2 - Transforming Challenges into Opportunities for Credit Unions
Webinar #2 - Transforming Challenges into Opportunities for Credit UnionsWebinar #2 - Transforming Challenges into Opportunities for Credit Unions
Webinar #2 - Transforming Challenges into Opportunities for Credit Unions
 
Enabling Data Catalog users with advanced usability
Enabling Data Catalog users with advanced usabilityEnabling Data Catalog users with advanced usability
Enabling Data Catalog users with advanced usability
 
Denodo Partner Connect: Technical Webinar - Architect Associate Certification...
Denodo Partner Connect: Technical Webinar - Architect Associate Certification...Denodo Partner Connect: Technical Webinar - Architect Associate Certification...
Denodo Partner Connect: Technical Webinar - Architect Associate Certification...
 
GenAI y el futuro de la gestión de datos: mitos y realidades
GenAI y el futuro de la gestión de datos: mitos y realidadesGenAI y el futuro de la gestión de datos: mitos y realidades
GenAI y el futuro de la gestión de datos: mitos y realidades
 

Recently uploaded

VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130Suhani Kapoor
 
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一F La
 
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...soniya singh
 
RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfgstagge
 
Data Science Jobs and Salaries Analysis.pptx
Data Science Jobs and Salaries Analysis.pptxData Science Jobs and Salaries Analysis.pptx
Data Science Jobs and Salaries Analysis.pptxFurkanTasci3
 
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...ThinkInnovation
 
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)jennyeacort
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfJohn Sterrett
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdfHuman37
 
Industrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfIndustrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfLars Albertsson
 
Schema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfSchema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfLars Albertsson
 
Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingNeil Barnes
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDRafezzaman
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptxthyngster
 
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsappssapnasaifi408
 
Call Girls In Mahipalpur O9654467111 Escorts Service
Call Girls In Mahipalpur O9654467111  Escorts ServiceCall Girls In Mahipalpur O9654467111  Escorts Service
Call Girls In Mahipalpur O9654467111 Escorts ServiceSapana Sha
 

Recently uploaded (20)

VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
VIP Call Girls Service Miyapur Hyderabad Call +91-8250192130
 
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
办理(Vancouver毕业证书)加拿大温哥华岛大学毕业证成绩单原版一比一
 
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
High Class Call Girls Noida Sector 39 Aarushi 🔝8264348440🔝 Independent Escort...
 
RadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdfRadioAdProWritingCinderellabyButleri.pdf
RadioAdProWritingCinderellabyButleri.pdf
 
Data Science Jobs and Salaries Analysis.pptx
Data Science Jobs and Salaries Analysis.pptxData Science Jobs and Salaries Analysis.pptx
Data Science Jobs and Salaries Analysis.pptx
 
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
Predictive Analysis - Using Insight-informed Data to Determine Factors Drivin...
 
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
Call Us ➥97111√47426🤳Call Girls in Aerocity (Delhi NCR)
 
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
꧁❤ Aerocity Call Girls Service Aerocity Delhi ❤꧂ 9999965857 ☎️ Hard And Sexy ...
 
DBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdfDBA Basics: Getting Started with Performance Tuning.pdf
DBA Basics: Getting Started with Performance Tuning.pdf
 
Decoding Loan Approval: Predictive Modeling in Action
Decoding Loan Approval: Predictive Modeling in ActionDecoding Loan Approval: Predictive Modeling in Action
Decoding Loan Approval: Predictive Modeling in Action
 
20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf20240419 - Measurecamp Amsterdam - SAM.pdf
20240419 - Measurecamp Amsterdam - SAM.pdf
 
E-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptxE-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptx
 
Industrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdfIndustrialised data - the key to AI success.pdf
Industrialised data - the key to AI success.pdf
 
Call Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort ServiceCall Girls in Saket 99530🔝 56974 Escort Service
Call Girls in Saket 99530🔝 56974 Escort Service
 
Schema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdfSchema on read is obsolete. Welcome metaprogramming..pdf
Schema on read is obsolete. Welcome metaprogramming..pdf
 
Brighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data StorytellingBrighton SEO | April 2024 | Data Storytelling
Brighton SEO | April 2024 | Data Storytelling
 
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTDINTERNSHIP ON PURBASHA COMPOSITE TEX LTD
INTERNSHIP ON PURBASHA COMPOSITE TEX LTD
 
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptxEMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM  TRACKING WITH GOOGLE ANALYTICS.pptx
EMERCE - 2024 - AMSTERDAM - CROSS-PLATFORM TRACKING WITH GOOGLE ANALYTICS.pptx
 
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
 
Call Girls In Mahipalpur O9654467111 Escorts Service
Call Girls In Mahipalpur O9654467111  Escorts ServiceCall Girls In Mahipalpur O9654467111  Escorts Service
Call Girls In Mahipalpur O9654467111 Escorts Service
 

Analyst Webinar: The Role of a Logical Architecture in Modern Data and Analytics

  • 1.
  • 2.
  • 3. Jacqueline Bloemen, Senior Analyst Data & Analytics, BARC The Future of Data Architecture Has the Data Warehouse Had Its Day?
  • 4. 4 The Future of Data Architecture: Has the Data Warehouse Had Its Day? Global survey Wide coverage of industries… …and company sizes > 250 participants 26% 22% 17% 13% 10% 9% 2% Industry Services Public sector IT Banking and finance Retail / Wholesale / Trade Other 30% 39% 31% Less than 500 500 - 4,999 5,000 or more
  • 5. What challenges do data users in your company face? 5 48% 43% 41% 37% 37% 30% 24% 3% 3% Business users cannot implement new requirements themselves Data for analyses must be tediously gathered from various sources IT cannot react quickly enough to new requirements Data landscape is difficult to understand A lack of technical support and data management personnel Data warehouse/data lake does not cover our requirements Tools are too technical Other No challenges
  • 6. Is Data Democracy Equal to Self-Service Analytics for Business Users? Source: BARC Topical Survey „The Future of Data Architecture“ 2022 Data & Analytics Lab Smart Process Factory Information Factory CRM Daten FI/CO Daten SCM Daten BI App ETL Daten BI App Daten Daten Daten Daten Daten Daten Daten Daten Daten Daten Daten Daten Reports, dashboards, classic analysis Embedded & real-time analytics, decision automation Data discovery, advanced analytics, AI/ML ERP Daten ...are giving business users more freedom in the use of data & analytics (BIC: 90%) 71% ...are introducing analytics tools suitable for business users (BIC: 90%) 74% ... are introducing data preparation tools suitable for business users (BIC: 74%) 48%
  • 7. What challenges do data users in your company face? 7 48% 43% 41% 37% 37% 30% 24% 3% 3% Business users cannot implement new requirements themselves Data for analyses must be tediously gathered from various sources IT cannot react quickly enough to new requirements Data landscape is difficult to understand A lack of technical support and data management personnel Data warehouse/data lake does not cover our requirements Tools are too technical Other No challenges LoB: 61%
  • 8. Fragmented Data Landscape – Regardless of the Data Warehouse Data & Analytics Lab Smart Process Factory Information Factory ERP Daten CRM Daten FI/CO Daten SCM Daten BI App ETL Daten BI App Daten Daten Daten Daten Daten Daten Daten Daten Daten Daten Daten Daten Reports, dashboards, classic analysis Embedded & real-time analytics, decision automation „Data warehouse / data lake does not cover our requirements“ „Existing data is not suitable for the necessary analyses“ Data discovery, advanced analytics, AI/ML
  • 9. What challenges do data users in your company face? 9 48% 43% 41% 37% 37% 30% 24% 3% 3% Business users cannot implement new requirements themselves Data for analyses must be tediously gathered from various sources IT cannot react quickly enough to new requirements Data landscape is difficult to understand A lack of technical support and data management personnel Data warehouse/data lake does not cover our requirements Tools are too technical Other No challenges LoB: 61%
  • 10. Data & analytics functional team Domain-oriented cross- functional teams (business, dev, ops) Challenges for central data & analytics functional teams: • Limited scalability • Limited business domain expertise 10 Customer Sales Product Data Lake Data Warehouse Analytics Apps Data pipelines Operational organization & architecture Data & analytics organization & architecture 73% of managers / process experts in business units „Business domain expertise in IT/data & analytics teams is insufficient“ 70% of managers / process experts in business units „Implemented data & analytics applications do not cover our requirements“
  • 11. Which concepts and technologies will be important for your future data & analytics landscape? 11 Source: BARC Survey “The Future of Data Architecture”, n=250 „Introduction of a data catalog and/or metadata management “ (approaches to modernizing, n=260) 28% „Overarching semantic data layer“ (important concept for landscape) 17%
  • 12. How relevant are the following business-related/organizational measures for your company (top 5)? 12 Source: Source: BARC Survey “The Future of Data Architecture”, n=253 Data Intelligence Data Mesh
  • 13. Future of Data Architecture: Can I Build a Data Mesh on my Data Lakehouse? Data & Analytics Lab Smart Process Factory Information Factory Customer Data Product Owner Sales Data Product Owner Sales KPIs Data Product Owner Basic Consu- mer Data Analyst Sales KPIs Customer Sales Order Sales Dashb. Data Archive Data Catalog Enterprise KPIs Labs/Sandboxes Data Foundation Data Lakehouse
  • 14. Future of Data Architecture: Can I Build a Data Mesh on my Data Lakehouse? Data & Analytics Lab Smart Process Factory Information Factory Customer Data Product Owner Sales Data Product Owner Sales KPIs Data Product Owner Basic Consu- mer Data Analyst Sales KPIs Customer Sales Order Sales Dashb. Data Archive Data Catalog Enterprise KPIs Labs/Sandboxes Data Foundation Data Lakehouse Operational Analytical Apps Departmental Analytical Apps Legacy Data Warehouses IoT Platform
  • 15. Data Fabric is a concept and architecture principle to better utilize data independent of usage and deployment type, and regardless of location. Data & Analytics Lab Smart Process Factory Information Factory Data Archive Data Catalog Enterprise KPIs Labs/Sandboxes Data Foundation Data Lakehouse Operational Analytical Apps Departmental Analytical Apps Legacy Data Warehouses IoT Platform Data Producers & Consumers LoB Expert Technical Expert LoB Expert Technical Expert Different business domains Different technical domains Breaking Down Data Silos: Metadata-infused Data Virtualization & Distributed Data Pipelines From Logical Data Warehouse to Data Fabric Logical Data Warehouse and Data Fabric are of growing relevance, especially for best-in-class companies
  • 16. Wrap-up & Recommendation 16 Consider logical data concepts when shaping the future of your data landscape: 1. Data Intelligence: Intelligence about data, not from data 2. Data Fabric: Architecture principle to integrate and utilize disparate, distributed data silos 3. Data Mesh: Applying domain-oriented ownership & product thinking to data
  • 17. Let‘s keep in touch! 17 Jacqueline Bloemen Senior Analyst Data & Analytics BARC GmbH, Würzburg jbloemen@barc.de +49-931-8806510
  • 18.
  • 19.
  • 20.
  • 21. One-Size Never Fits All: Cloud Vendors ▪ ▪ ▪
  • 23.
  • 25. 25 SQL Operational EDW Data Lakes Files SaaS APIs REST GraphQL OData Event Product Customer Location Employee 1. Each domain is given a separate virtual schema. A common domain may be useful to centralized data products common across domains 2. Domains connect their data sources 3. Metadata is mapped to relational views. No data is replicated 4. Domains can model their Data Products. Products can be used to define other products 5. For execution, Products can be served directly from their sources, or replicated to a central location, like a lake 7. Products can be access via SQL, or exposed as an API. No coding is required Common Domain Event Management Human Resources 6. A central team can set guidelines and governance to ensure interoperability 8. Infrastructure can easily scale out in a cluster
  • 26. 26 SQL Operational EDW Data Lakes Files SaaS APIs REST GraphQL OData Event Product Customer Location Employee 1. Each domain is given a separate virtualization server. This gives them full ownership of the domain infrastructure 3. A central DV server that uses domains as sources simplifies governance and interoperability (e.g. JOINs and GraphQL queries across domains) Customer Management Event Management Human Resources 2. Data products can be secured and directly exposed as APIs from each domain