Data Virtualization to Survive a Multi and
Hybrid Cloud World
Mitesh Shah
Senior Cloud Product Manager , Denodo
Agenda
1. Hybrid & Multi-Cloud Challenges/Drivers
2. Data Virtualization & Cloud Architecture
3. Hybrid/Multi-Cloud Use Cases and Trends
4. Key Takeaways
4
Motivation for Hybrid, Multi-Cloud deployments
46.23%
33.67%
32.66%
31.66%
2.51%
0.00%
5.00%
10.00%
15.00%
20.00%
25.00%
30.00%
35.00%
40.00%
45.00%
50.00%
Cloud deployment model
Responses
https://www.denodo.com/en/document/whitepaper/denodo-global-cloud-survey-2019
5
What’s driving Cloud consumption …. Top Use Cases on AWS & Azure
0.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
Top Use Cases on AWS
Responses0.00%
10.00%
20.00%
30.00%
40.00%
50.00%
60.00%
Top Use Cases on Azure
Responses
6
Denodo Data Virtualization & Hybrid + Multi-Cloud ecosystem
Two Ways to look at it:
1- Where does Data Virtualization (DV) fit in your
Cloud journey
a) Simplifying - Migration to the Cloud journey
b) Alleviating - Data Sprawl and API ecosystem
c) Advantage DV with key use cases in the Cloud
2- Key decision making factors in the Cloud and
how Denodo DV can help
a) Architecture and Performance in the Cloud
b) Security & Governance using DV
c) DevOps /Deployment Automation (Containerization)
IT: Flexible Source Architecture
Business:
Flexible Tool
Choice
IT can now
move at
slower
speed w/o
affecting
business
Business can
now make
faster & more
sophisticated
decisions as
all data
accessible by
any tool of
choice
Data Driven Agile Architecture using Data Virtualization
(Connect + Combine + Publish)
8
Hybrid Data Fabric – Migration to Cloud
Scenario where the Hybrid Data
Hub is useful is during migration
periods
• Databases and applications can
be gradually migrated to the
cloud
• The DV layer absorbs the
changes
• Migration is transparent for end
users
Active
Directory
Data CenterCloud
Data Everywhere - Cloud Native, Hybrid, Multi-Cloud & More
Type Of
Data
Sample Being used for
Machine
generated
data
• Clickstream web server logs
• IVR logs, App Server logs
• DBMS logs
• On-line behaviour analysis
• Cyber security
• Consumer IoT (Sensor data)
• Industrial IoT (Sensor data)
• Location, temperature,
movement, vibration, pressure
• Product usage behaviour
• Product or equipment performance
Human
generated
data
• Social network data
• Inbound email
• Competitor news feeds
• Documents
• Voice interaction data
• Unstructured text , sentiment analysis
Traditional
structured
data
• Master data
• Transaction data
• Customer, product, employee, supplier,
site,…..
• Orders, shipments, returns, payments,
adjustments..
External data • Open government data
• Weather data
• Structured data
• Semi-structured data e.g., JSON, XML, AVRO,
• Sales impact, distribution impact
Data Virtualization in the API Ecosystem
Data virtualization platforms like Denodo
can play a significant role in an API
ecosystem.
Let’s review three common architectures:
1. Data Virtualization as a Data Service
provider
2. Data Virtualization as an abstraction
data layer for Microservices
3. Data Virtualization as an API
Management tool
10
11
Top trending use cases in the cloud
Trending Use Case Description / How does DV fits into
ML & AI & Data Science
• Think AI to improve customer engagement via powered chatbots and such.
• Data involved in AI apps is unstructured (docs, social media etc).
• Ability to connect, relate and simplify using the agile DV architecture
Data Governance/Security
• Questions: Where to govern data? and is the Data Lake a playground, an
What tools are available, or will we develop our own?
• How do you protect intellectual property when working with third parties or
across the global regions?
• DV’s role in terms of abstraction, masking, secure access is growing and
evolving day by day.
Virtual Data Lakes
• Role= Complementary: Data (warehouse, Mart, Repository, Reservoir, Lake
• Virtualize to minimize complexity of data type, access, management,
security using single DV layer
Blockchain
• Supply chain management, healthcare (patient data silos can be organized
to record in a ledger as transaction to provide central access), Financial
(asset tokenization such that investment data is accessible to retail
investors
IOT analytics and Edge
Computing
• Imagine scenarios where speed and fast data is key, from asset
management, critical power issues, process optimization, predictive
analytics to the real-time needs of supply chain management in a hyper-
connected world, the list is endless.
12
Denodo’s multi-location architecture- why it’s important?
Amazon RDS,
Aurora
US East
Availability
Zone
EMEA
Availability
Zone
On-prem
data center
13
Denodo’s Security Architecture, Governance & Hybrid Cloud Use Cases
• Use Case 1: Single
source of truth to avoid
data inconsistencies.
• Use Case 2: Unified
Security layer with
centralized authorization
management and
auditing
• Use Case 3: Data Catalog
/Marketplace
Denodo as a Unified Security layer at Asurion
Use Case 2 – Unified Security Layer in a Hybrid Cloud/on-prem deployment
Use Cases for Data Virtualization in Data Governance and Security
15
• Use Case 1: Single Source
of Truth to avoid data
inconsistencies, etc.
• Use Case 2: Unified
Security layer with
centralized authorization
management and auditing
• Use Case 3: Data
Catalog/Marketplace
– Single source of truth at CIT (to comply with stringent Basel III risk management regulations)
16
How Denodo Complement’s Logical Data Lake in Cloud
Denodo Architecture for Logical Data Lake
● Denodo does not substitute data
warehouses, data lakes, ETLs...
● Denodo enables the use of all
together plus other data sources
○ In a logical data warehouse
○ In a logical data lake
○ They are very similar, the only
difference is in the main
objective
● There are also use cases where
Denodo can be used as data
source in a ETL flow
17
Denodo – Docker – Kubernetes - Containerization
Agile DevOps
• What is ? Containerization is the mechanism of packaging the software binaries and libraries in a
light weight container (which runs as a process) on the operating system(windows/linux).
• Is it same as VM? No, VM (virtual machine) is an OS, that comes with software(hypervisor), which
imitates dedicated hardware. One can run a container image on a physical machine or a VM
environment
• Why are they important to Cloud ? We should care about container support as Cloud is about
portability, scalability and automation, which is what containers make it easy to accomplish.
Top 3 benefits:
1. Facilitates Dev/Ops automation in CI/CD environment.
2. Supported with AWS /Azure container service or microservices architecture
3. Portability can help with multi-cloud migration, scaling and more.
Business Need Solution Benefits
Global Computer Accessory Provider Successfully
Achieves Cloud Modernization with Denodo in the Cloud
Case Study
• Needed to transition to cloud to increase
performance via a more reliable, efficient,
and cost-effective data analytics
• Performance and time/speed-to-delivery
issues needed to be addressed; data
warehouse could no longer be extended
• Security requirements across multiple
analytical tools needed to be centralized
• Efficiency and reliability – Transition to the
cloud has been embraced as a model for
innovation and agility
• Consistent security – Synchronized
security across multiple analytical tools
• Agility – Rapid prototyping of new data
sources with proper governance structure
• Denodo forms consistent business layer in
the cloud (AWS) and prevents direct access
to the data sources
• Denodo integrates data across Redshift,
other cloud and on-prem sources, and feeds
Tableau, Pentaho BA, etc.
• Serves as central security layer to ensure
secure access across multiple analytical
tools
This Swiss global provider of personal computer and tablet accessories has its
headquarters in Switzerland and California. The company develops and markets
peripheral devices for PCs, including keyboards, mice, trackballs, microphones, etc.
In 2015, the company reported a revenue of $2 billion with its 9,000 employees.
19
Cloud is Important and so is how you apply DV in Cloud …
• Hybrid Cloud and Multi-Cloud account for more than
50% of the use cases in the Cloud
• Proliferation of Data silos, new applications have made it
important to under understand Cloud Architecture and
• Data Virtualization can be used in innovative ways to
save cost and time when most needed
• Try out Denodo Test Drives and/or Free Trials in the
Cloud
• https://www.denodo.com/en/denodo-platform/test-drives
• https://www.denodo.com/en/denodo-platform/free-trials
© Copyright Denodo Technologies. All rights reserved
Unless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm, without prior the written
authorization from Denodo Technologies.

Data Virtualization to Survive a Multi and Hybrid Cloud World

  • 2.
    Data Virtualization toSurvive a Multi and Hybrid Cloud World Mitesh Shah Senior Cloud Product Manager , Denodo
  • 3.
    Agenda 1. Hybrid &Multi-Cloud Challenges/Drivers 2. Data Virtualization & Cloud Architecture 3. Hybrid/Multi-Cloud Use Cases and Trends 4. Key Takeaways
  • 4.
    4 Motivation for Hybrid,Multi-Cloud deployments 46.23% 33.67% 32.66% 31.66% 2.51% 0.00% 5.00% 10.00% 15.00% 20.00% 25.00% 30.00% 35.00% 40.00% 45.00% 50.00% Cloud deployment model Responses https://www.denodo.com/en/document/whitepaper/denodo-global-cloud-survey-2019
  • 5.
    5 What’s driving Cloudconsumption …. Top Use Cases on AWS & Azure 0.00% 10.00% 20.00% 30.00% 40.00% 50.00% 60.00% Top Use Cases on AWS Responses0.00% 10.00% 20.00% 30.00% 40.00% 50.00% 60.00% Top Use Cases on Azure Responses
  • 6.
    6 Denodo Data Virtualization& Hybrid + Multi-Cloud ecosystem Two Ways to look at it: 1- Where does Data Virtualization (DV) fit in your Cloud journey a) Simplifying - Migration to the Cloud journey b) Alleviating - Data Sprawl and API ecosystem c) Advantage DV with key use cases in the Cloud 2- Key decision making factors in the Cloud and how Denodo DV can help a) Architecture and Performance in the Cloud b) Security & Governance using DV c) DevOps /Deployment Automation (Containerization)
  • 7.
    IT: Flexible SourceArchitecture Business: Flexible Tool Choice IT can now move at slower speed w/o affecting business Business can now make faster & more sophisticated decisions as all data accessible by any tool of choice Data Driven Agile Architecture using Data Virtualization (Connect + Combine + Publish)
  • 8.
    8 Hybrid Data Fabric– Migration to Cloud Scenario where the Hybrid Data Hub is useful is during migration periods • Databases and applications can be gradually migrated to the cloud • The DV layer absorbs the changes • Migration is transparent for end users Active Directory Data CenterCloud
  • 9.
    Data Everywhere -Cloud Native, Hybrid, Multi-Cloud & More Type Of Data Sample Being used for Machine generated data • Clickstream web server logs • IVR logs, App Server logs • DBMS logs • On-line behaviour analysis • Cyber security • Consumer IoT (Sensor data) • Industrial IoT (Sensor data) • Location, temperature, movement, vibration, pressure • Product usage behaviour • Product or equipment performance Human generated data • Social network data • Inbound email • Competitor news feeds • Documents • Voice interaction data • Unstructured text , sentiment analysis Traditional structured data • Master data • Transaction data • Customer, product, employee, supplier, site,….. • Orders, shipments, returns, payments, adjustments.. External data • Open government data • Weather data • Structured data • Semi-structured data e.g., JSON, XML, AVRO, • Sales impact, distribution impact
  • 10.
    Data Virtualization inthe API Ecosystem Data virtualization platforms like Denodo can play a significant role in an API ecosystem. Let’s review three common architectures: 1. Data Virtualization as a Data Service provider 2. Data Virtualization as an abstraction data layer for Microservices 3. Data Virtualization as an API Management tool 10
  • 11.
    11 Top trending usecases in the cloud Trending Use Case Description / How does DV fits into ML & AI & Data Science • Think AI to improve customer engagement via powered chatbots and such. • Data involved in AI apps is unstructured (docs, social media etc). • Ability to connect, relate and simplify using the agile DV architecture Data Governance/Security • Questions: Where to govern data? and is the Data Lake a playground, an What tools are available, or will we develop our own? • How do you protect intellectual property when working with third parties or across the global regions? • DV’s role in terms of abstraction, masking, secure access is growing and evolving day by day. Virtual Data Lakes • Role= Complementary: Data (warehouse, Mart, Repository, Reservoir, Lake • Virtualize to minimize complexity of data type, access, management, security using single DV layer Blockchain • Supply chain management, healthcare (patient data silos can be organized to record in a ledger as transaction to provide central access), Financial (asset tokenization such that investment data is accessible to retail investors IOT analytics and Edge Computing • Imagine scenarios where speed and fast data is key, from asset management, critical power issues, process optimization, predictive analytics to the real-time needs of supply chain management in a hyper- connected world, the list is endless.
  • 12.
    12 Denodo’s multi-location architecture-why it’s important? Amazon RDS, Aurora US East Availability Zone EMEA Availability Zone On-prem data center
  • 13.
    13 Denodo’s Security Architecture,Governance & Hybrid Cloud Use Cases • Use Case 1: Single source of truth to avoid data inconsistencies. • Use Case 2: Unified Security layer with centralized authorization management and auditing • Use Case 3: Data Catalog /Marketplace
  • 14.
    Denodo as aUnified Security layer at Asurion Use Case 2 – Unified Security Layer in a Hybrid Cloud/on-prem deployment
  • 15.
    Use Cases forData Virtualization in Data Governance and Security 15 • Use Case 1: Single Source of Truth to avoid data inconsistencies, etc. • Use Case 2: Unified Security layer with centralized authorization management and auditing • Use Case 3: Data Catalog/Marketplace – Single source of truth at CIT (to comply with stringent Basel III risk management regulations)
  • 16.
    16 How Denodo Complement’sLogical Data Lake in Cloud Denodo Architecture for Logical Data Lake ● Denodo does not substitute data warehouses, data lakes, ETLs... ● Denodo enables the use of all together plus other data sources ○ In a logical data warehouse ○ In a logical data lake ○ They are very similar, the only difference is in the main objective ● There are also use cases where Denodo can be used as data source in a ETL flow
  • 17.
    17 Denodo – Docker– Kubernetes - Containerization Agile DevOps • What is ? Containerization is the mechanism of packaging the software binaries and libraries in a light weight container (which runs as a process) on the operating system(windows/linux). • Is it same as VM? No, VM (virtual machine) is an OS, that comes with software(hypervisor), which imitates dedicated hardware. One can run a container image on a physical machine or a VM environment • Why are they important to Cloud ? We should care about container support as Cloud is about portability, scalability and automation, which is what containers make it easy to accomplish. Top 3 benefits: 1. Facilitates Dev/Ops automation in CI/CD environment. 2. Supported with AWS /Azure container service or microservices architecture 3. Portability can help with multi-cloud migration, scaling and more.
  • 18.
    Business Need SolutionBenefits Global Computer Accessory Provider Successfully Achieves Cloud Modernization with Denodo in the Cloud Case Study • Needed to transition to cloud to increase performance via a more reliable, efficient, and cost-effective data analytics • Performance and time/speed-to-delivery issues needed to be addressed; data warehouse could no longer be extended • Security requirements across multiple analytical tools needed to be centralized • Efficiency and reliability – Transition to the cloud has been embraced as a model for innovation and agility • Consistent security – Synchronized security across multiple analytical tools • Agility – Rapid prototyping of new data sources with proper governance structure • Denodo forms consistent business layer in the cloud (AWS) and prevents direct access to the data sources • Denodo integrates data across Redshift, other cloud and on-prem sources, and feeds Tableau, Pentaho BA, etc. • Serves as central security layer to ensure secure access across multiple analytical tools This Swiss global provider of personal computer and tablet accessories has its headquarters in Switzerland and California. The company develops and markets peripheral devices for PCs, including keyboards, mice, trackballs, microphones, etc. In 2015, the company reported a revenue of $2 billion with its 9,000 employees.
  • 19.
    19 Cloud is Importantand so is how you apply DV in Cloud … • Hybrid Cloud and Multi-Cloud account for more than 50% of the use cases in the Cloud • Proliferation of Data silos, new applications have made it important to under understand Cloud Architecture and • Data Virtualization can be used in innovative ways to save cost and time when most needed • Try out Denodo Test Drives and/or Free Trials in the Cloud • https://www.denodo.com/en/denodo-platform/test-drives • https://www.denodo.com/en/denodo-platform/free-trials
  • 21.
    © Copyright DenodoTechnologies. All rights reserved Unless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm, without prior the written authorization from Denodo Technologies.