#FastDataStrategy
Denodo 7.0 - What's New?
Alberto Pan
CTO, Denodo
Agenda1. Denodo Vision: Unified Data Delivery Platform
2. What’s New in Denodo 7
3. Q & A
Product Vision
5
Denodo: Unified Data Delivery Platform for the Business
4. Access with any tool / protocol –
Data service / API Layer
5. Centralized metadata, security &
governance
6. 90% time to market reductions and
cost savings
1. Single access point to data – Location
Independence
2. Data in business friendly form –
Semantic Layer
3. Data adapted for the needs of each
LOB, type of user and application
More than 60% of Self-Service Initiatives Ranked as
Average or lower
Source: InsideAnalysis.com
6
DATA CONSUMERS
DISPARATE DATA SOURCES
SQL Queries
(JDBC, ODBC, ADO.NET)
Web Services
(SOAP, REST, OData)
Web-based catalog
& search
Secure delivery
(SSL/TLS)
DATA CONSUMERS
MPP Processing
Relational Cache
Corporate Security
Monitoring & Auditing
Metadata
Repository
Execution Engine
& Optimizer
A Modern Data Virtualization Architecture
DATA VIRTUALIZATION
7
The Enterprise Data Layer for Big Data and Analytics
Reference Architecture
8
The Enterprise Data Layer for Operational and Transactional
Reference Architecture
9
DV in the IoT Ecosystem
Other RDBMS
(apps, CRM, SAP)
Other Sources
(SaaS, SFDC, etc.)
Ingestion Streaming
analytics
Big Data
Storage
Batch analytics,
Machine earning
Streaming data
Traditional batch
processing
(ETL to EDW)
Semantic
Model
Secure
+
Combine
+
Enrich
10
Cloud and On-Prem Integration
Denodo 7: What’s New
12
New Release of Denodo Platform Redefines Data Management for Mission-critical Enterprise Use Cases.
Reimagine Data Management with Denodo Platform 7.0
Unparalleled Performance
Combined power of Massive Parallel
Processing & Dynamic Query Optimization
for immediate data delivery in big data,
cloud, and real-time scenarios.
Integrated Data Catalog
The Only Data Virtualization offering
that tightly integrates Data Catalog and
Data Delivery for contextual information
delivery and collective intelligence.
Full Lifecycle Management
Streamlined DevOps with new tools
and APIs that greatly simplify
deployments, updates, management
and more.
Security and Connectivity
New Data Sources, Data Publishing and
Security standards
13
Denodo Data Virtualization: Advanced Optimization
Minimizes data movement and maximizes
local processing at the origin systems
Leverages in-memory MPP Processing at
the DV layer
Multiple caching options: partial, full,
incremental, …
Optimize distributed queries across large repositories
The Denodo Platform ... incorporates dynamic query
optimization as a key value point…specifically for high data
volume and complexity;”
Gartnet Magic Quadrant for Data Integration, 2017
14
Query Optimization: Classical Federation
Naive Strategy (BI Tools, BDI Tools, Simple
federation engines):
join
union
group by
Customers (3M)
Sales previous years
(3B)Sales this year (290M)
290M rows
300M rows
(sales previous
year)
3M rows 593M rows through the
network
Obtain Total Sales By Customer Country in the Last Two Years
15
Query Optimization: Dynamic Optimizer
Denodo Strategy
join
union
group by
Customers (3M)
Sales previous years
(3B)Sales this year
(290M)
3M rows (sales by
customer this year)
3M rows (sales
by customer
previous year)
3M rows 9 M rows through the
network
Obtain Total Sales By Customer Country in the Last Two Years
group by
customer
group by
customer
16
Dynamic Optimizer + MPP Processing (Denodo 7)
union
group by
3M rows
(sales by customer
this year)
3M rows
(sales by
customer
previous year)
3M rows
(customers)
Aggregation
pushdowngroup by
customer
group by
customer
join
Integrated
MPP processing
System Execution Time Optimization Technique
No Rewriting >10 min None
Denodo 6 51 sec Aggregation push-down
Denodo 7 13 sec
Aggregation push-down + MPP
integration
17
New Release of Denodo Platform Redefines Data Management for Mission-critical Enterprise Use Cases.
Reimagine Data Management with Denodo Platform 7.0
Unparalleled Performance
Combined power of Massive Parallel
Processing & Dynamic Query Optimization
for immediate data delivery in big data,
cloud, and real-time scenarios.
Integrated Data Catalog
The Only Data Virtualization offering
that tightly integrates Data Catalog and
Data Delivery for contextual information
delivery and collective intelligence.
Full Lifecycle Management
Streamlined DevOps with new tools
and APIs that greatly simplify
deployments, updates, management
and more.
Security and Connectivity
New Data Sources, Data Publishing and
Security standards
18
Why a Data Catalog ?
Catalog of datasets available for consumption by the
business in the Delivery Layer
80% of time dedicated to finding the right data
Discover datasets relevant for a particular need and
understand what data they provide
Expose Datasets available to Business Users and Developers
19
The Role of the Data Catalog
Catalog of views and web services
• Classify existing views and services using business categories, tags,..
• Browse and search capabilities using multiple criteria
• See descriptions, relationships and data lineage
• See information about the dataset usage
20
Denodo Data Catalog 7.0
21
Denodo Data Catalog: Business Categories
22
Denodo Data Catalog: Tagging
23
Denodo Data Catalog: Relationships
24
Denodo Data Catalog: Data Lineage
25
The Role of the Data Catalog
Catalog of views and web services
• Classify existing views and services using business categories, tags,..
• Browse and search capabilities using multiple criteria
• See descriptions, relationships and data lineage
• See information about the dataset usage
Preview and find data
• Quick look at data
• Search based on content
26
Denodo Data Catalog: Content Search
27
Denodo Data Catalog: Get Access
28
The Role of the Data Catalog
Catalog of views and web services
• Classify existing views and services using business categories, tags,..
• Browse and search capabilities using multiple criteria
• See descriptions, relationships and data lineage
• See information about the dataset usage
Preview and find data
• Quick look at data
• Search based on content
Consume
• Obtain connection details to consume data with your favourite tool
• Customize existing views with visual transformation wizards
• “My queries” for personal use & share with other users
• Propose new standard business / canonical views
29
Denodo Data Catalog: Data Preparation
30
Denodo Data Catalog: Save and Share
31
New Release of Denodo Platform Redefines Data Management for Mission-critical Enterprise Use Cases.
Reimagine Data Management with Denodo Platform 7.0
Unparalleled Performance
Combined power of Massive Parallel
Processing & Dynamic Query Optimization
for immediate data delivery in big data,
cloud, and real-time scenarios.
Integrated Data Catalog
The Only Data Virtualization offering
that tightly integrates Data Catalog and
Data Delivery for contextual information
delivery and collective intelligence.
Full Lifecycle Management
Streamlined DevOps with new tools
and APIs that greatly simplify
deployments, updates, management
and more.
Security and Connectivity
New Data Sources, Data Publishing and
Security standards
32
Denodo’s Solution Manager
Administration and
Development Client
DEVELOPMENT
Load Balancer
Q&A PRODUCTION
CLUSTER
Integrated
Version
Control
MS TFSSubversion git
Solution Manager
Offers centralize management from a web
console of:
▪ Server and client licenses
▪ Updates
▪ Monitoring
▪ Migrations (VDP and SCH)
VCS for
Migration history
DB for Environment
Dependent properties
33
Solution Manager: Licenses and Updates
34
Ping Data Source
35
New Release of Denodo Platform Redefines Data Management for Mission-critical Enterprise Use Cases.
Reimagine Data Management with Denodo Platform 7.0
Unparalleled Performance
Combined power of Massive Parallel
Processing & Dynamic Query Optimization
for immediate data delivery in big data,
cloud, and real-time scenarios.
Integrated Data Catalog
The Only Data Virtualization offering
that tightly integrates Data Catalog and
Data Delivery for contextual information
delivery and collective intelligence.
Full Lifecycle Management
Streamlined DevOps with new tools
and APIs that greatly simplify
deployments, updates, management
and more.
Security and Connectivity
New Data Sources, Data Publishing and
Security standards
36
Extended capabilities in existing adapters (e.g. enhanced
pagination support for REST web services,…)
New adapter for Presto DB (Denodo 7)
New Salesforce adapter in the main distribution (Denodo 7)
Connectivity to Data Sources:
Connectivity: Southbound
37
New Salesforce Adapter
38
New adapter for Power BI
Support for Open API specification (Swagger) in published web
services
Extended functions for geospatial data and GeoJSON support
Access to Denodo from Consuming Applications:
Connectivity: Northbound
39
Denodo Data Virtualization: Security
Northbound Support for OAuth, JSON WT
New policies for setting Quotas (e.g. max.
queries per user/application per hour/day)
Extensions to security privileges system
Unified Security Policies Across All Data Sources and Consuming Apps
Our Denodo rollout was one of the easiest and most successful rollouts
of critical enterprise software I have seen. It was successful in handling
our initial, security, use case immediately”
Enterprise Architect, Asurion, 2017
Security
Policy
Conditions satisfied
Data consuming users, Apps
Query
Accept / add filters
Reject
Policy Server
40
Key Takeaways
Denodo bridges the gap between the complex and changing IT data infrastructure and
Business Users and Applications
▪ The best Data Virtualization engine in the market, integrates and exposes data to the
business much faster and at a fraction of the cost of other approaches
▪ Offers unparalled performance in Data Virtualization
▪ Includes integrated Catalog functionalities for data discovery
▪ Automates the full lifecycle management of Denodo applications across multiple
environments and locations (on-premises or cloud)
▪ Continues expanding support for new data sources, data consumption tools and security
standards
Q&A
42
DOWNLOAD DENODO
EXPRESS
DENODO FOR AWS DENODO FOR AZURE
Download Denodo Express
Next Steps
Access Denodo Platform in the cloud!
30 day free trial available!
Thank you!
© Copyright Denodo Technologies. All rights reserved
Unless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm, without prior the written
authorization from Denodo Technologies.
#FastDataStrategy

Denodo Platform 7.0: What's New?

  • 1.
  • 2.
    Denodo 7.0 -What's New? Alberto Pan CTO, Denodo
  • 3.
    Agenda1. Denodo Vision:Unified Data Delivery Platform 2. What’s New in Denodo 7 3. Q & A
  • 4.
  • 5.
    5 Denodo: Unified DataDelivery Platform for the Business 4. Access with any tool / protocol – Data service / API Layer 5. Centralized metadata, security & governance 6. 90% time to market reductions and cost savings 1. Single access point to data – Location Independence 2. Data in business friendly form – Semantic Layer 3. Data adapted for the needs of each LOB, type of user and application More than 60% of Self-Service Initiatives Ranked as Average or lower Source: InsideAnalysis.com
  • 6.
    6 DATA CONSUMERS DISPARATE DATASOURCES SQL Queries (JDBC, ODBC, ADO.NET) Web Services (SOAP, REST, OData) Web-based catalog & search Secure delivery (SSL/TLS) DATA CONSUMERS MPP Processing Relational Cache Corporate Security Monitoring & Auditing Metadata Repository Execution Engine & Optimizer A Modern Data Virtualization Architecture DATA VIRTUALIZATION
  • 7.
    7 The Enterprise DataLayer for Big Data and Analytics Reference Architecture
  • 8.
    8 The Enterprise DataLayer for Operational and Transactional Reference Architecture
  • 9.
    9 DV in theIoT Ecosystem Other RDBMS (apps, CRM, SAP) Other Sources (SaaS, SFDC, etc.) Ingestion Streaming analytics Big Data Storage Batch analytics, Machine earning Streaming data Traditional batch processing (ETL to EDW) Semantic Model Secure + Combine + Enrich
  • 10.
  • 11.
  • 12.
    12 New Release ofDenodo Platform Redefines Data Management for Mission-critical Enterprise Use Cases. Reimagine Data Management with Denodo Platform 7.0 Unparalleled Performance Combined power of Massive Parallel Processing & Dynamic Query Optimization for immediate data delivery in big data, cloud, and real-time scenarios. Integrated Data Catalog The Only Data Virtualization offering that tightly integrates Data Catalog and Data Delivery for contextual information delivery and collective intelligence. Full Lifecycle Management Streamlined DevOps with new tools and APIs that greatly simplify deployments, updates, management and more. Security and Connectivity New Data Sources, Data Publishing and Security standards
  • 13.
    13 Denodo Data Virtualization:Advanced Optimization Minimizes data movement and maximizes local processing at the origin systems Leverages in-memory MPP Processing at the DV layer Multiple caching options: partial, full, incremental, … Optimize distributed queries across large repositories The Denodo Platform ... incorporates dynamic query optimization as a key value point…specifically for high data volume and complexity;” Gartnet Magic Quadrant for Data Integration, 2017
  • 14.
    14 Query Optimization: ClassicalFederation Naive Strategy (BI Tools, BDI Tools, Simple federation engines): join union group by Customers (3M) Sales previous years (3B)Sales this year (290M) 290M rows 300M rows (sales previous year) 3M rows 593M rows through the network Obtain Total Sales By Customer Country in the Last Two Years
  • 15.
    15 Query Optimization: DynamicOptimizer Denodo Strategy join union group by Customers (3M) Sales previous years (3B)Sales this year (290M) 3M rows (sales by customer this year) 3M rows (sales by customer previous year) 3M rows 9 M rows through the network Obtain Total Sales By Customer Country in the Last Two Years group by customer group by customer
  • 16.
    16 Dynamic Optimizer +MPP Processing (Denodo 7) union group by 3M rows (sales by customer this year) 3M rows (sales by customer previous year) 3M rows (customers) Aggregation pushdowngroup by customer group by customer join Integrated MPP processing System Execution Time Optimization Technique No Rewriting >10 min None Denodo 6 51 sec Aggregation push-down Denodo 7 13 sec Aggregation push-down + MPP integration
  • 17.
    17 New Release ofDenodo Platform Redefines Data Management for Mission-critical Enterprise Use Cases. Reimagine Data Management with Denodo Platform 7.0 Unparalleled Performance Combined power of Massive Parallel Processing & Dynamic Query Optimization for immediate data delivery in big data, cloud, and real-time scenarios. Integrated Data Catalog The Only Data Virtualization offering that tightly integrates Data Catalog and Data Delivery for contextual information delivery and collective intelligence. Full Lifecycle Management Streamlined DevOps with new tools and APIs that greatly simplify deployments, updates, management and more. Security and Connectivity New Data Sources, Data Publishing and Security standards
  • 18.
    18 Why a DataCatalog ? Catalog of datasets available for consumption by the business in the Delivery Layer 80% of time dedicated to finding the right data Discover datasets relevant for a particular need and understand what data they provide Expose Datasets available to Business Users and Developers
  • 19.
    19 The Role ofthe Data Catalog Catalog of views and web services • Classify existing views and services using business categories, tags,.. • Browse and search capabilities using multiple criteria • See descriptions, relationships and data lineage • See information about the dataset usage
  • 20.
  • 21.
    21 Denodo Data Catalog:Business Categories
  • 22.
  • 23.
  • 24.
  • 25.
    25 The Role ofthe Data Catalog Catalog of views and web services • Classify existing views and services using business categories, tags,.. • Browse and search capabilities using multiple criteria • See descriptions, relationships and data lineage • See information about the dataset usage Preview and find data • Quick look at data • Search based on content
  • 26.
  • 27.
  • 28.
    28 The Role ofthe Data Catalog Catalog of views and web services • Classify existing views and services using business categories, tags,.. • Browse and search capabilities using multiple criteria • See descriptions, relationships and data lineage • See information about the dataset usage Preview and find data • Quick look at data • Search based on content Consume • Obtain connection details to consume data with your favourite tool • Customize existing views with visual transformation wizards • “My queries” for personal use & share with other users • Propose new standard business / canonical views
  • 29.
    29 Denodo Data Catalog:Data Preparation
  • 30.
  • 31.
    31 New Release ofDenodo Platform Redefines Data Management for Mission-critical Enterprise Use Cases. Reimagine Data Management with Denodo Platform 7.0 Unparalleled Performance Combined power of Massive Parallel Processing & Dynamic Query Optimization for immediate data delivery in big data, cloud, and real-time scenarios. Integrated Data Catalog The Only Data Virtualization offering that tightly integrates Data Catalog and Data Delivery for contextual information delivery and collective intelligence. Full Lifecycle Management Streamlined DevOps with new tools and APIs that greatly simplify deployments, updates, management and more. Security and Connectivity New Data Sources, Data Publishing and Security standards
  • 32.
    32 Denodo’s Solution Manager Administrationand Development Client DEVELOPMENT Load Balancer Q&A PRODUCTION CLUSTER Integrated Version Control MS TFSSubversion git Solution Manager Offers centralize management from a web console of: ▪ Server and client licenses ▪ Updates ▪ Monitoring ▪ Migrations (VDP and SCH) VCS for Migration history DB for Environment Dependent properties
  • 33.
  • 34.
  • 35.
    35 New Release ofDenodo Platform Redefines Data Management for Mission-critical Enterprise Use Cases. Reimagine Data Management with Denodo Platform 7.0 Unparalleled Performance Combined power of Massive Parallel Processing & Dynamic Query Optimization for immediate data delivery in big data, cloud, and real-time scenarios. Integrated Data Catalog The Only Data Virtualization offering that tightly integrates Data Catalog and Data Delivery for contextual information delivery and collective intelligence. Full Lifecycle Management Streamlined DevOps with new tools and APIs that greatly simplify deployments, updates, management and more. Security and Connectivity New Data Sources, Data Publishing and Security standards
  • 36.
    36 Extended capabilities inexisting adapters (e.g. enhanced pagination support for REST web services,…) New adapter for Presto DB (Denodo 7) New Salesforce adapter in the main distribution (Denodo 7) Connectivity to Data Sources: Connectivity: Southbound
  • 37.
  • 38.
    38 New adapter forPower BI Support for Open API specification (Swagger) in published web services Extended functions for geospatial data and GeoJSON support Access to Denodo from Consuming Applications: Connectivity: Northbound
  • 39.
    39 Denodo Data Virtualization:Security Northbound Support for OAuth, JSON WT New policies for setting Quotas (e.g. max. queries per user/application per hour/day) Extensions to security privileges system Unified Security Policies Across All Data Sources and Consuming Apps Our Denodo rollout was one of the easiest and most successful rollouts of critical enterprise software I have seen. It was successful in handling our initial, security, use case immediately” Enterprise Architect, Asurion, 2017 Security Policy Conditions satisfied Data consuming users, Apps Query Accept / add filters Reject Policy Server
  • 40.
    40 Key Takeaways Denodo bridgesthe gap between the complex and changing IT data infrastructure and Business Users and Applications ▪ The best Data Virtualization engine in the market, integrates and exposes data to the business much faster and at a fraction of the cost of other approaches ▪ Offers unparalled performance in Data Virtualization ▪ Includes integrated Catalog functionalities for data discovery ▪ Automates the full lifecycle management of Denodo applications across multiple environments and locations (on-premises or cloud) ▪ Continues expanding support for new data sources, data consumption tools and security standards
  • 41.
  • 42.
    42 DOWNLOAD DENODO EXPRESS DENODO FORAWS DENODO FOR AZURE Download Denodo Express Next Steps Access Denodo Platform in the cloud! 30 day free trial available!
  • 43.
    Thank you! © CopyrightDenodo Technologies. All rights reserved Unless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm, without prior the written authorization from Denodo Technologies. #FastDataStrategy