1.
Demo:
Wie beschleunigt die Denodo Plattform
Ihre Zeit der Erkenntnisgewinnung?
Leendert Kollmer
Senior Sales Engineer, Denodo

2.
2
What does a Business User need?
Business User
& BI Analyst
1. Self Service
• Be able to do things by themselves,
no need to open constant requests
to IT
2. Ease of use
• All data accessible in the same place
• Data in easy-to-understand format
• Well documented
3. Reporting in their favorite tool
• Excel, Tableau, PowerBI, etc.

3.
3
What does IT need?
1. Agile data integration
• Integrate virtually or physically with
just a few clicks
2. Centralized delivery control
• Security
• Governance
• Auditing
3. Flexibility for change
• Change back-end without interrupting
business
• Migration to the cloud and modern
systems
Data Engineer & IT

4.
4
Bridging the Gap
Business User
& BI Analyst
Data Engineer & IT
Sales by customer and
promotion?
Marketing Sales
DATA CATALOG
Discover - Explore - Document
Execution
Engine
Security &
Governance
Semantic
Layer
Unified Data
Access
AI
• Marketing data is in a SaaS app
• API access has high latency
• Maybe we need to cache it locally?
• We need to address incremental
updates
• Sales is in the EDW
• Currently on prem in Oracle
• Planning migration to the cloud
• Can’t disrupt business!
Customer

5.
1. Unified Data Access
• What: Connect all data to the logical layer
• Why:
• Back-end complexity is hidden to end users
• IT gains flexibility for change
• Features:
✔ Connectivity to different sources
✔ Abstraction of underlying technology
Data Engineer & IT

6.
2. Semantics
• What: Brings additional meaning to data for simpler usage
• Why:
• Presents data to business users in their own language, simplifies
self-service
• Increase reusability and reduces IT requests
• Features
✔ Definition of derived data models
✔ Tagging and documenting
Data Engineer & IT

7.
3. Unified Security & Governance
• What: Secure and govern all data in a single place
• Why:
• Simplifies security management, faster and less
error prone
• Business user only see what they are allowed,
across all data assets
• Features:
✔ Tag-based security policies
✔ Lineage, change impact analysis
Data Engineer & IT

8.
4. Self Service Access
• What:
• Empower business users to explore, preview and create
new data insights
• Why:
• Reduce dependency from IT
• Increase reusability and reduce shadow IT
• Features:
✔ Data Catalog: Explore, Document, Preview
✔ Zero-coding web services (REST, OData, GraphQL)
✔ Visualization with reporting tools (Tableau, PowerBI, etc.)
Business User
& BI Analyst

9.
5. Performance & Scalability
• What:
• Execute queries at scale in the fastest possible way
• Why:
• Provide fast, responsive execution
• Features:
✔ Real-time data integration
✔ Query optimization
✔ AI-based Query Acceleration
✔ Data replication

10.
10
Execution and optimization
Denodo includes an advance execution engine that optimizes
and orchestrates execution across data sources
▪ By default, since Denodo has no data, execution happens in real time
▪ Denodo pushes down execution to sources as much as possible.
▪ For a single source query, data just passes through with minimal overhead
▪ For multi-source queries, Denodo offers a state-of-the art cost based
optimizer with rules engine to generate efficient execution plans, even for
large data volumes
▪ Includes options like MPP execution and on-demand data movement
▪ Denodo also provides a variety of techniques for selective materialization
▪ Query acceleration based on aggregate-awareness techniques
▪ Advanced caching mechanism
▪ And point-to-point replication capabilities

11.
11
Performance – Multi-source optimization
• This approach gives the DV layer a lot of flexibility to take advantage of
processing at the sources, and in turn, reduce data transfers
• The right execution plan is automatically chosen by the optimizer based on the capabilities
of the sources, and cost estimations based on volume and the operations involved
Candidate #1:
Naïve Strategy
Sales Customer
3 M 100k
JOIN
GROUP BY
country
Candidate #2:
On-the-fly Data Movement
Sales Customer
Temp_Customer
2 M
50
JOIN
CREATE
TEMP
GROUP BY
country
Candidate #3:
Partial Aggregation Pushdown
Sales Customer
2 M
2 M
To maximize push
down the aggregation
is split in 2 steps:
• 1st by customer ID
• 2nd by state
This significantly
reduces network
Traffic and processing
In Denodo
JOIN
GROUP BY
country
GROUP BY
country
System Time (s)
Denodo #1 7.96 s
Denodo #2 2.23 s
Denodo #3 0.9 s
Others 14.76 s

12.
12
Smart Query Acceleration: AI-based Recommendations
Denodo 8 uses Artificial
Intelligence to automatically
recommend the best summaries
to increase performance
Denodo uses a complex algorithm
that combines usage history and
cost simulations to generate
them

13.
6. Deployment and Operation
• What:
• Integrated capabilities for management and operation of the platform
• Why:
• Reduce operational work for IT and align with modern CI/CD trends
• Features:
✔ Automated cloud provisioning
✔ Monitoring
✔ Team development and revision management

14.
14
Deployment and Operation
In addition to the execution server and development environment, Denodo includes
a full-fledged ecosystem to manage the operation of the platform
▪ Flexible options for on-prem, cloud and containerized deployment
▪ Fully automated deployment models in AWS and Azure managed graphically in Solution
Manager
▪ Integrated scheduler for batch operations
▪ Caching refresh, stats gathering, etc.
▪ Real-time web-based monitoring tool
▪ Graphical management of updates, migrations and backups
▪ APIs for integration with lifecycle management tools (e.g. Jenkins)

15.
Key Takeaways
1. Better data discovery and self-service
2. More flexibility for IT
3. Improved query performance
4. Centralized security and governance
5. Automation across the board

16.
© Copyright Denodo Technologies. All rights reserved
Unless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm,
without prior the written authorization from Denodo Technologies.