Watch full webinar here: https://bit.ly/3oWR1Bl
The future of infrastructure management lies in automation. In this session, Denodo subject matter expert will talk about how in a multi-cloud scenario, the infrastructure can be automatically managed transparently via a web GUI. Audience will get to see that in action through a live demo.
3. #DenodoDataFest
Scaling Multi-Cloud Deployments with Denodo:
Automated Infrastructure Management
SVP Data Architectures &
Chief Evangelist,
Denodo Technologies
Paul Moxon
Sales Engineer,
Denodo Technologies
Senthil Ramesh JV
4. Agenda
1. Collect or Connect?
2. The Need for a Logical Data Fabric
3. Multi-Cloud Deployment Challenges
4. The Role of Denodo Solution Manager
5. Denodo Platform Demo
6. Summary
7. Q&A
7. 7
Denodo Cloud Survey 2020
• More than 75% of companies already have projects in cloud
• Over 15% are Cloud-First and/or are in “advanced” state
• Only 3.97% do not have plans for Cloud in the short term
• More than 53% have hybrid integration needs
• Key Use Cases include: Analytics (50%), Data Lake (31%), AI/ML (28%)
• Less than 9% of on-prem systems are decommissioned (Forrester estimates 8%)
• Key Technologies in Cloud Journey: Cloud Platform Tools (56%), Data Virtualization (49.5%),
Data Lake Technology (48%)
Source: Denodo Global Cloud Survey 2020
8. 8
DV is a Distributed and Logical Architecture
▪ Distributed: Data resides in multiple systems /
locations
▪ Data today is too big and distributed
▪ Modern analytics needs are too diverse: one size never fits all
▪ Hybrid and multi-cloud
▪ Logical: Consumers access data through semantic
models, decoupled from data location and physical
schemas
▪ Semantic models adapt to consumer needs and enforce
common policies
▪ Not necessarily virtual/federated access: any delivery style
including replication when needed
▪ Allows for technology evolution and infrastructure changes
(e.g. cloud transition)
9. 9
This is a Key Idea in a Data Fabric design
• A data fabric is a distributed and
logical architecture
• A Data fabric enables multiple data
integration strategies
• Needs to empower the user to apply
the strategy that better fits the
scenario
• Sometimes federation works great,
others replication is best
11. 11
Role of the Solution Manager (Cont’d)
• Solution Manager supports many functionalities
• License management
• Product updates and version consistency
• Monitoring environments
• Defining environment configurations
• Creation and management of configuration revisions
• Promotion of revisions between environments
• Solution Manager is key component for DevOps
12. 12
Automation in the Cloud
• Cloud infrastructures provide automation
configuration and deployment capabilities
• Launchable images
• Configurable storage options
• Auto-scaling groups/Scale sets to scale up down
• Configurable load balancers
• Security groups
• Centralized logging
• Available via APIs (e.g. AWS API)
13. 13
Solution Manager – Automated Cloud Mode
• Configure hybrid, multi-Cloud Denodo Platform deployments
• Environments on-premises and in Cloud
• Managed from a single place
• Configure Cloud infrastructure components of Denodo Platform deployment
• AMIs to launch for VDP Servers, Denodo Data Catalog, and Denodo Scheduler
• Load balancers, Auto-scaling groups, Storage options, Security groups, Denodo logging
configurations
• Automatically launch and shutdown infrastructure components
• e.g. launch/shutdown AMI instances containing VDP Servers
15. 15
In this demo, we will learn how to …
• Configure the AWS credentials in Solution Manager
• Configure the support credentials in Solution Manager
• Configure the logging on S3 buckets
• Create an Environment through the automated mode using AWS credentials
• Create a cluster that consists of a VDP instance
• Understand the cluster creation events
• Understand how to start/stop/restart the instances from the solution manager
16. 16
We will also see how to…
• Install Updates on the Denodo Platform components directly from the solution
manager.
• From Support Site
• From S3 Bucket
• Login to the Design Studio of the new instance and do basic queries
• Setup the authentication for the solution manager components including LDAP
and Single Sign on
• Overview on Promotions and deployments between the environments that are
on-prem or in cloud.
18. 18
Key Takeaways
• Denodo Platform 8.0’s new Automated Cloud Mode simplifies hybrid and Cloud
deployments
• Define Denodo environment for AWS from Solution Manager
• Define images to be launched
• Define autoscaling groups
• Define Elastic Load Balancers
• Define storage options
• Define Security Group settings
• Define logging configuration
19. 19
Future Enhancements
• Support for Automated Cloud Mode for Microsoft
Azure – Q4, 2021
• Support for Automated Mode for on-premise
containerized deployments (Kubernetes) – H1, 2022
• Assign IAM policies to instances provisioned via
Solution Manager – Q4, 2021
• Assign customizable tags to instance provisioned by
Solution Manager – H1, 2022
• Migrations via Solution Manager with externalized
Metadata repository – Q4, 2021 and H1, 2022