How to Run Containerized Enterprise
SQL Applications in Cloud
April 17, 2019
Joe Leslie, Senior Product Manager, NuoDB
Murat Karslioglu, VP of Products, MayaData
Copyright © 2019 NuoDB, Inc.
Joe Leslie
Senior Product Manager
NuoDB
Murat Karslioglu
VP of Products
MayaData
MEET THE PRESENTERS
2 |
MOVING TO THE CLOUD,
RETHINKING EVERYTHING
Microservices
and Containers
Growing Data
Workloads
Developer
Retooling
Dev-ops &
Agile
Data
Security
Purchasing
Patterns
6
CONTAINER CHALLENGES FOR
SQL DATABASES
Replication
Legacy data replication
not designed for
container environments
Performance
Network and storage
abstraction layers
require careful
planning
Lift-and-Shift
Moving existing Apps
to the cloud
container model is a
sizable task
Copyright © 2019 NuoDB, Inc.
Virtualization,
Commodity & Cloud
Scale out / in
ACID
(consistency)
Existing SQL
skills & code
SQL database
abstraction
What everyone wants: What they don’t want to lose
“Elasticity” “SQL”
“I want to elastically scale my SQL RDBMS to the cloud”
Continuous
Availability
WHAT’S NEEDED FOR CLOUD
SUCCESS?
7 |
“NuoDB combines the scale-out simplicity and
continuous availability that cloud applications require
with the transactional consistency and durability that
databases of record demand.”
INTRODUCING ANOTHER WAY
Copyright © 2019 NuoDB, Inc.
+ Founded in 2010
+ Management team and investors
are database pioneers
+ Patented distributed SQL database
+ Leading SaaS & on-premises
applications run on NuoDB
+ HQ in Cambridge, MA
NuoDB
9 |
Copyright © 2019 NuoDB, Inc.
+ A distributed, peer-to-peer system
appearing as a single, logical database
+ Transactional and Storage
components scale independently to
meet on-demand Application
requirements
+ Continuously Available - Survive
failures and perform rolling upgrades
+ Straightforward ANSI SQL interface
+ Adheres to ACID database properties
+ Deploy across geographical locations
- AZs and DCs
In-memory
transactions for
application data
affinity
Durable, scale-out
storage
NuoDB: THE DISTRIBUTED SQL DATABASE
10 |
Copyright © 2019 NuoDB, Inc.
Process/host faults Storage faults Network faults
SM
A
TE
A
TE
A
TE
SM SM
Application ServicesA Transaction Engine (TE)TEStorage Manager (SM)SM
A
SM
TE
A
TE
A
TE
A
SM
TE
A
TE
A
TE
SMSM SM SM
ALWAYS-ON WITH NUODB CONTAINERS
11 |
Copyright © 2019 NuoDB, Inc.
Web/Mobile Application
+ Read dominated
+ Scale-out compute tier
SCALING THE DATABASE TO MEET APP
REQUIREMENTS WITH NUODB CONTAINERS
OLTP Application
+ Mixed read/write
+ Scale-out compute & storage tiers
Logging Application
+ Insert dominated
+ Scale-out storage tier
HTAP Application
+ Mixed read/write
+ Dedicated analytical nodes
12 |
Copyright © 2019 NuoDB, Inc.
RDBMS
OCP / K8s OCP / K8s
Traditional RDBMS runs outside
Container-Native Environment
Container-native NuoDB runs as a set of
containers forming a single logical database
TRADITIONAL vs. CONTAINER-NATIVE RDBMS
13 |
Copyright © 2019 NuoDB, Inc. 14 |
+ NuoDB – OLTP SQL database for Digital Transformation
▪ Always-On in the cloud
▪ Scale database components independently
▪ SQL/ACID Compliant
+ Supports Red Hat OpenShift and open source Kubernetes
▪ Container-native database
▪ Optimized for microservices
▪ Supports leading container-native storage solutions
+ Proven
▪ Trusted by leading Fortune companies
▪ Multiple Banking and Telecom systems in production
SUMMARY
Microservices
and Containers
DevOps &
Agile
NVMe &
SCM
Copyright © 2019 NuoDB, Inc.
+ Company founded in 2010
+ OpenEBS Project started in 2016
+ Global team with depth in Storage,
DevOps, SaaS and managed service
+ Large community behind OpenEBS
and chaos engineering project
Litmus.
+ HQ in San Jose, CA
● OpenEBS:
○ 2.5M+ Docker pulls
○ 5500+ GitHub stars
○ 6k+ users
MayaData & OpenEBS
16 |
Copyright © 2019 NuoDB, Inc.
+ Leading OSS project for CAS
+ Cloud-native / Built on K8s
OpenEBS: Container Attached Storage
+ Per workload / Flexible configuration
+ Deploy across DCs & AZs
17 |
Copyright © 2019 NuoDB, Inc.
The Idea: Container Attached Storage
Manifests express
intent stateless
Container 1 Container 2 Container 3
Container 1 Container 2 Container 3
stateful
Container 1 Container 2 Container 3
Data Container Data Container Data Container
Any Server, Any Cloud Any Server, Any Cloud
18 |
19
IT TAKES TWO TO TANGO
Platform
Flexibility
Freedom from
lock-in
User
Experience
19
Copyright © 2019 NuoDB, Inc.
+ The bar - user expectations - has been set by AWS and others
+ My data is just there - accessible via NuoDB - and works without me needing
to do anything or even think about storage vs. DBs
+ Why would anyone want to run their own environment, as opposed to
relying on a cloud-provider-service?
Freedom from lock-in & control resulting in greater agility including the
ability to operate across clouds
To achieve these benefits, operations have to be simple and completely
automated with multiple layers of resilience
DBaaS-like Experience
20 |
Copyright © 2019 NuoDB, Inc.
+ No need to manage the local disks
+ Large size PVs can be provisioned
+ Start with small storage and add disks
as needed on the fly.
+ Take backup of the NuoDB data
periodically and back them up to S3 or
any object storage so that restoration
of the same data is possible to the
same or any other Kubernetes cluster
Advantages: OpenEBS for NuoDB
21 |
Copyright © 2019 NuoDB, Inc.
Costs:
+ Your devs spin up containers
▪ 10-100x the rate of VMs
▪ Many storage systems cannot
handle rate of attach / detach
+ 25-30% are stateful requiring storage
▪ Storage from clouds is 5-10x
more expensive than ephemeral
disks
TCO - Cost Savings
Solution:
+ Per container storage
▪ Granular control
▪ Eliminates attach / detach
challenges
+ Runs across direct attached storage
including ephemeral
▪ Saves 25-30% directly
+ Thin provisioning reduces need to
reprovision or over provision
▪ Additional 20-25% savings
45-50% $ savings
Copyright © 2019 NuoDB, Inc.
MayaData Agility Platform
+ OpenEBS:
Leading OSS containerized storage
+ Litmus:
Leading OSS chaos engineering for
stateful workloads
+ MayaOnline:
Control and visibility
+ Services such as DMaaS:
Data migration as a service
+ Proactive support
MDAP
23 |
Copyright © 2019 NuoDB, Inc.
+ NuoDB & OpenEBS Solution Guide:
▪ https://mayadata.io/assets/pdf/nuodb-openebs-solution-docs.pdf
+ OpenEBS Documentation:
▪ https://docs.openebs.io/docs/next/nuodb.html
+ OpenEBS Getting Started Workshop
▪ https://www.katacoda.com/openebs/scenarios/openebs-intro
▪ https://github.com/openebs/community/tree/master/workshop
+ OpenEBS & Litmus Repositories
▪ https://github.com/openebs/openebs
▪ https://github.com/openebs/litmus
Solution & Resources
24 |
DEMO
Joe Leslie
Senior Product Manager
NuoDB
Uma Mukkara
Co-founder/COO
MayaData
Copyright © 2019 NuoDB, Inc.
Demo Overview
Architecture, Demo of NuoDB on MayaOnline and NuoDB insights
Scaling up of NuoDB components including the underlying OpenEBS
storage.
Performing chaos on TE, Admin and SM components and
demonstrating high availability of NuoDB . Overview of Inserting
chaos in NuoDB using Litmus framework in CI pipelines
26 |
Copyright © 2019 NuoDB, Inc.
Demo Setup
EE 3.11
0.8.1
EE 3.3.1
27 |
Copyright © 2019 NuoDB, Inc.
Production Sizing Recommendations
32GB Memory
16 vCPUs
28 |
Copyright © 2019 NuoDB, Inc.
Demo Setup
29 |
Copyright © 2019 NuoDB, Inc.
Demo Setup
30 |
Copyright © 2019 NuoDB, Inc.
Demo Setup
31 |
Copyright © 2019 NuoDB, Inc.
NuoDB Pipeline on MayaData CI
32 |
SUMMARY
Copyright © 2019 NuoDB, Inc.
+ MDAP is the first truly cross cloud data layer that:
▪ frees enterprises from lock-in
▪ controls cloud spending
▪ while delivering a consistent developer
experience across clouds and data centers
+ Certified /w OpenShift and runs on open source
Kubernetes
▪ Container-native database
▪ Optimized for microservices
SUMMARY
34 |
Copyright © 2019 NuoDB, Inc.
+ OpenEBS Documentation:
▪ https://docs.openebs.io/docs/next/nuodb.html
+ OpenEBS Getting Started Workshop
▪ https://www.katacoda.com/openebs/scenarios/openebs-intro
▪ https://github.com/openebs/community/tree/master/workshop
+ OpenEBS & Litmus Repositories
▪ https://github.com/openebs/openebs
▪ https://github.com/openebs/litmus
+ NuoDB Documentation:
▪ http://doc.nuodb.com/Latest/Default.htm
+ NuoDB CE Download:
▪ https://www.nuodb.com/download
Solution & Resources
NuoDB & OpenEBS Solution Guide
▪ https://mayadata.io/assets/pdf/nuodb-opene
bs-solution-docs.pdf
35 |

NuoDB + MayaData: How to Run Containerized Enterprise SQL Applications in the Cloud

  • 1.
    How to RunContainerized Enterprise SQL Applications in Cloud April 17, 2019 Joe Leslie, Senior Product Manager, NuoDB Murat Karslioglu, VP of Products, MayaData
  • 2.
    Copyright © 2019NuoDB, Inc. Joe Leslie Senior Product Manager NuoDB Murat Karslioglu VP of Products MayaData MEET THE PRESENTERS 2 |
  • 5.
    MOVING TO THECLOUD, RETHINKING EVERYTHING Microservices and Containers Growing Data Workloads Developer Retooling Dev-ops & Agile Data Security Purchasing Patterns
  • 6.
    6 CONTAINER CHALLENGES FOR SQLDATABASES Replication Legacy data replication not designed for container environments Performance Network and storage abstraction layers require careful planning Lift-and-Shift Moving existing Apps to the cloud container model is a sizable task
  • 7.
    Copyright © 2019NuoDB, Inc. Virtualization, Commodity & Cloud Scale out / in ACID (consistency) Existing SQL skills & code SQL database abstraction What everyone wants: What they don’t want to lose “Elasticity” “SQL” “I want to elastically scale my SQL RDBMS to the cloud” Continuous Availability WHAT’S NEEDED FOR CLOUD SUCCESS? 7 |
  • 8.
    “NuoDB combines thescale-out simplicity and continuous availability that cloud applications require with the transactional consistency and durability that databases of record demand.” INTRODUCING ANOTHER WAY
  • 9.
    Copyright © 2019NuoDB, Inc. + Founded in 2010 + Management team and investors are database pioneers + Patented distributed SQL database + Leading SaaS & on-premises applications run on NuoDB + HQ in Cambridge, MA NuoDB 9 |
  • 10.
    Copyright © 2019NuoDB, Inc. + A distributed, peer-to-peer system appearing as a single, logical database + Transactional and Storage components scale independently to meet on-demand Application requirements + Continuously Available - Survive failures and perform rolling upgrades + Straightforward ANSI SQL interface + Adheres to ACID database properties + Deploy across geographical locations - AZs and DCs In-memory transactions for application data affinity Durable, scale-out storage NuoDB: THE DISTRIBUTED SQL DATABASE 10 |
  • 11.
    Copyright © 2019NuoDB, Inc. Process/host faults Storage faults Network faults SM A TE A TE A TE SM SM Application ServicesA Transaction Engine (TE)TEStorage Manager (SM)SM A SM TE A TE A TE A SM TE A TE A TE SMSM SM SM ALWAYS-ON WITH NUODB CONTAINERS 11 |
  • 12.
    Copyright © 2019NuoDB, Inc. Web/Mobile Application + Read dominated + Scale-out compute tier SCALING THE DATABASE TO MEET APP REQUIREMENTS WITH NUODB CONTAINERS OLTP Application + Mixed read/write + Scale-out compute & storage tiers Logging Application + Insert dominated + Scale-out storage tier HTAP Application + Mixed read/write + Dedicated analytical nodes 12 |
  • 13.
    Copyright © 2019NuoDB, Inc. RDBMS OCP / K8s OCP / K8s Traditional RDBMS runs outside Container-Native Environment Container-native NuoDB runs as a set of containers forming a single logical database TRADITIONAL vs. CONTAINER-NATIVE RDBMS 13 |
  • 14.
    Copyright © 2019NuoDB, Inc. 14 | + NuoDB – OLTP SQL database for Digital Transformation ▪ Always-On in the cloud ▪ Scale database components independently ▪ SQL/ACID Compliant + Supports Red Hat OpenShift and open source Kubernetes ▪ Container-native database ▪ Optimized for microservices ▪ Supports leading container-native storage solutions + Proven ▪ Trusted by leading Fortune companies ▪ Multiple Banking and Telecom systems in production SUMMARY
  • 15.
  • 16.
    Copyright © 2019NuoDB, Inc. + Company founded in 2010 + OpenEBS Project started in 2016 + Global team with depth in Storage, DevOps, SaaS and managed service + Large community behind OpenEBS and chaos engineering project Litmus. + HQ in San Jose, CA ● OpenEBS: ○ 2.5M+ Docker pulls ○ 5500+ GitHub stars ○ 6k+ users MayaData & OpenEBS 16 |
  • 17.
    Copyright © 2019NuoDB, Inc. + Leading OSS project for CAS + Cloud-native / Built on K8s OpenEBS: Container Attached Storage + Per workload / Flexible configuration + Deploy across DCs & AZs 17 |
  • 18.
    Copyright © 2019NuoDB, Inc. The Idea: Container Attached Storage Manifests express intent stateless Container 1 Container 2 Container 3 Container 1 Container 2 Container 3 stateful Container 1 Container 2 Container 3 Data Container Data Container Data Container Any Server, Any Cloud Any Server, Any Cloud 18 |
  • 19.
    19 IT TAKES TWOTO TANGO Platform Flexibility Freedom from lock-in User Experience 19
  • 20.
    Copyright © 2019NuoDB, Inc. + The bar - user expectations - has been set by AWS and others + My data is just there - accessible via NuoDB - and works without me needing to do anything or even think about storage vs. DBs + Why would anyone want to run their own environment, as opposed to relying on a cloud-provider-service? Freedom from lock-in & control resulting in greater agility including the ability to operate across clouds To achieve these benefits, operations have to be simple and completely automated with multiple layers of resilience DBaaS-like Experience 20 |
  • 21.
    Copyright © 2019NuoDB, Inc. + No need to manage the local disks + Large size PVs can be provisioned + Start with small storage and add disks as needed on the fly. + Take backup of the NuoDB data periodically and back them up to S3 or any object storage so that restoration of the same data is possible to the same or any other Kubernetes cluster Advantages: OpenEBS for NuoDB 21 |
  • 22.
    Copyright © 2019NuoDB, Inc. Costs: + Your devs spin up containers ▪ 10-100x the rate of VMs ▪ Many storage systems cannot handle rate of attach / detach + 25-30% are stateful requiring storage ▪ Storage from clouds is 5-10x more expensive than ephemeral disks TCO - Cost Savings Solution: + Per container storage ▪ Granular control ▪ Eliminates attach / detach challenges + Runs across direct attached storage including ephemeral ▪ Saves 25-30% directly + Thin provisioning reduces need to reprovision or over provision ▪ Additional 20-25% savings 45-50% $ savings
  • 23.
    Copyright © 2019NuoDB, Inc. MayaData Agility Platform + OpenEBS: Leading OSS containerized storage + Litmus: Leading OSS chaos engineering for stateful workloads + MayaOnline: Control and visibility + Services such as DMaaS: Data migration as a service + Proactive support MDAP 23 |
  • 24.
    Copyright © 2019NuoDB, Inc. + NuoDB & OpenEBS Solution Guide: ▪ https://mayadata.io/assets/pdf/nuodb-openebs-solution-docs.pdf + OpenEBS Documentation: ▪ https://docs.openebs.io/docs/next/nuodb.html + OpenEBS Getting Started Workshop ▪ https://www.katacoda.com/openebs/scenarios/openebs-intro ▪ https://github.com/openebs/community/tree/master/workshop + OpenEBS & Litmus Repositories ▪ https://github.com/openebs/openebs ▪ https://github.com/openebs/litmus Solution & Resources 24 |
  • 25.
    DEMO Joe Leslie Senior ProductManager NuoDB Uma Mukkara Co-founder/COO MayaData
  • 26.
    Copyright © 2019NuoDB, Inc. Demo Overview Architecture, Demo of NuoDB on MayaOnline and NuoDB insights Scaling up of NuoDB components including the underlying OpenEBS storage. Performing chaos on TE, Admin and SM components and demonstrating high availability of NuoDB . Overview of Inserting chaos in NuoDB using Litmus framework in CI pipelines 26 |
  • 27.
    Copyright © 2019NuoDB, Inc. Demo Setup EE 3.11 0.8.1 EE 3.3.1 27 |
  • 28.
    Copyright © 2019NuoDB, Inc. Production Sizing Recommendations 32GB Memory 16 vCPUs 28 |
  • 29.
    Copyright © 2019NuoDB, Inc. Demo Setup 29 |
  • 30.
    Copyright © 2019NuoDB, Inc. Demo Setup 30 |
  • 31.
    Copyright © 2019NuoDB, Inc. Demo Setup 31 |
  • 32.
    Copyright © 2019NuoDB, Inc. NuoDB Pipeline on MayaData CI 32 |
  • 33.
  • 34.
    Copyright © 2019NuoDB, Inc. + MDAP is the first truly cross cloud data layer that: ▪ frees enterprises from lock-in ▪ controls cloud spending ▪ while delivering a consistent developer experience across clouds and data centers + Certified /w OpenShift and runs on open source Kubernetes ▪ Container-native database ▪ Optimized for microservices SUMMARY 34 |
  • 35.
    Copyright © 2019NuoDB, Inc. + OpenEBS Documentation: ▪ https://docs.openebs.io/docs/next/nuodb.html + OpenEBS Getting Started Workshop ▪ https://www.katacoda.com/openebs/scenarios/openebs-intro ▪ https://github.com/openebs/community/tree/master/workshop + OpenEBS & Litmus Repositories ▪ https://github.com/openebs/openebs ▪ https://github.com/openebs/litmus + NuoDB Documentation: ▪ http://doc.nuodb.com/Latest/Default.htm + NuoDB CE Download: ▪ https://www.nuodb.com/download Solution & Resources NuoDB & OpenEBS Solution Guide ▪ https://mayadata.io/assets/pdf/nuodb-opene bs-solution-docs.pdf 35 |