Copyright (C) 2018 451 Research LLC
What It Means to be a Container-Native
SQL Database
July 24, 2018
451 Research and NuoDB
James Curtis
451 Research
Ariff Kassam
NuoDB
James Curtis
Senior Analyst, Data Platforms & Analytics
2
Ariff Kassam
Vice President, Products
Housekeeping Items:
Questions?
A copy of the presentation will be provided
to all attendeesPresentation Slides
Feedback
To ask a question, click on the question
button
Don’t forget to leave feedback at the end
of the webinar
3
451 Research is a leading IT research & advisory company
4
Founded in 2000
300+ employees, including over 120 analysts
2,000+ clients: Technology & Service providers, corporate
advisory, finance, professional services, and IT decision makers
70,000+ IT professionals, business users and consumers in our research community
Over 52 million data points published each quarter and 4,500+ reports published
each year
3,000+ technology & service providers under coverage
451 Research and its sister company, Uptime Institute, are the two divisions of The
451 Group
Headquartered in New York City, with offices in London, Boston, San Francisco,
Washington DC, Mexico, Costa Rica, Brazil, Spain, UAE, Russia, Taiwan, Singapore
and Malaysia
Research & Data
Advisory
Events
Go 2 Market
Digital Transformation: What do we mean?
5
Copyright (C) 2016 451 Research LLC
3
Digital Transformation is the investment in
new digital technologies and processes to
not only more effectively engage
customers, partners or employees, but to
also cut costs.
Digital transformation is real and happening now
6
42%
28%
20%
10%
Execution. We have a formal strategy and are actively digitizing our
business processes and/or assets.
Evaluation. We are planning and researching to develop a digital
transformation strategy.
Consideration. We areconsidering it, but have no formal plans.
No strategy. We currently have no digital transformation strategy.
% of respondents (n=1002)
Source: 451 Research, Voice of the Enterprise: Digital Pulse, Workloads and Key Projects 2018
What exactly needs to be digitally transformed?
Process
Transformation
Information
Transformation
Platform
Transformation
§ More than a technical shift, but a cultural one
§ Focus on collaboration—employees but also
customers, partners, suppliers
§ Agile methods for software development
§ Gathering data and lots of it in various means
and methods
§ Multiple communication points on multiple
devices
§ Leveraging data with advanced analytics
§ IT moving from cost center to software enabler
§ Organizations needs systems of engagement—tools
and systems for omnichannel interaction
§ Integration with legacy systems of record
7
When considering a digital transformation, enterprises
often need to…
8
Handle Growth
Steady and Seasonal
Manage Costs
Now and Future
Minimize Friction
Adoption and Adjustment
▪ NewSQL databases: 29% CAGR
▪ Traditional relational databases: 6% CAGR
9
Handle
Growth
Manage
Costs
Minimal
Friction
Database growth expected for
relational databases 2017-22
Combined
6.4%
2017-22 CAGR
Source: 451 Research, Total Data: Platforms & Analytics, May 2018.
10
Handle
Growth
Manage
Costs
Minimal
Friction
Database revenue growth by
execution 2016-21
Source: 451 Research’s Total Data Market Monitor, May 2018, and Voice of the Enterprise Cloud Transformation,
Workloads and Key Projects 2017
11
Handle
Growth
Manage
Costs
Minimal
Friction
Great expectations for reduced
costs in cloud adoption
Source: 451 Research, The Cloud Transformation Journey, February 2018.
12
Handle
Growth
Manage
Costs
Minimal
Friction
But the cloud is a journey….
Source: 451 Research, The Cloud Transformation Journey, February 2018.
13
Handle
Growth
Manage
Costs
Minimal
Friction
Maintain existing skills
§ New technologies such as MapReduce and Hadoop
garnered a lot of attention due to the flexibility they
enable for large-scale data processing
§ But no one stopped using SQL
§ SQL isn’t back – it never went away
14
Handle
Growth
Manage
Costs
Minimal
Friction
Examine existing technologies
▪ Traditional relational DBMS can get stretched
beyond their normal capacity by the needs of high-
volume, highly distributed applications
▪ Modern relational DBMS provide scalability while
also enabling ACID guarantees for transactions
But enterprises also worry about the future
15
In addition to… Enterprise want to….
Handle
Growth
Manage
Costs
Minimal
Friction
Build for the Future
Invest and Future Proof
16
Containers will play key role
for digital transformations
§ Enable packaging/deploying of applications
§ Enables spin-up/down of applications and/or
services
§ Reduce provisioning times
§ Easy to move around as needed
§ Open source development and growing community
support
3
Containers adoption is modest, but expected to grow
Source: 451 Research, Storage: Workloads and Key Projects, 2018
18
Containers are now being
deployed for databases
§ Innovations in container technology are emerging
that allow for persistence storage for stateful
applications
§ Vendors are merging containers with data workflows
as a means to tackle digital transformation efforts
§ Enterprises are becoming increasingly comfortable
with databases running on cloud infrastructure
Key Takeaways
19
Thank you!
james.curtis@451research.com
@jmscrts
www.451research.com
DIGITAL TRANSFORMATION
IT departments must
become more agile so
that enterprises can
quickly respond to
changing customer,
competitive and
business demands
Traditional SQL
database solutions
anchor enterprise-
critical application
architectures and
processes in the past
To fully realize the
benefits of Digital
Transformation,
enterprises need SQL
database solutions that
can be adopted as part
of their cloud &
container strategy
21
Copyright © 2018 NuoDB
WHAT ARE CONTAINERS
+ Containers are a
virtualization
technology that
package application(s)
and required
dependencies – but
does not include an OS
+ More efficient than
VMs - allowing
customers to deploy
more containers on a
single system
BENEFITS OF CONTAINERS
Increased agility and
time to market by
enabling DevOps best
practices.
No vendor lock-in.
Containers are fully
portable across
environments, cloud
providers or hybrid.
Improve server
utilization by deploying
multiple containers on
as single server.
23
Copyright © 2018 NuoDB
DATABASE PATTERNS FOR CONTAINERS
24
` `
DB Outside
Containers
Data Cache +
DB Outside Containers
DB In Containers
25
CONTAINER CHALLENGES FOR DBs
Complex
Complex to setup and
multiple components
for HA & DR
Performance
Network and storage
abstraction layers
impact performance
Lockdown
DBs are locked
down and tightly
controlled
Coupled
Tightly coupled
with large scaled
servers
Copyright © 2018 NuoDB
IN CONTAINER VS CONTAINER NATIVE
26
+ Placing traditional SQL databases “in containers” does not make
them any more modern or agile
§ More efficient virtualization
§ Scale up architecture
+ Container native solutions leverage the native benefits of containers
and container management platforms
§ Increase developer productivity
§ Operational simplicity
§ Dynamic provisioning
§ Horizontal scale out
§ Server and location agnostic
Copyright © 2018 NuoDB
INTRODUCING NuoDB
27
NuoDB is the only container-native relational SQL database that enables
enterprise applications to run completely in a container platform
Elastic SQL
Elastic SQL: The benefits of Traditional
Databases & Containers
SQL
ACID
Zero
Downtime
Elastic
scale-out
Enterprise
Adoption
Containers,
Commodity
& Cloud
Traditional RDBMS
NoSQL
MARKET GAP
SQLACID Enterprise
Adoption
Zero
Downtime
Elastic
scale-out
Containers,
Commodity
& Cloud
Copyright © 2018 NuoDB
28
NuoDB DATABASE
Modern distributed, peer-to-peer
services acting as a single, logical
database
+ New modern database architecture
with independent database services
+ Services scale independently
and elastically
+ ANSI SQL interface
+ Deploy across containers,
clouds & data centers
+ Continuous availability for planned
and unplanned outages
Fast in-memory transaction
processing
with dynamic application
data affinity
Durable storage
management with
scale-out storage
NuoDB Architecture
Legacy RDBMS
Architecture
Storage
Query Processing
KEY IDEA #1: A DISTRIBUTED WORLD
29
1. Start with a client-server DBMS
2. Try to turn it into a Distributed System
1. Start with a Distributed System
2. Deliver database services on this system
DON’T DO
A single logical database
Complex add-ons and
processes to maintain
Copyright © 2018 NuoDB
KEY IDEA #2: CONTAINERIZED SERVICES
30
Separate transactions from storage
In-memory transactions
+ Transactions are executed fully
in-memory
+ No sharding / explicit
partitioning
Storage is redundant & flexible
+ Durable persistence
+ Automated replication
+ Each storage service can store a
full copy or a partition of the
data
Single logical database
+ Each services can be distributed across a single
cluster or across multiple clusters
+ Each service can be scaled independently
Copyright © 2018 NuoDB
KEY IDEA #3: SIMPLE, NO-KNOBS
31
Traditional DBs have 100s of
configuration parameters/settings
NuoDB is simple to start and
maintain
Copyright © 2018 NuoDB
NuoDB CONTAINER NATIVE ADVANTAGES
32
+ Increased developer agility
§ Provide self-service deployment, usage and operation (CD/CI)
+ Horizontal scale out performance
§ Full read/write scale out to address performance bottlenecks
§ Integrated in-memory cache for low latency access
+ Simplified operational model
§ Single platform for operations
§ Automated operations using RESTful APIS
§ Built-in HA/DR for a simpler solution
Copyright © 2018 NuoDB
DEVELOPER SELF-SERVICE AGILITY
33
+ Agile development requires developer self-service for
fast deployment, usage and operation
Developers cannot wait for DBAs or operations to provision a
database for developer use
Simple to start and manage
+ NuoDB can be easily integrated into developer CD/CI
pipelines so that developers can provision a database
within seconds
+ Simple configuration options
Copyright © 2018 NuoDB
HORIZONTAL SCALE-OUT PERFORMANCE
34
NuoDB is the only container-native SQL operational database
that provides read & write scale out
+ Container-native applications address scaling by deploying
additional containers (scale out)
+ Traditional SQL database use scale-up architectures
Only have read scale out
Copyright © 2018 NuoDB
HORIZONTAL SCALE-OUT PERFORMANCE
+ NuoDB allows
independent scale-out
of either compute or
storage tiers to
address different
workload use cases
Logging Application
+ Insert dominated
+ Scale-out storage tier
HTAP Application
+ Mixed read/write
+ Dedicated analytical nodes
OLTP Application
+ Mixed read/write
+ Scale-out compute & storage tiers
TE TE TE TE TE
SMSM
TE TE TE TE TE
SMSMSM SM
TE TE
SMSMSM SM
TE TE TE TE TE
SMSM
Web/Mobile Application
+ Read dominated
+ Scale-out compute tier
35
Copyright © 2018 NuoDB
IN-MEMORY CACHE PERFORMANCE
36
+ Data caching is commonly used
to improve latency and read
scalability
Used to off-load databases
+ Requires applications to manage cache and database
consistency (e.g. cache aside pattern)
Introduces another layer of complexity to application
development
Copyright © 2018 NuoDB
37
IN-MEMORY CACHE PERFORMANCE
+ NuoDB has an integrated caching layer
- Transaction Engines (TEs)
+ TEs are in-memory data caches that
can co-located with the service for low
latency data access
+ As a single logical database, NuoDB
automatically manages the cache
coherency between the caches and
storage (Storage Manager - SM)
TE TE TE
SM
Copyright © 2018 NuoDB
38
SIMPLIFIED OPERATIONS
+ Traditional SQL databases
have multiple add-ons to
support HA and DR
capabilities
+ Introduces additional
complexities in a
container environment
Copyright © 2018 NuoDB
39
SIMPLIFIED OPERATIONS
+ Since NuoDB is a
distributed database,
data replication for HA
and DR is part of the
database and naturally
fits in a container
environment
Copyright © 2018 NuoDB
SUMMARY
40
+ Enterprises struggle to fulfill the promises of Digital
Transformation for applications reliant on traditional SQL
databases
+ NuoDB is a modern, fully distributed and container-native
SQL database that allows enterprises to deploy
enterprise-critical applications completely within a
container platform
Copyright © 2018 NuoDB
THANK YOU!
41
The Elastic SQL Database facebook.com/nuodb/
@NuoDB
youtube.com/nuoDB
linkedin.com/company/nuodb
github.com/nuodb
NuoDB.com
FOLLOW US:

451 Research + NuoDB: What It Means to be a Container-Native SQL Database

  • 1.
    Copyright (C) 2018451 Research LLC What It Means to be a Container-Native SQL Database July 24, 2018 451 Research and NuoDB James Curtis 451 Research Ariff Kassam NuoDB
  • 2.
    James Curtis Senior Analyst,Data Platforms & Analytics 2 Ariff Kassam Vice President, Products
  • 3.
    Housekeeping Items: Questions? A copyof the presentation will be provided to all attendeesPresentation Slides Feedback To ask a question, click on the question button Don’t forget to leave feedback at the end of the webinar 3
  • 4.
    451 Research isa leading IT research & advisory company 4 Founded in 2000 300+ employees, including over 120 analysts 2,000+ clients: Technology & Service providers, corporate advisory, finance, professional services, and IT decision makers 70,000+ IT professionals, business users and consumers in our research community Over 52 million data points published each quarter and 4,500+ reports published each year 3,000+ technology & service providers under coverage 451 Research and its sister company, Uptime Institute, are the two divisions of The 451 Group Headquartered in New York City, with offices in London, Boston, San Francisco, Washington DC, Mexico, Costa Rica, Brazil, Spain, UAE, Russia, Taiwan, Singapore and Malaysia Research & Data Advisory Events Go 2 Market
  • 5.
    Digital Transformation: Whatdo we mean? 5 Copyright (C) 2016 451 Research LLC 3 Digital Transformation is the investment in new digital technologies and processes to not only more effectively engage customers, partners or employees, but to also cut costs.
  • 6.
    Digital transformation isreal and happening now 6 42% 28% 20% 10% Execution. We have a formal strategy and are actively digitizing our business processes and/or assets. Evaluation. We are planning and researching to develop a digital transformation strategy. Consideration. We areconsidering it, but have no formal plans. No strategy. We currently have no digital transformation strategy. % of respondents (n=1002) Source: 451 Research, Voice of the Enterprise: Digital Pulse, Workloads and Key Projects 2018
  • 7.
    What exactly needsto be digitally transformed? Process Transformation Information Transformation Platform Transformation § More than a technical shift, but a cultural one § Focus on collaboration—employees but also customers, partners, suppliers § Agile methods for software development § Gathering data and lots of it in various means and methods § Multiple communication points on multiple devices § Leveraging data with advanced analytics § IT moving from cost center to software enabler § Organizations needs systems of engagement—tools and systems for omnichannel interaction § Integration with legacy systems of record 7
  • 8.
    When considering adigital transformation, enterprises often need to… 8 Handle Growth Steady and Seasonal Manage Costs Now and Future Minimize Friction Adoption and Adjustment
  • 9.
    ▪ NewSQL databases:29% CAGR ▪ Traditional relational databases: 6% CAGR 9 Handle Growth Manage Costs Minimal Friction Database growth expected for relational databases 2017-22 Combined 6.4% 2017-22 CAGR Source: 451 Research, Total Data: Platforms & Analytics, May 2018.
  • 10.
    10 Handle Growth Manage Costs Minimal Friction Database revenue growthby execution 2016-21 Source: 451 Research’s Total Data Market Monitor, May 2018, and Voice of the Enterprise Cloud Transformation, Workloads and Key Projects 2017
  • 11.
    11 Handle Growth Manage Costs Minimal Friction Great expectations forreduced costs in cloud adoption Source: 451 Research, The Cloud Transformation Journey, February 2018.
  • 12.
    12 Handle Growth Manage Costs Minimal Friction But the cloudis a journey…. Source: 451 Research, The Cloud Transformation Journey, February 2018.
  • 13.
    13 Handle Growth Manage Costs Minimal Friction Maintain existing skills §New technologies such as MapReduce and Hadoop garnered a lot of attention due to the flexibility they enable for large-scale data processing § But no one stopped using SQL § SQL isn’t back – it never went away
  • 14.
    14 Handle Growth Manage Costs Minimal Friction Examine existing technologies ▪Traditional relational DBMS can get stretched beyond their normal capacity by the needs of high- volume, highly distributed applications ▪ Modern relational DBMS provide scalability while also enabling ACID guarantees for transactions
  • 15.
    But enterprises alsoworry about the future 15 In addition to… Enterprise want to…. Handle Growth Manage Costs Minimal Friction Build for the Future Invest and Future Proof
  • 16.
    16 Containers will playkey role for digital transformations § Enable packaging/deploying of applications § Enables spin-up/down of applications and/or services § Reduce provisioning times § Easy to move around as needed § Open source development and growing community support
  • 17.
    3 Containers adoption ismodest, but expected to grow Source: 451 Research, Storage: Workloads and Key Projects, 2018
  • 18.
    18 Containers are nowbeing deployed for databases § Innovations in container technology are emerging that allow for persistence storage for stateful applications § Vendors are merging containers with data workflows as a means to tackle digital transformation efforts § Enterprises are becoming increasingly comfortable with databases running on cloud infrastructure
  • 19.
  • 20.
  • 21.
    DIGITAL TRANSFORMATION IT departmentsmust become more agile so that enterprises can quickly respond to changing customer, competitive and business demands Traditional SQL database solutions anchor enterprise- critical application architectures and processes in the past To fully realize the benefits of Digital Transformation, enterprises need SQL database solutions that can be adopted as part of their cloud & container strategy 21
  • 22.
    Copyright © 2018NuoDB WHAT ARE CONTAINERS + Containers are a virtualization technology that package application(s) and required dependencies – but does not include an OS + More efficient than VMs - allowing customers to deploy more containers on a single system
  • 23.
    BENEFITS OF CONTAINERS Increasedagility and time to market by enabling DevOps best practices. No vendor lock-in. Containers are fully portable across environments, cloud providers or hybrid. Improve server utilization by deploying multiple containers on as single server. 23
  • 24.
    Copyright © 2018NuoDB DATABASE PATTERNS FOR CONTAINERS 24 ` ` DB Outside Containers Data Cache + DB Outside Containers DB In Containers
  • 25.
    25 CONTAINER CHALLENGES FORDBs Complex Complex to setup and multiple components for HA & DR Performance Network and storage abstraction layers impact performance Lockdown DBs are locked down and tightly controlled Coupled Tightly coupled with large scaled servers
  • 26.
    Copyright © 2018NuoDB IN CONTAINER VS CONTAINER NATIVE 26 + Placing traditional SQL databases “in containers” does not make them any more modern or agile § More efficient virtualization § Scale up architecture + Container native solutions leverage the native benefits of containers and container management platforms § Increase developer productivity § Operational simplicity § Dynamic provisioning § Horizontal scale out § Server and location agnostic
  • 27.
    Copyright © 2018NuoDB INTRODUCING NuoDB 27 NuoDB is the only container-native relational SQL database that enables enterprise applications to run completely in a container platform Elastic SQL Elastic SQL: The benefits of Traditional Databases & Containers SQL ACID Zero Downtime Elastic scale-out Enterprise Adoption Containers, Commodity & Cloud Traditional RDBMS NoSQL MARKET GAP SQLACID Enterprise Adoption Zero Downtime Elastic scale-out Containers, Commodity & Cloud
  • 28.
    Copyright © 2018NuoDB 28 NuoDB DATABASE Modern distributed, peer-to-peer services acting as a single, logical database + New modern database architecture with independent database services + Services scale independently and elastically + ANSI SQL interface + Deploy across containers, clouds & data centers + Continuous availability for planned and unplanned outages Fast in-memory transaction processing with dynamic application data affinity Durable storage management with scale-out storage NuoDB Architecture Legacy RDBMS Architecture Storage Query Processing
  • 29.
    KEY IDEA #1:A DISTRIBUTED WORLD 29 1. Start with a client-server DBMS 2. Try to turn it into a Distributed System 1. Start with a Distributed System 2. Deliver database services on this system DON’T DO A single logical database Complex add-ons and processes to maintain
  • 30.
    Copyright © 2018NuoDB KEY IDEA #2: CONTAINERIZED SERVICES 30 Separate transactions from storage In-memory transactions + Transactions are executed fully in-memory + No sharding / explicit partitioning Storage is redundant & flexible + Durable persistence + Automated replication + Each storage service can store a full copy or a partition of the data Single logical database + Each services can be distributed across a single cluster or across multiple clusters + Each service can be scaled independently
  • 31.
    Copyright © 2018NuoDB KEY IDEA #3: SIMPLE, NO-KNOBS 31 Traditional DBs have 100s of configuration parameters/settings NuoDB is simple to start and maintain
  • 32.
    Copyright © 2018NuoDB NuoDB CONTAINER NATIVE ADVANTAGES 32 + Increased developer agility § Provide self-service deployment, usage and operation (CD/CI) + Horizontal scale out performance § Full read/write scale out to address performance bottlenecks § Integrated in-memory cache for low latency access + Simplified operational model § Single platform for operations § Automated operations using RESTful APIS § Built-in HA/DR for a simpler solution
  • 33.
    Copyright © 2018NuoDB DEVELOPER SELF-SERVICE AGILITY 33 + Agile development requires developer self-service for fast deployment, usage and operation Developers cannot wait for DBAs or operations to provision a database for developer use Simple to start and manage + NuoDB can be easily integrated into developer CD/CI pipelines so that developers can provision a database within seconds + Simple configuration options
  • 34.
    Copyright © 2018NuoDB HORIZONTAL SCALE-OUT PERFORMANCE 34 NuoDB is the only container-native SQL operational database that provides read & write scale out + Container-native applications address scaling by deploying additional containers (scale out) + Traditional SQL database use scale-up architectures Only have read scale out
  • 35.
    Copyright © 2018NuoDB HORIZONTAL SCALE-OUT PERFORMANCE + NuoDB allows independent scale-out of either compute or storage tiers to address different workload use cases Logging Application + Insert dominated + Scale-out storage tier HTAP Application + Mixed read/write + Dedicated analytical nodes OLTP Application + Mixed read/write + Scale-out compute & storage tiers TE TE TE TE TE SMSM TE TE TE TE TE SMSMSM SM TE TE SMSMSM SM TE TE TE TE TE SMSM Web/Mobile Application + Read dominated + Scale-out compute tier 35
  • 36.
    Copyright © 2018NuoDB IN-MEMORY CACHE PERFORMANCE 36 + Data caching is commonly used to improve latency and read scalability Used to off-load databases + Requires applications to manage cache and database consistency (e.g. cache aside pattern) Introduces another layer of complexity to application development
  • 37.
    Copyright © 2018NuoDB 37 IN-MEMORY CACHE PERFORMANCE + NuoDB has an integrated caching layer - Transaction Engines (TEs) + TEs are in-memory data caches that can co-located with the service for low latency data access + As a single logical database, NuoDB automatically manages the cache coherency between the caches and storage (Storage Manager - SM) TE TE TE SM
  • 38.
    Copyright © 2018NuoDB 38 SIMPLIFIED OPERATIONS + Traditional SQL databases have multiple add-ons to support HA and DR capabilities + Introduces additional complexities in a container environment
  • 39.
    Copyright © 2018NuoDB 39 SIMPLIFIED OPERATIONS + Since NuoDB is a distributed database, data replication for HA and DR is part of the database and naturally fits in a container environment
  • 40.
    Copyright © 2018NuoDB SUMMARY 40 + Enterprises struggle to fulfill the promises of Digital Transformation for applications reliant on traditional SQL databases + NuoDB is a modern, fully distributed and container-native SQL database that allows enterprises to deploy enterprise-critical applications completely within a container platform
  • 41.
    Copyright © 2018NuoDB THANK YOU! 41 The Elastic SQL Database facebook.com/nuodb/ @NuoDB youtube.com/nuoDB linkedin.com/company/nuodb github.com/nuodb NuoDB.com FOLLOW US: