Confidential │ ©2019 VMware, Inc.
Running DataStax
Enterprise on
VMware Cloud and
Hybrid Environments
August 2019
Confidential │ ©2019 VMware, Inc. 22
VMware Cloud Hybrid Launch2019
vSAN for Development and Test2017
vSAN for DSE Production Launch2018100+Joint Customers Using
our Products Together
• DataStax Accelerate - Hybrid Demo
• Recommended more deployment options with DSE running on
vSAN
• Production deployment recommendations
• Press Release, Technical White Paper
• VMworld 2018 - Blog, Solution Brief, Session
• Technical White Paper on performance and operational tests
of DSE on VSAN
• Recommended DSE on vSAN for Dev/Test Environment
• VMworld 2017: Blogs, Solution Brief
3Confidential │ ©2019 VMware, Inc.
VMware & vSAN
Confidential │ ©2019 VMware, Inc. 4
VMware Delivers Industry-Leading Software for HCI
Natively integrated for
mission-critical apps
Industry-leading
deployment flexibility
Consistent operations
edge to core to cloud
ALL AVAILABLE TODAY
vSphere vSAN
Confidential │ ©2019 VMware, Inc. 5
Private CloudEdge Public Cloud
Cloud Native AppsTraditional Apps
vRealize Suite
vSphere vSAN NSX
VMware
Cloud
Foundation
VMware Expands HCI software to Full Stack
Confidential │ ©2019 VMware, Inc. 6
VMware HCI Powers Any Application, Anywhere
Containers
EUC
Cloud-NativeBusiness-Critical
Confidential │ ©2019 VMware, Inc. 7
The VMware Open Ecosystem Offers Flexibility for Customers
Partner-Managed Cloud
vSAN
ReadyNodes
Integrated
Systems
Engineered
Appliances
VMware Cloud on Dell EMC
Customer-Managed Private Cloud
VMware-Managed
Private Cloud
VMware Cloud on AWS
Public Cloud
Confidential │ ©2019 VMware, Inc. 8
Infrastructure Modernization at Your Own Pace
Core HCI
vSAN + vSphere
Full Stack HCI
Cloud Foundation
Hybrid Cloud
VMware Cloud on AWS
Easy Agility
Fully Automated Private
Cloud
Consistent Operations
On-prem and Off-prem
Confidential │ ©2019 VMware, Inc. 9
Market Overview
vSAN Achieves
20,000
Customers
Announced in the
last earnings call
vSAN the Market
Leading HCI
Software
41.1% Market Share
in the Latest IDC
Report
vSAN Awards
Gartner Peer
Insights Customer’s
Choice
DataStax Partner of
the Year
2019
10Confidential │ ©2019 VMware, Inc.
Why DataStax and
VMware?
Confidential │ ©2019 VMware, Inc. 11
DataStax and Cassandra Early Adopters
Pain Points
● Data Modeling Learning
Curve
● SSD Required for Realistic
Performance
● Scale-out Only
● Minimal separation of
operator and developer tasks
● Management of more
hardware
11
Limited in Scale and
Geo-Distribution
Limitless Scale and
Geo-Distribution
Confidential │ ©2019 VMware, Inc. 12
Pain Points
● Data Modeling Learning Curve
● SSD Required for Realistic Performance
● Scale-out Only
● Minimal separation of operator and
developer tasks
● Management of more hardware
VMware Benefits
VMware Product Solutions
● vSAN Storage Management with
expandable capacity
● Add more CPU, DRAM, Bandwidth to nodes
● VMotion, OS Snapshots
● Full Stack HA/Failover
13Confidential │ ©2019 VMware, Inc.
Solution Architecture
Confidential │ ©2019 VMware, Inc. 14
Extending DataStax Enterprise on vSAN to the cloud
Unified management platform
for hybrid cloud & multi-cloud
Efficiently support your high
speed workloads
Scale up and out based on
application needs
Support Application HA
requirements
Next-Gen Node
vSphere vSAN
vSAN Datastore
Next-Gen Node
DSE DSE
Confidential │ ©2019 VMware, Inc. 15
DSE/DDAC Fit in VMware Cloud Foundation Architecture
Private
Cloud
Edge Public
Cloud
Traditional Apps
vRealize Suite
vSphere vSAN NSX
VMware
Cloud
Foundation
Confidential │ ©2019 VMware, Inc. 16
DSE/DDAC Fit in VMware Cloud Foundation Architecture
Private
Cloud
Edge Public
Cloud
Cloud Native AppsTraditional Apps
vRealize Suite
vSphere vSAN NSX
VMware
Cloud
Foundation
Confidential │ ©2019 VMware, Inc. 17
DSE/DDAC Fit in VMware Cloud Foundation Architecture
Private
Cloud
Edge Public
Cloud
Cloud Native AppsTraditional Apps
vRealize Suite
vSphere vSAN NSX
VMware
Cloud
Foundation
Confidential │ ©2019 VMware, Inc. 18
DSE/DDAC Fit in VMware Cloud Foundation Architecture
Private
Cloud
Edge Public
Cloud
Cloud Native AppsTraditional Apps
vRealize Suite
vSphere vSAN NSX
VMware
Cloud
Foundation
DSE
VM
Confidential │ ©2019 VMware, Inc. 19
vRealize Suite
20Confidential │ ©2019 VMware, Inc.
Deployment Options
Confidential │ ©2019 VMware, Inc. 21
Hybrid Cloud Deployment Scenarios
21
Hybrid –
Bursting or
Active
Active
On Premises
Production
Hybrid –
Dev/Test
VMware
Cloud
Dev/Test
Hybrid–
Discrete
Workloads
VMware
Cloud
App 1
(workload)
On Premises
App 1(auth)
On Premises
App 1 (full)
VMware
Cloud
App 1
(full)
Confidential │ ©2019 VMware, Inc. 22
Hybrid Cloud to Multi-Cloud
22
On Premises
Multi-Cloud
VMware
Cloud
(AWS)
VMware
Cloud
(Azure)
On Premises
Hybrid Cloud
VMware Cloud
(AWS US
West)
VMware Cloud
(AWS US
East)
23Confidential │ ©2019 VMware, Inc.
The Burning Storage Questions
Confidential │ ©2019 VMware, Inc. 24
The Past – Bare Metal VSphere
Logs DATA
OS
Logs
OS
DATA
z
DATA
Logs
OS Logs
DATA
OS
Logs
Logs
OS
DATADATA
OS
DATA
DATA DATA
DATA
DATA
DATA
Host 1 Host 2
Configuration
• Drives directly mapped to VM’s or
• Drives exposed as storage volume in
ESXi
Pros
• Very Fast
Cons
• More manual effort to upgrade a host
• Host failure requires manual effort
from DB and Infrastructure teams
• No intelligent resource management
• DB is managed in one-off
configuration from other Enterprise
Apps
Confidential │ ©2019 VMware, Inc. 25
Current vSAN Solutions
Logs DATA
OS
Logs
OS
DATA
z
DATA
Logs
OS
Logs DATA
OS
Logs
Logs
OS
DATA
DATA
OS
DATA
DATA DATA
DATA
DATA
DATA
Host 1 Host 2
Configuration
• vSAN Manages Storage and allocation
of storage for VM’s
Pros
• Additional Management Options
• Vmotion for Upgrades
• Automated failover for OS and
Storage
Cons
• Optimizing for performance (FTT=0)
requires more complex architecture
• Optimizing for Ease-of-Management
(FTT=1) requires additional capacity
NVMe Cache NVMe Cache
NVMe Cache NVMe Cache
Confidential │ ©2019 VMware, Inc. 26
Benefits Tradeoffs Availability Configuration
FTT=0 Performance (Fast).
No additional
storage compared to
Cassandra bare-
metal
Requires careful
planning. Disk
failures can
require more
frequent node
rebuilds
Available today
in all vSAN
multi-cluster
deployments
(minimum 3).
OS, Logs and
Data configured
with FTT=0.
Storage may not
be on the same
node as compute
FTT=0 with
Host
Affinity
Performance
(Faster). No
additional storage
compared to
Cassandra bare-
metal
Non-GA solution Potential future
availability in
Kubernetized
service model
OS, Logs and
Data configured
with FTT=0 with
Host Affinity.
Storage local to
VM’s
FTT=1 Simple management,
HA, V-Motion, DRS
available
Minimal tradeoff
in performance.
Requires 2x
Storage
Available today
in all vSAN
offerings
OS, Logs and
Data configured
with FTT=1
Combined Probable reduction Requires careful Available today OS configured
vSAN Solutions
Confidential │ ©2019 VMware, Inc. 27
Confidential │ ©2019 VMware, Inc. 28
Confidential │ ©2019 VMware, Inc. 29
Future Product Suite Integrations
Confidential │ ©2019 VMware, Inc. 30
Good Performance – vSAN & Vsphere Management Features – Requires Careful Planning
The Present – FTT=0
Logs
DAT
A
Logs
OS
Logs
DAT
A
OS
DAT
A
OS
Logs
DAT
A
LogsOS
Logs
OS
DAT
A
DAT
A
OS
Logs
DAT
A
Logs
OS
Logs
OS
DAT
A
DAT
A
OS
Logs
DAT
A
Logs
OS
Logs
OS
DAT
A
DAT
A
OS
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
Host 1
NVMe Cache
NVMe Cache
Host 2
NVMe Cache
NVMe Cache
Host 3
NVMe Cache
NVMe Cache
Host 4
NVMe Cache
NVMe Cache
Confidential │ ©2019 VMware, Inc. 31
FTT Review
FTT – Failures to Tolerate – Number
of hosts which can be lost without
losing VMware’s known copy of the
data
Copies of Data on
VSAN
FTT 0 1
FTT 1 2
FTT 2 3
cachecache
capacity
capacity
capacity
capacity
capacity
capacity
capacity
capacity
capacity
capacity
capacity
capacity
HOST 1 HOST 2
Node1-data Node2-data
Node1-log
Node1-OS
Node2-log
Node2-OS
Node1-data
Node1-log
Node2-data
Node2-log
Node2-OS Node1-OS
FTT=1
*this is just an example and doesn’t meet
minimum host requirements
Confidential │ ©2019 VMware, Inc. 32
VSAN Cluster 1 VSAN Cluster
2
DSE RACK
1
Datacenter
1
VSAN Cluster
3
VSAN Cluster
4
DSE RACK
2
DSE RACK
3
DSE RACK
4
FTT=0 or FTT=1
Confidential │ ©2019 VMware, Inc. 33
VSAN Cluster 1 VSAN Cluster
2
DSE RACK
1
Datacenter
1
VSAN Cluster
3
VSAN Cluster
4
DSE RACK
2
DSE RACK
3
DSE RACK
4
Confidential │ ©2019 VMware, Inc. 34
VSAN Cluster 1 VSAN Cluster
2
DSE RACK
1
Datacenter
1
VSAN Cluster
3
VSAN Cluster
4
DSE RACK
2
DSE RACK
3
DSE RACK
4
Confidential │ ©2019 VMware, Inc. 35
VSAN Cluster 1 VSAN Cluster
2
DSE RACK
1
Datacenter
1
VSAN Cluster
3
VSAN Cluster
4
DSE RACK
2
DSE RACK
3
DSE RACK
4
Confidential │ ©2019 VMware, Inc. 36
VSAN Cluster 1 VSAN Cluster
2
DSE RACK
1
Datacenter
1
VSAN Cluster
3
VSAN Cluster
4
DSE RACK
2
DSE RACK
3
DSE RACK
4
Confidential │ ©2019 VMware, Inc. 37
VSAN Cluster 1 VSAN Cluster
2
DSE RACK
1
Datacenter
1
VSAN Cluster
3
VSAN Cluster
4
DSE RACK
2
DSE RACK
3
DSE RACK
4
38Confidential │ ©2019 VMware, Inc.
Future
Confidential │ ©2019 VMware, Inc. 39
Host 4
NVMe Cache
NVMe Cache
Host 3
NVMe Cache
NVMe Cache
Host 2
NVMe Cache
NVMe Cache
Host 1
NVMe Cache
NVMe Cache
Good Performance – Great Management Options – DBAs and Admins Hug and then Hug Again
The Future – FTT=0 with Host Affinity
Logs
DAT
A
Logs
OS
Logs
DAT
A
OS
DAT
A
OS
Logs
DAT
A
LogsOS
Logs
OS
DAT
A
DAT
A
OS
Logs
DAT
A
Logs
OS
Logs
OS
DAT
A
DAT
A
OS
Logs
DAT
A
Logs
OS
Logs
OS
DAT
A
DAT
A
OS
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
DAT
A
Confidential │ ©2019 VMware, Inc. 40
Future Product Suite Integrations
Confidential │ ©2019 VMware, Inc. 41
Future Cloud Native Strategy
Won the
Orchestration War
Won the
Enterprise
Won Data
Distribution & Scale
42Confidential │ ©2019 VMware, Inc.
Conclusions
42
43Confidential │ ©2019 VMware, Inc.
DataStax & VMware have
validated vSAN for
DataStax Enterprise
production support on
premises, in VMware
Cloud, and between the
two.
Confidential │ ©2019 VMware, Inc. 44
OS, Logs and Data on FTT=1, discreet/multi vSphere/vSAN clusters per DSE rack definition
• Mimics what largest customers are doing, provides highest availability at the cost of 2x capacity
overhead per DSE datacenter
OS and Logs on FTT=1, Data on FTT=0, discreet/multi vSphere/vSAN clusters per DSE rack
definition
• Enterprise blend of availability and capacity savings. Single permanent disk failure means some data
VMDKs will need to be recreated followed by DSE rebuild methodologies.
Approved Solutions
45Confidential │ ©2019 VMware, Inc.
Backup
45
Confidential │ ©2019 VMware, Inc. 4646
VMware Cloud Hybrid Launch
DataStax Accelerate - Hybrid Demo/Talk.
Recommend multiple DSE nodes per host.
Recommend vSAN with or without host affinity.
2019
vSAN for Development and Test2017
vSAN for Production Launch
VMworld 2018 - Blog, Solution Brief, VMworld Talk,
Press Release, Technical White Paper and
Enablement on production testing results and
recommendations
2018
VMworld 2017 Focus: Blogs, Solution Brief and
Technical White Paper (published 1/2018) detailing
performance and operational tests of DSE on VSAN
100+Joint Customers Using
our Products Together
Confidential │ ©2019 VMware, Inc. 47
Extending DataStax Enterprise on vSAN to the cloud
Unified management platform
for hybrid cloud & multi-cloud
Efficiently support your high
speed workloads
Scale up and out based on
application needs
Support Application HA
requirements
Next-Gen Node
vSphere vSAN
vSAN Datastore
Next-Gen Node
DSE DSE
Confidential │ ©2019 VMware, Inc.
Thank You

Running DataStax Enterprise in VMware Cloud and Hybrid Environments

  • 1.
    Confidential │ ©2019VMware, Inc. Running DataStax Enterprise on VMware Cloud and Hybrid Environments August 2019
  • 2.
    Confidential │ ©2019VMware, Inc. 22 VMware Cloud Hybrid Launch2019 vSAN for Development and Test2017 vSAN for DSE Production Launch2018100+Joint Customers Using our Products Together • DataStax Accelerate - Hybrid Demo • Recommended more deployment options with DSE running on vSAN • Production deployment recommendations • Press Release, Technical White Paper • VMworld 2018 - Blog, Solution Brief, Session • Technical White Paper on performance and operational tests of DSE on VSAN • Recommended DSE on vSAN for Dev/Test Environment • VMworld 2017: Blogs, Solution Brief
  • 3.
    3Confidential │ ©2019VMware, Inc. VMware & vSAN
  • 4.
    Confidential │ ©2019VMware, Inc. 4 VMware Delivers Industry-Leading Software for HCI Natively integrated for mission-critical apps Industry-leading deployment flexibility Consistent operations edge to core to cloud ALL AVAILABLE TODAY vSphere vSAN
  • 5.
    Confidential │ ©2019VMware, Inc. 5 Private CloudEdge Public Cloud Cloud Native AppsTraditional Apps vRealize Suite vSphere vSAN NSX VMware Cloud Foundation VMware Expands HCI software to Full Stack
  • 6.
    Confidential │ ©2019VMware, Inc. 6 VMware HCI Powers Any Application, Anywhere Containers EUC Cloud-NativeBusiness-Critical
  • 7.
    Confidential │ ©2019VMware, Inc. 7 The VMware Open Ecosystem Offers Flexibility for Customers Partner-Managed Cloud vSAN ReadyNodes Integrated Systems Engineered Appliances VMware Cloud on Dell EMC Customer-Managed Private Cloud VMware-Managed Private Cloud VMware Cloud on AWS Public Cloud
  • 8.
    Confidential │ ©2019VMware, Inc. 8 Infrastructure Modernization at Your Own Pace Core HCI vSAN + vSphere Full Stack HCI Cloud Foundation Hybrid Cloud VMware Cloud on AWS Easy Agility Fully Automated Private Cloud Consistent Operations On-prem and Off-prem
  • 9.
    Confidential │ ©2019VMware, Inc. 9 Market Overview vSAN Achieves 20,000 Customers Announced in the last earnings call vSAN the Market Leading HCI Software 41.1% Market Share in the Latest IDC Report vSAN Awards Gartner Peer Insights Customer’s Choice DataStax Partner of the Year 2019
  • 10.
    10Confidential │ ©2019VMware, Inc. Why DataStax and VMware?
  • 11.
    Confidential │ ©2019VMware, Inc. 11 DataStax and Cassandra Early Adopters Pain Points ● Data Modeling Learning Curve ● SSD Required for Realistic Performance ● Scale-out Only ● Minimal separation of operator and developer tasks ● Management of more hardware 11 Limited in Scale and Geo-Distribution Limitless Scale and Geo-Distribution
  • 12.
    Confidential │ ©2019VMware, Inc. 12 Pain Points ● Data Modeling Learning Curve ● SSD Required for Realistic Performance ● Scale-out Only ● Minimal separation of operator and developer tasks ● Management of more hardware VMware Benefits VMware Product Solutions ● vSAN Storage Management with expandable capacity ● Add more CPU, DRAM, Bandwidth to nodes ● VMotion, OS Snapshots ● Full Stack HA/Failover
  • 13.
    13Confidential │ ©2019VMware, Inc. Solution Architecture
  • 14.
    Confidential │ ©2019VMware, Inc. 14 Extending DataStax Enterprise on vSAN to the cloud Unified management platform for hybrid cloud & multi-cloud Efficiently support your high speed workloads Scale up and out based on application needs Support Application HA requirements Next-Gen Node vSphere vSAN vSAN Datastore Next-Gen Node DSE DSE
  • 15.
    Confidential │ ©2019VMware, Inc. 15 DSE/DDAC Fit in VMware Cloud Foundation Architecture Private Cloud Edge Public Cloud Traditional Apps vRealize Suite vSphere vSAN NSX VMware Cloud Foundation
  • 16.
    Confidential │ ©2019VMware, Inc. 16 DSE/DDAC Fit in VMware Cloud Foundation Architecture Private Cloud Edge Public Cloud Cloud Native AppsTraditional Apps vRealize Suite vSphere vSAN NSX VMware Cloud Foundation
  • 17.
    Confidential │ ©2019VMware, Inc. 17 DSE/DDAC Fit in VMware Cloud Foundation Architecture Private Cloud Edge Public Cloud Cloud Native AppsTraditional Apps vRealize Suite vSphere vSAN NSX VMware Cloud Foundation
  • 18.
    Confidential │ ©2019VMware, Inc. 18 DSE/DDAC Fit in VMware Cloud Foundation Architecture Private Cloud Edge Public Cloud Cloud Native AppsTraditional Apps vRealize Suite vSphere vSAN NSX VMware Cloud Foundation DSE VM
  • 19.
    Confidential │ ©2019VMware, Inc. 19 vRealize Suite
  • 20.
    20Confidential │ ©2019VMware, Inc. Deployment Options
  • 21.
    Confidential │ ©2019VMware, Inc. 21 Hybrid Cloud Deployment Scenarios 21 Hybrid – Bursting or Active Active On Premises Production Hybrid – Dev/Test VMware Cloud Dev/Test Hybrid– Discrete Workloads VMware Cloud App 1 (workload) On Premises App 1(auth) On Premises App 1 (full) VMware Cloud App 1 (full)
  • 22.
    Confidential │ ©2019VMware, Inc. 22 Hybrid Cloud to Multi-Cloud 22 On Premises Multi-Cloud VMware Cloud (AWS) VMware Cloud (Azure) On Premises Hybrid Cloud VMware Cloud (AWS US West) VMware Cloud (AWS US East)
  • 23.
    23Confidential │ ©2019VMware, Inc. The Burning Storage Questions
  • 24.
    Confidential │ ©2019VMware, Inc. 24 The Past – Bare Metal VSphere Logs DATA OS Logs OS DATA z DATA Logs OS Logs DATA OS Logs Logs OS DATADATA OS DATA DATA DATA DATA DATA DATA Host 1 Host 2 Configuration • Drives directly mapped to VM’s or • Drives exposed as storage volume in ESXi Pros • Very Fast Cons • More manual effort to upgrade a host • Host failure requires manual effort from DB and Infrastructure teams • No intelligent resource management • DB is managed in one-off configuration from other Enterprise Apps
  • 25.
    Confidential │ ©2019VMware, Inc. 25 Current vSAN Solutions Logs DATA OS Logs OS DATA z DATA Logs OS Logs DATA OS Logs Logs OS DATA DATA OS DATA DATA DATA DATA DATA DATA Host 1 Host 2 Configuration • vSAN Manages Storage and allocation of storage for VM’s Pros • Additional Management Options • Vmotion for Upgrades • Automated failover for OS and Storage Cons • Optimizing for performance (FTT=0) requires more complex architecture • Optimizing for Ease-of-Management (FTT=1) requires additional capacity NVMe Cache NVMe Cache NVMe Cache NVMe Cache
  • 26.
    Confidential │ ©2019VMware, Inc. 26 Benefits Tradeoffs Availability Configuration FTT=0 Performance (Fast). No additional storage compared to Cassandra bare- metal Requires careful planning. Disk failures can require more frequent node rebuilds Available today in all vSAN multi-cluster deployments (minimum 3). OS, Logs and Data configured with FTT=0. Storage may not be on the same node as compute FTT=0 with Host Affinity Performance (Faster). No additional storage compared to Cassandra bare- metal Non-GA solution Potential future availability in Kubernetized service model OS, Logs and Data configured with FTT=0 with Host Affinity. Storage local to VM’s FTT=1 Simple management, HA, V-Motion, DRS available Minimal tradeoff in performance. Requires 2x Storage Available today in all vSAN offerings OS, Logs and Data configured with FTT=1 Combined Probable reduction Requires careful Available today OS configured vSAN Solutions
  • 27.
    Confidential │ ©2019VMware, Inc. 27
  • 28.
    Confidential │ ©2019VMware, Inc. 28
  • 29.
    Confidential │ ©2019VMware, Inc. 29 Future Product Suite Integrations
  • 30.
    Confidential │ ©2019VMware, Inc. 30 Good Performance – vSAN & Vsphere Management Features – Requires Careful Planning The Present – FTT=0 Logs DAT A Logs OS Logs DAT A OS DAT A OS Logs DAT A LogsOS Logs OS DAT A DAT A OS Logs DAT A Logs OS Logs OS DAT A DAT A OS Logs DAT A Logs OS Logs OS DAT A DAT A OS DAT A DAT A DAT A DAT A DAT A DAT A DAT A DAT A DAT A DAT A DAT A DAT A Host 1 NVMe Cache NVMe Cache Host 2 NVMe Cache NVMe Cache Host 3 NVMe Cache NVMe Cache Host 4 NVMe Cache NVMe Cache
  • 31.
    Confidential │ ©2019VMware, Inc. 31 FTT Review FTT – Failures to Tolerate – Number of hosts which can be lost without losing VMware’s known copy of the data Copies of Data on VSAN FTT 0 1 FTT 1 2 FTT 2 3 cachecache capacity capacity capacity capacity capacity capacity capacity capacity capacity capacity capacity capacity HOST 1 HOST 2 Node1-data Node2-data Node1-log Node1-OS Node2-log Node2-OS Node1-data Node1-log Node2-data Node2-log Node2-OS Node1-OS FTT=1 *this is just an example and doesn’t meet minimum host requirements
  • 32.
    Confidential │ ©2019VMware, Inc. 32 VSAN Cluster 1 VSAN Cluster 2 DSE RACK 1 Datacenter 1 VSAN Cluster 3 VSAN Cluster 4 DSE RACK 2 DSE RACK 3 DSE RACK 4 FTT=0 or FTT=1
  • 33.
    Confidential │ ©2019VMware, Inc. 33 VSAN Cluster 1 VSAN Cluster 2 DSE RACK 1 Datacenter 1 VSAN Cluster 3 VSAN Cluster 4 DSE RACK 2 DSE RACK 3 DSE RACK 4
  • 34.
    Confidential │ ©2019VMware, Inc. 34 VSAN Cluster 1 VSAN Cluster 2 DSE RACK 1 Datacenter 1 VSAN Cluster 3 VSAN Cluster 4 DSE RACK 2 DSE RACK 3 DSE RACK 4
  • 35.
    Confidential │ ©2019VMware, Inc. 35 VSAN Cluster 1 VSAN Cluster 2 DSE RACK 1 Datacenter 1 VSAN Cluster 3 VSAN Cluster 4 DSE RACK 2 DSE RACK 3 DSE RACK 4
  • 36.
    Confidential │ ©2019VMware, Inc. 36 VSAN Cluster 1 VSAN Cluster 2 DSE RACK 1 Datacenter 1 VSAN Cluster 3 VSAN Cluster 4 DSE RACK 2 DSE RACK 3 DSE RACK 4
  • 37.
    Confidential │ ©2019VMware, Inc. 37 VSAN Cluster 1 VSAN Cluster 2 DSE RACK 1 Datacenter 1 VSAN Cluster 3 VSAN Cluster 4 DSE RACK 2 DSE RACK 3 DSE RACK 4
  • 38.
    38Confidential │ ©2019VMware, Inc. Future
  • 39.
    Confidential │ ©2019VMware, Inc. 39 Host 4 NVMe Cache NVMe Cache Host 3 NVMe Cache NVMe Cache Host 2 NVMe Cache NVMe Cache Host 1 NVMe Cache NVMe Cache Good Performance – Great Management Options – DBAs and Admins Hug and then Hug Again The Future – FTT=0 with Host Affinity Logs DAT A Logs OS Logs DAT A OS DAT A OS Logs DAT A LogsOS Logs OS DAT A DAT A OS Logs DAT A Logs OS Logs OS DAT A DAT A OS Logs DAT A Logs OS Logs OS DAT A DAT A OS DAT A DAT A DAT A DAT A DAT A DAT A DAT A DAT A DAT A DAT A DAT A DAT A
  • 40.
    Confidential │ ©2019VMware, Inc. 40 Future Product Suite Integrations
  • 41.
    Confidential │ ©2019VMware, Inc. 41 Future Cloud Native Strategy Won the Orchestration War Won the Enterprise Won Data Distribution & Scale
  • 42.
    42Confidential │ ©2019VMware, Inc. Conclusions 42
  • 43.
    43Confidential │ ©2019VMware, Inc. DataStax & VMware have validated vSAN for DataStax Enterprise production support on premises, in VMware Cloud, and between the two.
  • 44.
    Confidential │ ©2019VMware, Inc. 44 OS, Logs and Data on FTT=1, discreet/multi vSphere/vSAN clusters per DSE rack definition • Mimics what largest customers are doing, provides highest availability at the cost of 2x capacity overhead per DSE datacenter OS and Logs on FTT=1, Data on FTT=0, discreet/multi vSphere/vSAN clusters per DSE rack definition • Enterprise blend of availability and capacity savings. Single permanent disk failure means some data VMDKs will need to be recreated followed by DSE rebuild methodologies. Approved Solutions
  • 45.
    45Confidential │ ©2019VMware, Inc. Backup 45
  • 46.
    Confidential │ ©2019VMware, Inc. 4646 VMware Cloud Hybrid Launch DataStax Accelerate - Hybrid Demo/Talk. Recommend multiple DSE nodes per host. Recommend vSAN with or without host affinity. 2019 vSAN for Development and Test2017 vSAN for Production Launch VMworld 2018 - Blog, Solution Brief, VMworld Talk, Press Release, Technical White Paper and Enablement on production testing results and recommendations 2018 VMworld 2017 Focus: Blogs, Solution Brief and Technical White Paper (published 1/2018) detailing performance and operational tests of DSE on VSAN 100+Joint Customers Using our Products Together
  • 47.
    Confidential │ ©2019VMware, Inc. 47 Extending DataStax Enterprise on vSAN to the cloud Unified management platform for hybrid cloud & multi-cloud Efficiently support your high speed workloads Scale up and out based on application needs Support Application HA requirements Next-Gen Node vSphere vSAN vSAN Datastore Next-Gen Node DSE DSE
  • 48.
    Confidential │ ©2019VMware, Inc. Thank You

Editor's Notes

  • #3 Notes from dryrun -
  • #5 Why is vSAN the industry leading HCI software? First, vSAN is the only storage software natively integrated with the market leading hypervisor, vSphere. vSAN’s unique integration delivers optimal resource utilization for mission critical applications. Second, vSAN provides industry leading deployment flexibility with the largest HCI ecosystem, with over 14,000 private clouds running on over 500+ ReadyNodes, jointly certified servers, and VxRail, a jointly engineered turnkey appliance. vSAN also has native services two of the largest public cloud providers, Amazon and IBM. Finally, VMware uniquely provides centralized management of all your HCI deployments from edge to core to cloud from the same tools you use today, vCenter and vRealize. No need to learn new skills. Importantly, all of these features are available today. Other HCI vendors may talk about future hybrid cloud, but only VMware software can deliver a true hybrid cloud to your data center now.
  • #6 John Where we started: Holistic Infrastructure Management… Across Private Cloud running on Any Hardware… With Enterprise-Grade Storage Features… For Traditional Apps
  • #7 John
  • #8 We offer the broadest set of deployment options on the market. For the private cloud, we leverage the strongest ecosystem with all major server vendors offering vSAN ReadyNodes that are ready run to vSAN. There are over 500 options to choose from now with all different form factors, from general purposes servers to storage dense systems to rugged systems for the edge. For customers that want integrated lifecycle management and/or single source support, integrated systems offer a mid-tier choice between a DIY solution with ReadyNodes and jointly-engineered solution, VxRail. And for those customers that want the simplicity and assurance of an appliance-based deployment model and to further reduce their operational costs, we jointly engineer Dell EMC VxRail, a turnkey appliance. VMware Cloud Foundation on Dell EMC VxRail offers best-in-class serviceability and lifecycle management capabilities for customers looking to automate the deployment and management of the full VMware Software Defined Datacenter (SDDC) stack. And then for customers looking to deploy in or extend to the public cloud, we have relationships with major cloud vendors, like Amazon and IBM, and with 100s of our service provider partners, like RackSpace and CenturyLink, who offer solutions built on HCI powered by vSAN.
  • #9 VMware HCI provides the simplest path from virtualization to hyperconverged infrastructure and the hybrid cloud. VMware enables your modernization journey at your own pace, or lets you step through the 3 key phases in turn: Phase 1: Start with Core HCI, powered by VMware vSAN. Manage compute and storage as one to enable greater operational agility, while future-proofing your infrastructure.   Phase 2: Evolve to Full-Stack HCI to build a completely automated private cloud   Phase 3: Extend to the Hybrid Cloud with a consistent operating model on-prem and off-prem, and for traditional and modern (cloud-native) applications What is Core HCI? Core HCI = vSAN + vSphere What is Full Stack HCI? Full Stack HCI = VMware Cloud Foundation, powered by vSAN What is Hybrid Cloud? Is it HCI? Hybrid Cloud is a combination of private and public cloud, that is based on the same HCI software stack to deliver consistent operations whether on-prem or off-prem. Hybrid Cloud = HCI (on-prem) + HCI (off-prem) What about Edge/Dimension? Is it HCI? Dimension is Full Stack HCI that is managed as a service, initially targeted at edge use cases. It uses the same software stack that is used in the core datacenter (on-prem) and public-cloud (off-prem) Dimension = HCI as a Service (HCIaaS)
  • #10 Before we get started, I’d like to share the latest information on the hyperconverged infrastructure market. First, let’s review the latest IDC Converged Systems Tracker from June of this year. In the June report, IDC found that VMware is once again the HCI software market leader, and we broke above 40% market share for the first time, recording a best ever 41.1% market share. We also achieved a year over year growth rate of 66%, greater than the market growth rate. Significantly, the next closest competitor dropped below 30% share, and another competitor’s share shrank so much that they are now lumped into the “other category.” In the last earnings call, we announced vSAN now counts over 20,000 customers, another significant milestone for our rapidly expanding business. Finally, earlier this year, vSAN was recognized as a Gartner Peer Insights Customer’s Choice for hyperconverged infrastructure. Our product received over one hundred positive reviews from users, which enabled us to achieve this designation. Also, DataStax, a cloud-native application provider, named VMware as their partner of the year, noting that our solution is the ideal infrastructure for container based applications.
  • #15 Main point: Many of these next-gen applications manage resilience using built in replication within the application. So in this case, how does vSAN align the design of these applications and support them in a production environment? Details:  In vSAN 6.7, we introduced a new feature “Host Affinity” for these new next-gen applications. This feature pins the data to the same host that the VM is running on, while setting storage policy FTT=0 that eliminates storage level redundancy.  This greatly reduces storage capacity overhead and I/O write overhead for these applications, while maintains availability via application level replication.   Note that, for vSAN 6.7, this feature is only available through RPQ (and some features HA/DRS are not available). Now how does Datastax Cassandra node fit into this? That’s how we tested in VMware lab in last 1.5 years with DSE guidance, and most recently the validation work we did to support Datastax Enterprise production on vSAN. This will be the most fun part and Kathryn will take you through this in next 25m. Now let's welcome Kathryn from Datastax to the stage. DSE is the always-on industry-leading data management platform, which is powered by best-distribution of Apache Cassandra.   Other details ---------------------------------- Overview: Ensures data resides on the same host VM runs For next-gen apps that provide built-in app resiliency Cassandra Hadoop Splunk VMs run with FTT=0 for space efficiency For details, please request information through VMware Product Management ---------------------------------- Details: Supported by a “Request for Product Qualification” (RPQ) – please contact vSAN product management for customers interested in this functionality. This feature is not limited to those specific applications listed, but rather, is applicable to most modern applications using a shared-nothing approach.  The RPQ process requires the customer to detail what specific applications that they are interested in using the feature with. Features not supported with Host Affinity in the release of vSAN 6.7 vSPhere HA vSphere DRS vSAN RAID-1 or RAID-5/6 vSAN data rebuild abilities after fault domain loss Rebalancing of a vSAN datastore vSAN Deduplication and Compression vSAN Encryption Features partially supported with Host Affinity in the release of vSAN 6.7 Maintenance mode for hosts. VMs with Host affinity policy must be powered off or suspended prior to EMM operation, and will be inaccessible. VMs are pinned to a specific host to maintain availability of the VM’s data that is being served up locally. The placement of data cannot follow the placement of the VM if the VM were to be moved to another host, and thus, is not supported.‘ This feature only supports a level of failure to tolerate (FTT) of 0. Other storage policies that are compatible with the host local policy include: Stripe Width Object Space Reservation, Flash Read Cache Reservation (hybrid) IOPS limits The considerations around this feature, as it stands in vSAN 6.7, will be detailed in a vSAN 6.7 Host Affinity Tech Note on StorageHub. ----------------------------------
  • #23 VCPP - Service Provider Specific Cloud
  • #28 Our Customers told us they wanted the best of both worlds.. and so we’ve spent the last year working through our differences and the story we’re going to show you is of two companies that are stronger together.
  • #32 We do this by having a tunable consistency model that replicates data within a datacenter and between datacenters. AND AH.. THAT”S where the rub is! vSAN is doing this ALSO!  For a LOT of the same reasons! This is the most important concept here. Nodes are always communicating with each other and with the client regarding cluster health and cluster load. The Clients will connect to a node containing the requested data and balance multiple requests for that data across the nodes which hold a copy. So to achieve the low latency guarantees the driver has to know the exact location of the data. There’s another key piece here as well. There are I/O intensive operations that are designed to stay within a single node. When a write comes in it is written to memory. Memory fills up and it’s flushed to disk. Every now and then we need to compact those tables that are written to disk. So we read them into memory. Sort them and clean them up, and then writ ethem back to disk. This communication is designed to happen without leaving that node and drastically increases network traffic So Cassandra needs to control it’s replicas and their placement. And if vSAN is doing this also. We are storing a lot of copies of the data and sacrificing performance. 
  • #33 Explain DSE Rack and VSAN Cluster alignment
  • #34 So lets look at what happens to a piece of data during a failure
  • #35 First remember that we actually have 3 copies of that data
  • #36 So if you lose one.. And Cassandra is configured to read and write at Qurorum .. You’re fine if you lose that fist DSE node!
  • #37 You’re also fine if you lose the whole host
  • #38 And you’re still okay losing that full Rack.
  • #44 Key Message/Talk track: Datastax and VMware have jointly validated vSAN for DataStax Enterprise (DSE) production environment. With this joint solutions, vSAN and DSE delivers predictable performance, high availability and simplified management for Next-gen Cassandra workload. Now as a customer we encourage you to start evaluating and deploying your Cassandra on vSAN. Don’t forget to sumit RQp request to our PM team via your account representative. Details: VMware and DataStax started the partnership about 1.5 year ago. We teamed up to design a solution aiming to combine the management benefits of HCI with the performance benefits of a shared-nothing storage subsystem.  Our teams have worked closely in a weekly basis on the joint validation. After numerous extensive tests/validation at VMware’s lab with guidance from Datastax, we jointly developed the vSAN solution brief and RA for DSE development environment in 2017, and most recently we validated vSAN for DataStax Enterprise (DSE) production environment. The solution leverages the host-affinity feature to place data on the same host that the VM runs and thus reduces additional storage overhead & improve performance due to less write (one copy) at vSAN layer This solution brings to customers the following benefits: Customers can deploy DSE clusters on vSAN for their modern cloud applications with ease and confidence in production environments. Running and managing DSE applications on VMware vSAN provides predictable performance and high availability. All storage management moves into a single software stack, thus taking advantage of the security, performance, scalability, operational simplicity, and cost-effectiveness of vSAN. It is simple for customers to expand using a scale-up or scale-out approach without incurring any downtime. 
  • #47 Notes from dryrun -
  • #48 Main point: Many of these next-gen applications manage resilience using built in replication within the application. So in this case, how does vSAN align the design of these applications and support them in a production environment? Details:  In vSAN 6.7, we introduced a new feature “Host Affinity” for these new next-gen applications. This feature pins the data to the same host that the VM is running on, while setting storage policy FTT=0 that eliminates storage level redundancy.  This greatly reduces storage capacity overhead and I/O write overhead for these applications, while maintains availability via application level replication.   Note that, for vSAN 6.7, this feature is only available through RPQ (and some features HA/DRS are not available). Now how does Datastax Cassandra node fit into this? That’s how we tested in VMware lab in last 1.5 years with DSE guidance, and most recently the validation work we did to support Datastax Enterprise production on vSAN. This will be the most fun part and Kathryn will take you through this in next 25m. Now let's welcome Kathryn from Datastax to the stage. DSE is the always-on industry-leading data management platform, which is powered by best-distribution of Apache Cassandra.   Other details ---------------------------------- Overview: Ensures data resides on the same host VM runs For next-gen apps that provide built-in app resiliency Cassandra Hadoop Splunk VMs run with FTT=0 for space efficiency For details, please request information through VMware Product Management ---------------------------------- Details: Supported by a “Request for Product Qualification” (RPQ) – please contact vSAN product management for customers interested in this functionality. This feature is not limited to those specific applications listed, but rather, is applicable to most modern applications using a shared-nothing approach.  The RPQ process requires the customer to detail what specific applications that they are interested in using the feature with. Features not supported with Host Affinity in the release of vSAN 6.7 vSPhere HA vSphere DRS vSAN RAID-1 or RAID-5/6 vSAN data rebuild abilities after fault domain loss Rebalancing of a vSAN datastore vSAN Deduplication and Compression vSAN Encryption Features partially supported with Host Affinity in the release of vSAN 6.7 Maintenance mode for hosts. VMs with Host affinity policy must be powered off or suspended prior to EMM operation, and will be inaccessible. VMs are pinned to a specific host to maintain availability of the VM’s data that is being served up locally. The placement of data cannot follow the placement of the VM if the VM were to be moved to another host, and thus, is not supported.‘ This feature only supports a level of failure to tolerate (FTT) of 0. Other storage policies that are compatible with the host local policy include: Stripe Width Object Space Reservation, Flash Read Cache Reservation (hybrid) IOPS limits The considerations around this feature, as it stands in vSAN 6.7, will be detailed in a vSAN 6.7 Host Affinity Tech Note on StorageHub. ----------------------------------