Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
VMware Virtual SAN
Duncan Epping
Chief Technologist
Office of the CTO
Storage & Availability
Hyper-converged infrastructur...
Agenda
1 Introduction
2 Virtual SAN, what is it?
3 Virtual SAN, a bit of a deeper dive
4 Virtual SAN Recent Enhancements
5...
The Software Defined Data Center
Compute Networking Storage
Management
• All infrastructure services virtualized:
compute,...
Hardware
evolution
started the
storage
revolution
Simplicity: Operational / Management
5
The Hypervisor is the Strategic High Ground
SAN/NASx86 - HCI Object Storage
VMware vSphere
Cloud Storage
6
Storage Policy-Based Management – App centric automation
Overview
• Intelligent placement
• Fine control of services at VM...
Storage Policy Based Management – What does it look like?
If the storage can satisfy the VM
Storage Policy, the VM Summary...
Virtual SAN,
what is it?
9
Virtual SAN, what is it?
Hyper-Converged Infrastructure
Distributed, Scale-out Architecture
Integrated with vSphere platfo...
But what does that really mean?
VSAN network
Generic x86 hardware
VMware vSphere & Virtual SAN Integrated with your Hyperv...
VSAN is the Most Widely Adopted HCI Product
Simplicity is key, on an oil
platform there are no
virtualization, storage or ...
Virtual SAN Use Cases
VMware vSphere + Virtual SAN
End User
Computing Test/Dev
ROBOStagingManagementDMZ
Business
Critical ...
Broadest Deployment Options from HCI to SDDC
Built on Industry-Leading VMware Hyper-Converged Software (HCS)
Certified Sol...
Tiered Hybrid vs All-Flash
All-Flash
100K IOPS per Host
+
sub-millisecond latency
Caching
Writes cached first,
Reads from ...
Really Simple Setup
Deduplication
and
Compression
Enable?
Fault Domains,
2 node or
stretched
cluster?
Manual or
Automatic ...
Virtual SAN,
a bit of a deeper dive
17
Virtual Machine as a set of Objects on VSAN
• VM Home Namespace
• VM Swap Object
• Virtual Disk (VMDK) Object
• Snapshot (...
Define a policy first…
Virtual SAN currently surfaces multiple storage capabilities to vCenter Server
What If APIs
New
Cap...
ESXi Host
Virtual SAN Objects and Components
VSAN is an object store!
• Object Tree with Branches
• Each Object has multip...
Number of Failures to Tolerate/Failure Tolerance Method
• Defines the number of hosts, disk or network failures a storage ...
Assign it to a new or existing VM
When the policy is selected, Virtual SAN uses it to place / distribute the VM to guarant...
Fault Domains, increasing availability through rack awareness
• Create fault domains to increase availability
• 8 node clu...
Virtual SAN,
Recent Enhancements
24
VSAN 5.5
March 2014
VSAN 6.0
March 2015
All Flash Configuration
64 node VSAN cluster
x2 Hybrid Performance
VSAN Snapshots/...
Virtual SAN – Stretched Cluster
Active-Active data centers
• Virtual SAN cluster split across 2 sites!
• Each site is a Fa...
Advanced Troubleshooting with VSAN Health Check
• Cluster Health
• Network Health
• Data Health
• Limits Health
• Physical...
Virtual SAN 6.2
specifics
28
Deduplication and Compression for Space Efficiency
• Nearline deduplication and compression per disk group level.
– Enable...
RAID-5/6 (Inline Erasure Coding)
• When Number of Failures to Tolerate = 1 and Failure Tolerance Method = Capacity  RAID-...
Software Checksum and disk scrubbing
Overview
• End-to-end checksum of the data to detect and resolve silent
disk errors d...
Other new improvements
Client Cache
• Write through read memory cache
– 0.4% of total host memory, up to 1GB per host
• “L...
Enhanced Virtual SAN Management with New Health Service
Built-in performance monitoring
Health and performance APIs and SD...
Performance, Scale and Availability for Any Application
B U S I N E S S - C R I T I C A L
A P P L I C AT I O N S
SAP Core ...
Wrapping up
35
36
VMware Virtual SAN: Generic Object Storage Platform
VMware vSphere
Virtual SAN
VMFS Block File Rest
37
Virtual SAN 6.2, hyper-converged infrastructure software
Upcoming SlideShare
Loading in …5
×

Virtual SAN 6.2, hyper-converged infrastructure software

6,662 views

Published on

This session tells the VMware Virtual SAN story. It includes some of the basics and what is new for VSAN 6.2.

Published in: Technology
  • Be the first to comment

Virtual SAN 6.2, hyper-converged infrastructure software

  1. 1. VMware Virtual SAN Duncan Epping Chief Technologist Office of the CTO Storage & Availability Hyper-converged infrastructure software
  2. 2. Agenda 1 Introduction 2 Virtual SAN, what is it? 3 Virtual SAN, a bit of a deeper dive 4 Virtual SAN Recent Enhancements 5 Wrapping up 2
  3. 3. The Software Defined Data Center Compute Networking Storage Management • All infrastructure services virtualized: compute, networking, storage • Underlying hardware abstracted, resources are pooled • Control of data center automated by software (management, security) • Virtual Machines are first class citizens of the SDDC • Today’s session will focus on one aspect of the SDDC - storage 3
  4. 4. Hardware evolution started the storage revolution
  5. 5. Simplicity: Operational / Management 5
  6. 6. The Hypervisor is the Strategic High Ground SAN/NASx86 - HCI Object Storage VMware vSphere Cloud Storage 6
  7. 7. Storage Policy-Based Management – App centric automation Overview • Intelligent placement • Fine control of services at VM level • Automation at scale through policy • Need new services for VM? • Change current policy on-the-fly • Attach new policy on-the-fly Virtual Machine Storage policy Reserve Capacity 40GB Availability 2 Failures to tolerate Read Cache 50% Stripe Width 6 Storage Policy-Based Management vSphere Virtual SAN Virtual Volumes Virtual Datastore 7
  8. 8. Storage Policy Based Management – What does it look like? If the storage can satisfy the VM Storage Policy, the VM Summary tab in the vSphere client will display the VM as compliant. If not, either due to failures, lack of resources or other reasons, the VM will be shown as non-compliant. 8
  9. 9. Virtual SAN, what is it? 9
  10. 10. Virtual SAN, what is it? Hyper-Converged Infrastructure Distributed, Scale-out Architecture Integrated with vSphere platform Ready for today’s vSphere use cases Software-Defined Storage vSphere & Virtual SAN 10
  11. 11. But what does that really mean? VSAN network Generic x86 hardware VMware vSphere & Virtual SAN Integrated with your Hypervisor Leveraging local storage resources Exposing a single shared datastore Virtual SAN 11
  12. 12. VSAN is the Most Widely Adopted HCI Product Simplicity is key, on an oil platform there are no virtualization, storage or network admins. The infrastructure is managed over a satellite link via a centralized vCenter Server. Reliability, availability and predictability is key. 12
  13. 13. Virtual SAN Use Cases VMware vSphere + Virtual SAN End User Computing Test/Dev ROBOStagingManagementDMZ Business Critical Apps DR / DA 13
  14. 14. Broadest Deployment Options from HCI to SDDC Built on Industry-Leading VMware Hyper-Converged Software (HCS) Certified Solutions Engineered Appliances Virtual SAN Ready Nodes EVO SDDC Certified Partner Hardware NSX vRealize Lifecycle Management EMC Federation HCI Appliance VMware HCS Virtual SAN + vSphere + vCenter VMware HCS Virtual SAN + vSphere + vCenter VMware HCS Virtual SAN + vSphere + vCenter EVO SDDC Manager 14
  15. 15. Tiered Hybrid vs All-Flash All-Flash 100K IOPS per Host + sub-millisecond latency Caching Writes cached first, Reads from capacity tier Capacity Tier Flash Devices Reads go directly to capacity tier SSD PCIe Ultra DIMM Data Persistence Hybrid 40K IOPS per Host Read and Write Cache Capacity Tier SAS / NL-SAS / SATA SSD PCIe Ultra DIMM Virtual SAN 15
  16. 16. Really Simple Setup Deduplication and Compression Enable? Fault Domains, 2 node or stretched cluster? Manual or Automatic Disk Claiming 16
  17. 17. Virtual SAN, a bit of a deeper dive 17
  18. 18. Virtual Machine as a set of Objects on VSAN • VM Home Namespace • VM Swap Object • Virtual Disk (VMDK) Object • Snapshot (delta) Object • Snapshot (delta) Memory Object VM Home VM Swap VMDK Snap delta Snap memory Snapshot 18
  19. 19. Define a policy first… Virtual SAN currently surfaces multiple storage capabilities to vCenter Server What If APIs New Capabilities in VSAN 6.2 19
  20. 20. ESXi Host Virtual SAN Objects and Components VSAN is an object store! • Object Tree with Branches • Each Object has multiple Components – This allows you to meet availability and performance requirements • Here is one example of “Distributed RAID” using 2 techniques: – Striping (RAID-0) – Mirroring (RAID-1) • Data is distributed based on VM Storage Policy ESXi HostESXi Host Mirror Copy stripe-2b stripe-2a RAID-0 Mirror Copy stripe-1b stripe-1a RAID-0 witness VMDK Object RAID-1 20
  21. 21. Number of Failures to Tolerate/Failure Tolerance Method • Defines the number of hosts, disk or network failures a storage object can tolerate. • RAID-1 Mirroring used when Failure Tolerance Method set to Performance (default). • For “n” failures tolerated, “n+1” copies of the object are created and “2n+1” host contributing storage are required! esxi-01 esxi-02 esxi-03 esxi-04 Virtual SAN Policy: “Number of failures to tolerate = 1” vmdk ~50% of I/O vmdk witness ~50% of I/O RAID-1 21
  22. 22. Assign it to a new or existing VM When the policy is selected, Virtual SAN uses it to place / distribute the VM to guarantee availability and Performance 22
  23. 23. Fault Domains, increasing availability through rack awareness • Create fault domains to increase availability • 8 node cluster with 4 defined fault domains (2 nodes in each) FD1 = esxi-01, esxi-02 FD3 = esxi-05, esxi-06 FD2 = esxi-03, esxi-04 FD4 = esxi-7, esxi-08 • To protect against one rack failure only 2 replicas are required and a witness across 3 failure domains! 23 FD2 FD3 FD4 esxi-01 esxi-02 esxi-03 esxi-04 esxi-05 esxi-06 esxi-07 esxi-08 FD1 vmdk vmdk witness RAID-1 23
  24. 24. Virtual SAN, Recent Enhancements 24
  25. 25. VSAN 5.5 March 2014 VSAN 6.0 March 2015 All Flash Configuration 64 node VSAN cluster x2 Hybrid Performance VSAN Snapshots/Clones Health UI Rack Awareness VSAN 6.2 March 2016 Deduplication and Compression RAID 5/6 support Software Checksum QoS via IOPS Limits IPv6 Performance Service Enhanced Capacity Views VSAN 6.1 September 2015 Stretched Cluster Replication - 5 Minutes RPO 2-node ROBO Health Monitoring & Remediation 25
  26. 26. Virtual SAN – Stretched Cluster Active-Active data centers • Virtual SAN cluster split across 2 sites! • Each site is a Fault Domain (FD) • Site-level protection with zero data loss and near-instantaneous recovery • Support for up to 5ms RTT latency between data sites – 10Gbps bandwidth expectation • Witness VM can reside anywhere – 200ms RTT latency – 100Mbps bandwidth required at most • Automated failover 5ms RTT, 10GbE Today VMware vSphere & Virtual SAN vSphere witness vmdk vmdk witness 26 vSphere & Virtual SAN Site Recovery Manager
  27. 27. Advanced Troubleshooting with VSAN Health Check • Cluster Health • Network Health • Data Health • Limits Health • Physical Disk Health • Stretched Cluster • Proactive Tests 27
  28. 28. Virtual SAN 6.2 specifics 28
  29. 29. Deduplication and Compression for Space Efficiency • Nearline deduplication and compression per disk group level. – Enabled on a cluster level – Deduplicated when de-staging from cache tier to capacity tier – Fixed block length deduplication (4KB Blocks) • Compression after deduplication – If block is compressed <= 2KB – Otherwise full 4KB block is stored Beta esxi-01 esxi-02 esxi-03 vmdk vmdk vSphere & Virtual SAN vmdk All Flash Only Significant space savings achievable, making the economics of an all-flash VSAN very attractive 29
  30. 30. RAID-5/6 (Inline Erasure Coding) • When Number of Failures to Tolerate = 1 and Failure Tolerance Method = Capacity  RAID-5 – 3+1 (4 host minimum) – 1.33x overhead for RAID-5 instead of 2x compared to FTT=1 with RAID-1 • When Number of Failures to Tolerate = 2 and Failure Tolerance Method = Capacity  RAID-6 – 4+2 (6 host minimum) – 1.5x overhead for for RAID-6 instead of 3x compared to FTT=2 with RAID-1 RAID-5 ESXi Host parity data data data ESXi Host data parity data data ESXi Host data data parity data ESXi Host data data data parity All Flash Only 30
  31. 31. Software Checksum and disk scrubbing Overview • End-to-end checksum of the data to detect and resolve silent disk errors due to faulty hardware/firmware • Checksum is enabled by default (policy driven) • If checksum verification fails on a read: – VSAN fetches the data from another copy in RAID-1 – VSAN recreates the data from other components in RAID-5/6 stripe • Disk scrubbing is run in the background Benefits • Provide additional level of data integrity • Automatic detection and resolution of silent disk errors Virtual SAN Datastore 31
  32. 32. Other new improvements Client Cache • Write through read memory cache – 0.4% of total host memory, up to 1GB per host • “Local” to the virtual Machine • Low overhead, big impact! Sparse Swap • Reclaim Space used by memory swap • Host advanced option enables setting policy for swap to no space reservation IOPS limit on object • Policy driven capability • Limit IOPS per VM/Virtual Disk • Eliminate noisy neighbor issues • Manage performance SLAs 32
  33. 33. Enhanced Virtual SAN Management with New Health Service Built-in performance monitoring Health and performance APIs and SDK Storage capacity reporting And many more health checks… Performance Monitoring Capacity Monitoring 33
  34. 34. Performance, Scale and Availability for Any Application B U S I N E S S - C R I T I C A L A P P L I C AT I O N S SAP Core Ready Testing and validated deployments SAP Tightly integrated cloud management Bundles Virtual SAN licenses for lowest cost VDI storage Horizon Oracle RAC supported Testing and validated deployments Oracle 34
  35. 35. Wrapping up 35
  36. 36. 36
  37. 37. VMware Virtual SAN: Generic Object Storage Platform VMware vSphere Virtual SAN VMFS Block File Rest 37

×