Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

EMC ScaleIO Overview

13,999 views

Published on

EMC ScaleIO technical overview

Published in: Technology, Business
  • Be the first to comment

EMC ScaleIO Overview

  1. 1. ScaleIO Convergence. Scalability. © Copyright 2014 EMC Corporation. All rights reserved. Elasticity. Performance. 1
  2. 2. EMC ScaleIO Software-Defined Converged Server SAN Software that creates a server-based SAN from local storage to deliver performance and capacity on demand Creates virtual pool of storage with varying performance tiers Media-agnostic: Leverages any HDDs, SSDs, & PCIe flash cards Server-agnostic: Installed on existing physical & virtual app servers © Copyright 2014 EMC Corporation. All rights reserved. 2
  3. 3. ScaleIO Turns DAS Into A Server SAN Convergence of storage and compute Scale-out to thousands of servers Elastic—add/remove servers & capacity ―on-the-fly‖ Performance—massive I/O parallelism © Copyright 2014 EMC Corporation. All rights reserved. 3
  4. 4. Convergence Simplify Your data center Architecture Converge storage and compute resources into a single-layer architecture Servers Aggregate capacity and I/O performance Make storage as ubiquitous as CPU & RAM Consolidate storage and applications onto x86 and ARM hardware © Copyright 2014 EMC Corporation. All rights reserved. Network Converged Architecture Storage 4
  5. 5. Scalability Massively scale to thousands of nodes Add storage devices and servers modularly to increase capacity and performance Storage growth always automatically aligned with application needs © Copyright 2014 EMC Corporation. All rights reserved. 5
  6. 6. Elasticity Dynamically add, move, remove storage and compute resources ―on the fly‖ with no downtime No capacity planning required Leverage mixed: – – – – Server brands Configurations OS platforms (physical & virtual) Media types © Copyright 2014 EMC Corporation. All rights reserved. 6
  7. 7. Performance Massive I/O Parallelism I/O processing load shared among all servers Automatic rebuild & rebalance Autonomous management of performance hot spots and data layout Eliminate I/O Bottlenecks Storage tiering © Copyright 2014 EMC Corporation. All rights reserved. 7
  8. 8. BeforeScaleIO With ScaleIO 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 1,000 IOPS 10 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 100 IOPS 1 TB 2,000 IOPS 20 TB © Copyright 2014 EMC Corporation. All rights reserved. 8
  9. 9. ScaleIO Environment Eliminate the Need for Array, Switching Fabric, and HBAs FLEXIBILITY IN EXPANSION © Copyright 2014 EMC Corporation. All rights reserved. 9
  10. 10. Auto-Rebalance Add Nodes or Disks Dynamically—System Automatically Migrates and Rebalances Storage © Copyright 2014 EMC Corporation. All rights reserved. 10
  11. 11. Auto-Rebalance Remove Nodes or Disks Dynamically—System Automatically Migrates and Rebalances Storage © Copyright 2014 EMC Corporation. All rights reserved. 11
  12. 12. Simple Management & Monitoring Automated installation scripts and easy configuration Any IT admin can manage the entire data center stack Call-home and incident reporting Self-regulated data layout, performance optimization, and HW/SW failure recovery—no administrative intervention required © Copyright 2014 EMC Corporation. All rights reserved. 12
  13. 13. Enterprise Features For Infrastructure as a Service APP 1 APP 2 APP 3 Protection Domains for Isolated Servers and Data Sets Storage Pools for Tiering Bandwidth/ IOPS Limiter for Quality of Service Light Data Encryption at Rest for Security Writeable Snapshots for Backups Control Performance, Capacity, and Data Location © Copyright 2014 EMC Corporation. All rights reserved. 13
  14. 14. Your Bottom Line How ScaleIO Lowers Your TCO 1. Commodity hardware 2. No dedicated storage components (FC network, HBAs, etc.) 3. Reduced power, cooling, and space 4. No ―forklift‖ upgrades for EOL HW 5. Reduced administrative overhead 6. ―Pay as you grow‖—linear investments with predictable costs © Copyright 2014 EMC Corporation. All rights reserved. 14
  15. 15. VSI VDI DATABASES TEST & DEV © Copyright 2014 EMC Corporation. All rights reserved. USE CASES 15
  16. 16. Virtual Server Infrastructure (VSI) Requirements: Why ScaleIO: – Large storage capacities – Easy growth – Deliver low $/server – Easy manageability VSI – – – – © Copyright 2014 EMC Corporation. All rights reserved. Any hardware Any size growth No capacity planning Easy growth in capacity and performance – Ease of management – Low TCO 16
  17. 17. Virtual Desktop Infrastructure (VDI) Requirements: Why ScaleIO: – Performance at peak times (―boot storms‖) – Large storage capacities – Easy growth – Deliver low $/desktop VDI – – – – – © Copyright 2014 EMC Corporation. All rights reserved. Parallel processing Any hardware Any size growth No capacity planning Easy growth in capacity and performance – Ease of management – Low TCO 17
  18. 18. Databases DATABASES Requirements: Why ScaleIO: – High write performance – High availability – Quick recovery – Low cost of storage – Convergence allows for fast writes – Massive parallelism delivers quick recovery – Stable, predictable performance – Low TCO © Copyright 2014 EMC Corporation. All rights reserved. 18
  19. 19. Development & Testing TEST & DEV Requirements: Why ScaleIO: – Medium capacity & performance – Low cost – Rapidly changing environment with high deduplication rate – Rapid hardware changes and repurposing – Rebalancing for frequently changing environments – Easy scale-out and hardware upgrade with no downtime – Low initial cost allows more investment in compute – Stable, predictable performance – Easy management © Copyright 2014 EMC Corporation. All rights reserved. 19
  20. 20. ARCHITECTURE © Copyright 2014 EMC Corporation. All rights reserved. 20
  21. 21. ScaleIO Data Client (SDC) Exposes ScaleIO Volumes to Application C SDC HOST © Copyright 2014 EMC Corporation. All rights reserved. ScaleIO Protocol ETH/IB DAS 21
  22. 22. ScaleIO Data Server (SDS) Owns Local Storage Dedicated to ScaleIO S SDS HOST © Copyright 2014 EMC Corporation. All rights reserved. ScaleIO Protocol ETH/IB DAS 22
  23. 23. Metadata Manager (MDM) Configures and monitors the ScaleIO system Keeps track of storage and data mapping Monitors capacity, performance, and load balancing Makes data migration decisions © Copyright 2014 EMC Corporation. All rights reserved. 23
  24. 24. Non-VMware Environments Server • Identical to physical environments VM • SDS and SDC sit inside hypervisor VM ……… VM Hypervisor C ETH/IB S © Copyright 2014 EMC Corporation. All rights reserved. 24
  25. 25. VMware Environments SVM: Dedicated ScaleIO VM in each ESX host containing SDC and SDS SDS: Accesses storage volumes via VMFS SDC: Exposes volumes as iSCSI targets to VMFS Hypervisor: iSCSI initiator, exposing VMFS to VMs © Copyright 2014 EMC Corporation. All rights reserved. ETH/IB Server SVM C VM …… VM S VMFS VMFS SCSI Hypervisor 25
  26. 26. Single Read I/O C S ETH/IB ETH/I B © Copyright 2014 EMC Corporation. All rights reserved. 26
  27. 27. Single Write I/O C S S ETH/IB ETH/I B © Copyright 2014 EMC Corporation. All rights reserved. 27
  28. 28. Fully Converged Configuration S C S C S C S C S C S C S C S C S C S C S C S C ETH/IB S C S C S C © Copyright 2014 EMC Corporation. All rights reserved. S C S C S C 28
  29. 29. Two-Layer Configuration C C C C C C ETH/IB S S S © Copyright 2014 EMC Corporation. All rights reserved. S S S 29
  30. 30. Two-Layer Configuration C C C C C C S S S S S S ETH/IB S S S © Copyright 2014 EMC Corporation. All rights reserved. S S S 30
  31. 31. Two-Layer Configuration Massive Parallelism as SDCs Contact Relevant SDSs Directly C C C C C C ETH/IB S S S © Copyright 2014 EMC Corporation. All rights reserved. S S S 31
  32. 32. Fully Converged Configuration Massive Parallelism as SDCs Contact Relevant SDSs Directly S C S C S C S C S C S C ETH/IB S C S C S C © Copyright 2014 EMC Corporation. All rights reserved. S C S C S C 32
  33. 33. Distributed Volumes SDS 1 SDS 2 SDS 5 SDS 3 SDS 6 SDS 4 SDS 100 Volume 1 … Volume 2 © Copyright 2014 EMC Corporation. All rights reserved. 33
  34. 34. Two-Copy ―Mesh‖ Mirroring E A D C B © Copyright 2014 EMC Corporation. All rights reserved. 34
  35. 35. Data Protection E B F E F B © Copyright 2014 EMC Corporation. All rights reserved. 35
  36. 36. Protection Domains • Protection Domain: A logically segregated grouping of SDSs (nodes and storage) • Provides security, data location, and performance segregation © Copyright 2014 EMC Corporation. All rights reserved. 36
  37. 37. Protection Domain Storage Pools DISKS FLASH • Storage pool: A subset of devices in a protection domain created for performance isolation and data segregation • Enables tiering between device types • Can be asymmetric Pool 1 © Copyright 2014 EMC Corporation. All rights reserved. Pool 2 Pool 3 37
  38. 38. Writeable Snapshots ScaleIO volumes that can be written, read and copied as snapshots VTree1 VTree2 V1 V2 Instantaneous and thinly provisioned to save space Organized in trees, known as VTrees Consistency Group: collection of snapshots created together at the same time © Copyright 2014 EMC Corporation. All rights reserved. S111 S112 S121 C1 S211 Consistency Group 38
  39. 39. Bandwidth/IOPS Limiter For Quality of Service Current Environment With IOPS Limiter APP 1 APP 2 © Copyright 2014 EMC Corporation. All rights reserved. APP 3 AVAILABLE 39
  40. 40. Why not rescue that capacity and put it to good use? © Copyright 2014 EMC Corporation. All rights reserved. 41

×