Eliminating Storage Sprawl: Scale-out NAS for Virtualization<br />
  ASP<br /> WEB<br /> Linux<br />  DEV<br />   HR<br />Legacy<br />Legacy<br />  SQL<br />  LOB<br />File Servers<br /> SQ...
Physical Storage<br />VMware Solves the Server Sprawl Problem<br />Servers are virtualized and stacked<br />Isilon’s Focus...
Virtualization Storage Challenges<br />Technical Challenge<br />Impact to Business<br />Server & storage proliferation<br ...
Increased staff time
Trade-offs in protection levels, backups, and performance
Supply-side approach inflates capitol costs
Inefficient, unused system resources
Hinders business agility
Limits business agility
Systems hard to adapt
Changes introduce risk. </li></li></ul><li>LUNs<br />Storage Sprawl on SANs<br />SANs require serious planning and flawles...
File Server Sprawl on NAS<br />Easy to Buy—not soEasy to Own, Scale, and Manage<br />LUN sprawl (hidden complexity)<br />“...
Scale-out NAS for Virtualization<br />Reduce the cost of deploying and managing storage for large-scale virtual environmen...
Isilon IQ<br />Enterprise-class hardware<br />OneFS™intelligent<br />software<br />complete storage system<br />Rapidly De...
Core Innovation  The Virtualization behind Clustered Storage<br />Creates one giant Datastore<br />Single file system, sin...
Non-disruptive Scalability<br />platform nodes<br />Pure Performance<br />Accelerator<br />S-Series<br />Backup Accelerato...
Maximize Storage EfficiencyScale-up vs. Scale-out Architecture Considerations<br />Source: The Total Economic Impact of Is...
100% AVAILABILITY<br />100% AVAILABILITY<br />100% AVAILABILITY<br />100% AVAILABILITY<br />100% AVAILABILITY<br />100% AV...
Reducing Acquisition Cost through Precision Right-Sizing<br />&quot;Large organizations feel the pain of traditional SANs ...
Scale-up vs. Scale-out NAS: TCOIf traditional NAS hardware were free – Isilon still offers a better 3-year TCO  <br />Why ...
VMware on Isilon Customers <br />
Server & Storage Consolidation<br />Background<br />Risk, financial and management consulting firm.  Also provides complia...
Virtual Test Labs for Management Automation<br />Background<br />The market leader in self-service virtualization automati...
Summary<br />Scale-out NAS well suited to <br />Large or dynamic environments—many VMs<br />Smaller environments requiring...
Backup Scenarios for Virtualization<br />
Backup Options<br />
Option 1: SyncIQ with VMware<br />Could be used to replicate and restore VMs <br />Best practice: <br />Schedule snapshots...
Option 2: VMware Tape BackupNDMP<br />Backup full VMs directly from Isilon storage to tape<br />Currently only 3-way NDMP<...
Option 3: VMware Consolidated Backup (VCB)<br />Use Backup Vendor VCB proxy to coordinate VMware snapshots with backup<br ...
Option 4: SnapshotIQ with VMware<br />OneFS snapshots could be used to store VM snapshots<br />Storage-based snapshots<br ...
Options 5 and 6: Backup Agents<br />Leverage licenses already purchased<br />Functionality depends on Backup and Restore A...
Upcoming SlideShare
Loading in …5
×

Scale out NAS for VMware Virtualization by Isilon

3,991 views

Published on

Isilon's innovative scale-out NAS storage solutions are designed to help enterprises overcome the most pressing storage challenges facing their businesses. From streamlining content production to enhancing the reliability of file services to supporting key disaster recovery initiatives, clustered storage solutions from Isilon combine the OneFS® operating system with the latest advances in industry-standard hardware to enable customers to accelerate their critical applications, workflows and processes, while reducing their capital and operating expenditures.

Published in: Technology
0 Comments
5 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
3,991
On SlideShare
0
From Embeds
0
Number of Embeds
34
Actions
Shares
0
Downloads
0
Comments
0
Likes
5
Embeds 0
No embeds

No notes for slide
  • SyncIQ could be used to replicate and restore VMs. It is always good to enable snapshot creation at destination so that we always have file system consistent snapshot at target. This option is present as part of SyncIQ job policy creation menu on WebGUI.SyncIQ 2.5 has major improvement to reduce the amount of data flowing from source to target. The new SyncIQ will only transfer changed blocks of files. The SyncIQ is extremely flexible as it supports replication at any directory level. This allows us to have policies where could replicate either single or specific set of VMs.The SyncIQ only provides data replication of VMs. But for complete DR we require support of host software which automates the process of DR. The VMware Site Recovery Manager is one such software. Currently it has roadmap to support NAS storage and we are working with VMware to integrate Isilon storage to work with VMware SRM software.
  • Isilon snapshots could be used to store VM snapshots. This could give performance improvements since ESX server doesn’t have to to go through the snapshot tree to resolve block accesses. The entire process could be automated with VM scripts which could be written wither in perl, VB etc. More information could be gathered from VMware developer forum portal. One important thing to note is that we do not provide advanced restore, hence in case customer would like to revert to previous VM snapshot , then it would have to be done by copying the contents from ifs snapshot directory.
  • SyncIQ could be used to replicate and restore VMs. It is always good to enable snapshot creation at destination so that we always have file system consistent snapshot at target. This option is present as part of SyncIQ job policy creation menu on WebGUI.SyncIQ 2.5 has major improvement to reduce the amount of data flowing from source to target. The new SyncIQ will only transfer changed blocks of files. The SyncIQ is extremely flexible as it supports replication at any directory level. This allows us to have policies where could replicate either single or specific set of VMs.The SyncIQ only provides data replication of VMs. But for complete DR we require support of host software which automates the process of DR. The VMware Site Recovery Manager is one such software. Currently it has roadmap to support NAS storage and we are working with VMware to integrate Isilon storage to work with VMware SRM software.
  • Scale out NAS for VMware Virtualization by Isilon

    1. 1. Eliminating Storage Sprawl: Scale-out NAS for Virtualization<br />
    2. 2. ASP<br /> WEB<br /> Linux<br /> DEV<br /> HR<br />Legacy<br />Legacy<br /> SQL<br /> LOB<br />File Servers<br /> SQL<br />Finance<br /> CAD /<br /> CAM<br />Random<br />Application and Server Sprawl<br />Many underutilized servers and storage devices<br />Costly to Manage<br />Software updates and patches<br />OS Versions<br />Maintenance releases<br />Security upgrades<br />Backups<br />Power consumption<br />Underutilized<br />Low CPU, RAM, and Disk usage<br />In the 2 to 20% range<br />Sub-optimal Availability<br />Drives and storage components fail<br />Traditional clustering unreliable<br />
    3. 3. Physical Storage<br />VMware Solves the Server Sprawl Problem<br />Servers are virtualized and stacked<br />Isilon’s Focus<br /> Run applications side-by-side<br />VMware safely partitions servers into shared resource pools<br />Stack applications within server<br />Reduce physical server footprint<br />Fewer servers to manage and backup<br /> Increase server utilization<br />Since Virtual Machines (VMs) share server resources, each effectively can run at a higher utilization rate<br />Server resources shared <br /> Centralize server management<br />Example: backup multiple VMs (within one server) from a single point<br />
    4. 4. Virtualization Storage Challenges<br />Technical Challenge<br />Impact to Business<br />Server & storage proliferation<br />Volumes locked to servers<br />Storage not easily shared<br />Monolithic scale-up storage not well-suited to virtualization<br />Scalability limited<br />Force over-buying / provisioning<br />Storage complexity, brittleness<br />Forces trade-offs in reliability for performance (or vice versa)<br /><ul><li>Management complexity drives up operational costs
    5. 5. Increased staff time
    6. 6. Trade-offs in protection levels, backups, and performance
    7. 7. Supply-side approach inflates capitol costs
    8. 8. Inefficient, unused system resources
    9. 9. Hinders business agility
    10. 10. Limits business agility
    11. 11. Systems hard to adapt
    12. 12. Changes introduce risk. </li></li></ul><li>LUNs<br />Storage Sprawl on SANs<br />SANs require serious planning and flawless execution of operations<br />Configuring LUNs, partitions, zoning<br />RDMs or VMFS?<br />Host file systems (NTFS, ext3)<br />Ad hoc components<br />Fiber channel HBAs<br />Severe complexity at scale<br />LUNs &gt; volumes &gt; zones &gt; ports &gt; HBAs &gt; servers &gt; VMs &gt; VMFS<br />
    13. 13. File Server Sprawl on NAS<br />Easy to Buy—not soEasy to Own, Scale, and Manage<br />LUN sprawl (hidden complexity)<br />“SAN”: RAID groups &gt; Aggregates &gt; Volumes &gt; LUNs &gt; File Systems &gt; HBAs &gt; Host File Systems (VMFS)<br />NAS: all of the above except HBAs and VMFS<br />File system sprawl (complexity at scale)<br />Other issues: availability, cost, etc. <br />/fs/01, /fs/02<br />RAID Groups & LUNs<br />Storage Device #1<br />/fs/03, /fs/04<br />RAID Groups & LUNs<br />Storage Device #2<br />/fs/05, /fs/06<br />RAID Groups & LUNs<br />Storage Device #3<br />
    14. 14. Scale-out NAS for Virtualization<br />Reduce the cost of deploying and managing storage for large-scale virtual environments by over 35%<br />Non-disruptive scalability<br />Performance<br />Capacity<br />Maximize efficiency<br />Higher utilization<br />Pay-as-you-grow<br />Volume-free provisioning<br />Protect all Virtual Machines Cost-effectively<br />Variable protection levels<br />Clustered: NO SPOF<br />All-Active HA failover<br />Right-size on-the-fly<br />Re-balance VMs across nodes and SmartConnect performance zones<br />Rapidly deploy and consolidate storage for hundreds of Virtual Machines in minutes<br />Setup and deploy a multi-terabyte cluster in minutes!<br />Single <br />File System <br />Isilon’s OneFS<br />Storage Device #1<br />Storage Device #2<br />Storage Device #3<br />
    15. 15. Isilon IQ<br />Enterprise-class hardware<br />OneFS™intelligent<br />software<br />complete storage system<br />Rapidly Deploy and Consolidate Storage<br />Unprecedented simplicity<br />Easy to setup, provision, manage, and change!<br />Build a cluster in 30 minutes <br />Enterprise-class, integrated storage system<br />Storage nodes: performance and capacity<br />Expansion nodes: pure capacity<br />Accelerators: pure performance<br />Deploy virtual machines in minutes<br />
    16. 16. Core Innovation The Virtualization behind Clustered Storage<br />Creates one giant Datastore<br />Single file system, single volume<br />Highest performance, fully symmetric cluster<br />Easy to manage and grow <br />Single unified platform across all products<br />9<br />
    17. 17. Non-disruptive Scalability<br />platform nodes<br />Pure Performance<br />Accelerator<br />S-Series<br />Backup Accelerator<br />X-Series<br />Linear Scaling of Performance & Capacity<br />Independent Performance Scaling<br />Capacity nodes<br />EX-Series<br />NL-Series<br />Performance<br />Independent Capacity Scaling<br />Capacity<br />
    18. 18. Maximize Storage EfficiencyScale-up vs. Scale-out Architecture Considerations<br />Source: The Total Economic Impact of Isilon’s Clustered Storage System, Forrester 2008<br />
    19. 19. 100% AVAILABILITY<br />100% AVAILABILITY<br />100% AVAILABILITY<br />100% AVAILABILITY<br />100% AVAILABILITY<br />100% AVAILABILITY<br />100% AVAILABILITY<br />100% AVAILABILITY<br />FAILED<br />FAILED<br />Comprehensive Data Protection<br />Protect all Virtual Machines–at the Right Protection Level<br />VMs stored on OneFS directory. For example:/ifs/farm1/vmachines<br />OneFS protects all data, across all nodes in cluster<br />All VMs striped across all nodes<br />N+1  N+4 set on various levels<br />File (individual VMs), Directory (multiple VMs), or Cluster (all VMs)<br />12<br />12<br />
    20. 20. Reducing Acquisition Cost through Precision Right-Sizing<br />&quot;Large organizations feel the pain of traditional SANs in large VMware deployments. With horizontal scaling of Isilon storage, we can right-size storage and performance for VMware, literally on the fly. <br />-- Storage Architect, World Leader in Jet Aircraft Engine Manufacturing and Testing<br /> Start small<br />From 10 TBs to 250 TBs<br /> Pay-as-you-grow<br />Single file systems image never change<br />Non-disruptively scale capacity up to 3.4 PB in a single cluster<br />Add pure capacity independently of performance<br /> Easy to scale<br />Add performance in minutes<br />Add capacity nodes in minutes<br />Core platform nodes<br />S-Series<br />X-Series<br />NL-Series<br />Linear Scaling of Performance & Capacity<br />“Isilon’s scale-out file storage is inherently more power efficient than NAS silos—adding what you need in granular increments, versus the gross over-provisioning that normally accompanies monolithic infrastructure silos. Adding processing power independently also saves floor and rack space, improves performance, and significantly reduces power consumption.”<br />
    21. 21. Scale-up vs. Scale-out NAS: TCOIf traditional NAS hardware were free – Isilon still offers a better 3-year TCO <br />Why this happens:<br />Staffing – ease of management <br />Storage utilization <br />Effectively scale reliably<br />Business Impact – Isilon is a better way to spend corporate money – freeing money to fund innovation and sustain the business <br />Source:The Total Economic Impact of Isilon’s Clustered Storage System, Forrester 2008<br />
    22. 22. VMware on Isilon Customers <br />
    23. 23. Server & Storage Consolidation<br />Background<br />Risk, financial and management consulting firm. Also provides compliance and litigation support, data analysis, e-discovery, and data archiving services. <br />We love what both VMware and Isilon do; the solutions are exceptionally complimentary. We’ve been able to streamline our entire IT operations, provide reliability and high availability—all by standardizing on clustered VMware servers and clustered storage from Isilon.<br />We even moved a mission critical VMware application off of our Hitachi SAN and found it performed better on the Isilon. <br />--IT Director<br />Infrastructure<br />Challenge<br />Managing storage for entire VMware environment<br />Backing up multiple virtual machines quickly<br />Managing more data with fewer people<br />Solution<br />Four Isilon IQ clusters in two locations—for production, e-discovery, archiving, and R&D<br />SnapshotIQ used to clone virtual machines<br />More than 70 virtual machines hosted on Isilon, including mission critical litigation app<br />Only four people manage entire IT department, including all applications and 75TBs of storage.<br />
    24. 24. Virtual Test Labs for Management Automation<br />Background<br />The market leader in self-service virtualization automation and lab management.<br />Cloud hosting provider for test, development, and LOB application staging services. <br />Delivers end-products to name-brand accounts for IT professionals, business users, and testers/developers. <br />Benefits<br />Easy of installation and management<br />High availability<br />Performance: exceeded goals by 2x: 4Gb/sec reads from 70 VMs <br />Rapid provisioning: single point of management for batch-deployment of many Virtual Machines. <br />Cloud Hosting<br />Challenge<br />Support dynamic, large scale cloud hosting environment for 1800+ Virtual Machines, reliably, at the right price-performance. Pass strict Surgient compliance testing.<br />Performance on traditional NAS topped out—and scalability proved impossible. Required 2Gbps+ which traditional NAS could not provide<br />Solution<br />5 IQ12000X, 1 Accelerator X with redundant IB switches<br />Achieved 4Gb/sec reads from 70 VMs running Iometer<br />Passed all other requirements<br />Isilon Cluster<br />NAS<br />
    25. 25. Summary<br />Scale-out NAS well suited to <br />Large or dynamic environments—many VMs<br />Smaller environments requiring simplicity<br />Reduce storage management costs by 35% over traditional NAS<br />Rapidly deploy and consolidate storage<br />Non-disruptively scale performance and capacity, without changes to host servers<br />Maximize efficiency—30% over traditional NAS<br />Protect all Virtual Machines cost-effectively<br />Fine grained data protection <br />Choice of certified backup partners<br />Optimize and right-size the system on the fly.<br />
    26. 26. Backup Scenarios for Virtualization<br />
    27. 27. Backup Options<br />
    28. 28. Option 1: SyncIQ with VMware<br />Could be used to replicate and restore VMs <br />Best practice: <br />Schedule snapshots in VirtualCenter on target<br />Replicate snapshot delta files<br />Extremely flexible: replicate single or multiple VMs<br />VMware Site Recovery Manager (SRM) for NAS on VMware roadmap <br />Isilon will support SRM<br />VM3<br />VM2<br />VM1<br />SyncIQ 2 transfers entire VMDK files<br />SyncIQ 2.5 transfers only changed blocks<br />
    29. 29. Option 2: VMware Tape BackupNDMP<br />Backup full VMs directly from Isilon storage to tape<br />Currently only 3-way NDMP<br />Upcoming 2-way NDMP with Isilon IQ Backup Accelerator<br />Use Isilon Snapshots to create point-in-time copies of VMs<br />Compatible with all Isilon-certified NDMP backup applications<br />Symantec, EMC, Commvault, Bakbone, Atempo<br />Upcoming IBM TSM support with Isilon IQ Backup Accelerator<br />VM3<br />VM2<br />VM1<br />NDMP file based incremental means entire VMDKs are always backed up<br />
    30. 30. Option 3: VMware Consolidated Backup (VCB)<br />Use Backup Vendor VCB proxy to coordinate VMware snapshots with backup<br />Backup full VM images or individual VM files on Windows VMs only.<br />True fullincremental VM backups – only backs up changed blocks<br />Compatible with all vendors that supply VCB agents.<br />So far have only tested with Symantec.<br />Uses ESX server as a resource to move backup data to VCB proxy tape<br />
    31. 31. Option 4: SnapshotIQ with VMware<br />OneFS snapshots could be used to store VM snapshots<br />Storage-based snapshots<br />Not crash consistent<br />The process could be automated to create application consistent VM snapshot with VMware scripts<br />Take VM snapshot<br />Isilon snapshot<br />Delete VM snapshot<br />No instant snapshot restore: customer needs to copy snapshots manually or write scripts<br />8:00<br />VM snapped<br />9:14<br />VM restored<br />9:10<br />VM deleted<br />
    32. 32. Options 5 and 6: Backup Agents<br />Leverage licenses already purchased<br />Functionality depends on Backup and Restore Application<br />Most support granular, object-based restore<br />Requires knowledge of applications inside VMs<br />Primary Site<br />
    33. 33. High Availability Scenarios <br />
    34. 34. Comprehensive High Availability<br />VMware HA + IsilonSmartConnect: Complementary Approaches<br /><ul><li>VMware HA monitors and detects server failures from VirtualCenter
    35. 35. If a server failure occurs, VMwareHA restarts VMs on a different physical server within a resource pool.</li></ul>VMware HA<br /> All-active Server High Availability<br /><ul><li>All ESX Servers mount all nodes
    36. 36. VMs are spread across all nodes
    37. 37. All VMs protected from server and storage failures
    38. 38. Rapid NFS failover provided for each ESX Server</li></ul>SmartConnect<br /> All-active Storage High Availability<br />OneFS <br /> NFS failover using SmartConnect takes 1 to 2 seconds<br />
    39. 39. Isilon SmartConnect Advanced<br />Highly Differentiated, All-active NFS Failover Solution for Virtualization<br />SmartConnect failover supported in VMware VirtualCenter 3.x<br />Dynamic IP addresses used in lieu of DNS zone name<br />VirtualCenter features such as VMotion fully supported <br />Capabilities<br />Datastore shared across multiple ESX servers<br />All-active NFS failover<br />
    40. 40. Disaster Recovery<br />
    41. 41. NFS<br />NFS<br />NFS<br />Disaster Recovery for VMware<br />DR and Backup Options for Isilon Clustered Storage:<br /><ul><li>SyncIQ: Asynchronous disk backup & remote replication
    42. 42. Host-based replication solutions from Partners such as Vizioncore
    43. 43. Certified Backup Partners: Symantec, Commvault, Bakbone, EMC</li></ul>Primary Site<br />Recovery Site<br />VirtualCenter<br />
    44. 44. SyncIQ for VMware Update<br />Replicate and restore VMs from site to site<br />Best-practice: Replicate ESX-based snapshots from source<br />Extremely flexible, could be used to replicate single or multiple VMs<br />SyncIQ 2 transfers entire snapshot delta or VM<br />VM3<br />VM2<br />VM1<br />Roadmap<br />VMware Site Recovery Manager (SRM) for NAS (Q209). Participating in beta program.<br />SyncIQ 2.5: transfers only changed blocks.<br />

    ×