Itzik Reich-EMC World 2015-Best Practices for running virtualized workloads on EMC XremIO
•Download as PPTX, PDF•
0 likes•3,829 views
The document discusses best practices for running virtualized workloads on an all-flash array. It covers topics like scale-out architecture, metadata management, data services, space reclamation, and virtualization efficiencies enabled by all-flash arrays. It also provides a case study of VMware's private cloud deployment using XtremIO arrays and discusses successes like supporting over 100,000 virtual machines created in 4 days for hands-on labs.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to Itzik Reich-EMC World 2015-Best Practices for running virtualized workloads on EMC XremIO
Similar to Itzik Reich-EMC World 2015-Best Practices for running virtualized workloads on EMC XremIO (20)
More from Itzik Reich
More from Itzik Reich (10)
Recently uploaded
Recently uploaded (20)
Itzik Reich-EMC World 2015-Best Practices for running virtualized workloads on EMC XremIO
- 1. 1© Copyright 2015 EMC Corporation. All rights reserved. 1© Copyright 2015 EMC Corporation. All rights reserved.
- 2. 2© Copyright 2015 EMC Corporation. All rights reserved. BEST PRACTICES FOR RUNNING VIRTUALIZED WORKLOADS ON AN ALL FLASH ARRAY ITZIK REICH, FIELD CTO, XTREMIO SHANE VAN BENTUM, OPERATIONS MANAGER, VMware 2© Copyright 2015 EMC Corporation. All rights reserved.
- 3. 3© Copyright 2015 EMC Corporation. All rights reserved. XtremIO: Leading By All Measures 1,400 customers 451 GROUP EMC takes the lead in strategic AFA technology GARTNER Magic Quadrant for Solid- State Arrays #1 IDC Worldwide All-Flash Array Revenue by Vendor, 1H14 40% OF TOP 100 & top 200 own XtremIO #1
- 4. 4© Copyright 2015 EMC Corporation. All rights reserved. • Scale-out architecture • Metadata management • Data Services & Management • Space reclamation in VM workload • Virtualization efficiencies driven by AFA BEST PRACTICES - SUMMARY
- 5. 5© Copyright 2015 EMC Corporation. All rights reserved. Go Fast (maybe solve economics) WHAT PROBLEM ARE YOU SOLVING? = + Get SmarterUse Flash
- 6. 6© Copyright 2015 EMC Corporation. All rights reserved. Thousands of VMs = I/O blender Provisioning & Cloning new VMs VMotion Operations A DAY IN THE LIFE OF A VIRTUAL DATA CENTER
- 7. 7© Copyright 2015 EMC Corporation. All rights reserved. LET ME TAKE YOU A FEW YEARS BACK
- 8. 8© Copyright 2015 EMC Corporation. All rights reserved. “EVERYTHING SHOULD BE MADE AS SIMPLE AS POSSIBLE BUT NOT ”SIMPLER
- 9. 9© Copyright 2015 EMC Corporation. All rights reserved. THE EVOLUTION OF “FLASH” ARRAYS Performance • Dual Controller • Single Workloads • No Data Services • High TCO • High Performance Gen 2 - 2008 • (Sometime) Data Services • Dual Controller • Single Workloads (VDI) • Post-Process Data Services • Lower TCO • Lower Performance Gen 3 - 2011 • Scale Out Architecture • Mixed Workloads • In-Line All the Time Data Services - Guaranteed • Lower TCO • High Performance Gen 4 - 2013 Gen1FlashSystems HybridArrays World of Compromise No Compromise
- 10. 10© Copyright 2015 EMC Corporation. All rights reserved. A SIMPLER WAY TO LOOK AT SCALE UP VS SCALE OUT
- 11. 11© Copyright 2015 EMC Corporation. All rights reserved. WHY ARE YOU BUYING THE LATEST What’s wrong with a year old architecture, it can still run your email app, right?
- 12. 12© Copyright 2015 EMC Corporation. All rights reserved. 12© Copyright 2015 EMC Corporation. All rights reserved. WHAT IS METADATA?
- 13. 13© Copyright 2015 EMC Corporation. All rights reserved. CONVENTIONAL METADATA 1GB Data Chunk Metadata record (~30 bytes) 1PB = 1,000,000 x 1GB chunks of data 1PB = 1,000,000 x 30 byte metadata records = 30MB of metadata 1PB Array 1M x 1GB data chunks 30MB metadata
- 14. 14© Copyright 2015 EMC Corporation. All rights reserved. WHY GRANULAR METADATA? • Vastly improved space allocation • Important for inherent load balancing • Important for data reduction effectiveness • Critical for effective copy data management • Why Content Based Metadata? PROVIDES SHORTHAND FOR WHAT’S ON THE ARRAY
- 15. 15© Copyright 2015 EMC Corporation. All rights reserved. METADATA DE-STAGING Dual Controller arrays don’t have enough memory to hold granular metadata in memory So they de-stage most metadata to the array AND MUST ACCESS THE ARRAY TO RETRIEVE IT AS NEEDED METADATA METADATA METADATA METADATA
- 16. 16© Copyright 2015 EMC Corporation. All rights reserved. METADATA IN A SCALE OUT ARCHITECTURE
- 17. 17© Copyright 2015 EMC Corporation. All rights reserved. XTREMIO IN-MEMORY CLONING PROVISIONING VM Provisioning in seconds! X-COPY / ODX COMMAND IN-MEMORY METADATA DATA ON SSD BLOCK BLOCK BLOCK BLOCK
- 18. 18© Copyright 2015 EMC Corporation. All rights reserved.
- 19. 19© Copyright 2015 EMC Corporation. All rights reserved. AGILE WRITEABLE SNAPSHOTS INLINE DATA AT REST ENCRYPTION XTREMIO DATA PROTECTION INLINE DEDUPLICATION INLINE COMPRESSION ALWAYS-ON THIN PROVISIONING XTREMIO DATA SERVICES ALWAYS-ON, INLINE, ZERO PENALTY, FREE
- 20. 20© Copyright 2015 EMC Corporation. All rights reserved. VMware’s Private CLOUD Shane van Bentum, Operations manager, VMware
- 21. 21© Copyright 2015 EMC Corporation. All rights reserved. VMware’s PRIVATE CLOUD VMware’s Private Cloud Agile Global Support Geo Management Over 220,000 VM Units deployed globally Dedicated global team running with VMware IT as a customer with a “Cloud First” policy Current availability maintained at 99.9% 75+ person worldwide team with solid experience and part of VMware R&D 24x7 monitoring and global support with VMware certified engineers
- 22. 22© Copyright 2015 EMC Corporation. All rights reserved. Scale & Growth Launched Built on vCloud Suite 10,000 VM units 65,000 VM units 120k VM Units Timeline Capacity Run Rate 150k VM Units 200k VM Units June 2012 January 2013 END June 2014 September 2014 December 2014
- 23. 23© Copyright 2015 EMC Corporation. All rights reserved. MAJOR TENANTS/USE CASES VMware’s Private Cloud Agile Global Support Geo Management Field Ops VMware Customer Labs, PSO, etc. Technical Marketing Hands-on-Labs For customers Corporate IT App teams Moving all IT Test/Dev GSS – Training Reference Environments and Customer Reproduction Management Business Unit Functional and scale testing of our management products Education Extended labs and Self-paced training TechOps Aggregating smaller cloud environments for various R&D/product teams for Testing purposes
- 24. 24© Copyright 2015 EMC Corporation. All rights reserved. Private Cloud Case Study: Education Services – Instructor Lead Training • These workloads are typically very IO intensive in very short bursts • Direct user interaction with the UI therefore requires a desktop like experience. • Virtual machines generally only have 1 week life span • One Template, many Clones
- 25. 25© Copyright 2015 EMC Corporation. All rights reserved. 100% SLA Direct VM Console interaction Nested Workloads PRIVATE CLOUD CASE STUDY: VMware HANDS ON LABS VMs Provisioned over 4 days: 100,000+ LAB Count: 10,000+ 500+ concurrent users Short vApp life High VM Curn rate
- 26. 26© Copyright 2015 EMC Corporation. All rights reserved. Why XtremIO Ability to support multiple mixed workloads that have disparate storage needs on a single consolidated platform Consolidate 700 spindle array into only 2 x-bricks by leveraging In Memory De-dupe and Compression Increase end user adoption of Private cloud by providing consistently superior performance, highly available and reliable solution Integrate with monitoring and management tools to simplify operations
- 27. 27© Copyright 2015 EMC Corporation. All rights reserved. Successes VMworld 2014 • 10,000+ Labs with over 100,000 VMs created over 4 days -A VM was created every 1.6 seconds which equals a full complex lab every 14.8 seconds! • Very low latency • Efficient use of Physical storage. -Avg overall efficiency 16:1 EDU – ILT • 100 or more classes running per week with over 1100 students • Lab performance has increased by 3x • Reduced classroom preparation time
- 28. 28© Copyright 2015 EMC Corporation. All rights reserved. Future • XtremIO has allowed us to offer high IOPS storage tier at relatively low cost per GB • Formalizing this storage tier and will be offering it to our internal tenants to run IO intense workloads outside of the use cases previously mentioned.
- 29. 29© Copyright 2015 EMC Corporation. All rights reserved. ALL FLASH ARRAY GOTCHAS!
- 30. 30© Copyright 2015 EMC Corporation. All rights reserved. ACHIEVING QUALITY OF SERVICE
- 31. 31© Copyright 2015 EMC Corporation. All rights reserved. SPACE RECLAMATION UNMAP QUESTION Upon a deletion of a VM and / or File(s) inside a VM, you would expect the capacity to return back to the array, right? YES NO
- 32. 32© Copyright 2015 EMC Corporation. All rights reserved. In-Guest Datastore When using Virtual Provisioning Storage Array, The deletion of a VM doesn’t cause the array to claim back the storage. It’s a two layer issue, inside the guest VM and outside the guest VM (at the datastore level) SPACE RECLAMATION
- 33. 33© Copyright 2015 EMC Corporation. All rights reserved.
- 34. 34© Copyright 2015 EMC Corporation. All rights reserved. YOUR CHOICE Microsoft sdelete RAXCO Virtualization
- 35. 35© Copyright 2015 EMC Corporation. All rights reserved. THE NUMBER OF VOLUMES QUESTION
- 36. 36© Copyright 2015 EMC Corporation. All rights reserved. EMC VSI Plugin vCenter plugin that can offload much of the array day to day tasks
- 37. 37© Copyright 2015 EMC Corporation. All rights reserved. INTEGRATED MANAGEMENT CONSOLE
- 38. 38© Copyright 2015 EMC Corporation. All rights reserved. ARRAY BASED INSIGHT USING OTHER TOOLS
- 39. 39© Copyright 2015 EMC Corporation. All rights reserved. THINK DIFFERENTLY ABOUT VM REPLICATION • Software Only - Hypervisor based replication solution • Disaster Recovery and Operational Recovery in VM-level granularity • Test, failover, failback and production recovery to any point-in-time per VM • Integrated Management & Orchestration with VMware’s vCenter GUI
- 40. 40© Copyright 2015 EMC Corporation. All rights reserved. SUMMARY VM level replication - any PIT • Easier OR & DR • Flexible RPO – up to Zero Data Loss (Sync) • No Single Point of Failure • Batch Protection & Multi-Site Built-in Orchestration • Automated Discovery & Provisioning • Resilient to HW changes • VM power-up order • Pre/Post Prompt & External Scripts • VMs Re-IP
- 41. 41© Copyright 2015 EMC Corporation. All rights reserved. • Scale-out architecture • Metadata management • Data Services & Management • Space reclamation in VM workload • Virtualization efficiencies driven by AFA BEST PRACTICES - SUMMARY
- 43. 43© Copyright 2015 EMC Corporation. All rights reserved. THE NUMBER OF VOLUMES QUESTION
- 44. 44© Copyright 2015 EMC Corporation. All rights reserved. USE EZT (EAGER ZEROED THICK)
- 45. 45© Copyright 2015 EMC Corporation. All rights reserved. WHAT ABOUT REPLICATION AND VMWARE SRM vSphere vCenter Server Site Recovery Manager vCenter Server Site Recovery Manager vSphere Production Site Recovery Site
- 46. 46© Copyright 2015 EMC Corporation. All rights reserved. AVOIDING THE LAST PIT ISSUE
- 47. 47© Copyright 2015 EMC Corporation. All rights reserved. SPACE RECLAMATION IN VM WORKLOAD
Editor's Notes
- In only its first year on the market, XtremIO has become the leading all-flash array (AFA) by every measure, including market share and the Gartner Magic Quadrant. Customers have adopted XtremIO more rapidly than any storage platform in history – $1BILLION run-rate in our very first year, with over 1400 customers and 40% of the Fortune 100. And most important of all, this huge early customer base has experienced well over 5x9s of reliability (and 6x9s for those deploying with VPLEX!), showing XtremIO is ready for the most mission-critical workloads. EMC purchased XtremIO in 2012 after evaluating every all-flash array startup in the world. XtremIO was picked because it innovated a fundamentally unique architecture that enabled the real end-game for AFAs: broad Tier 1 + workload consolidation for the agile data center. But we had to take our time to truly bullet-proof the product and integrate with best-of-breed EMC solutions, and we were in fact the last AFA to enter the market in November 2013. So why did we rocket to #1 so fast? Because we were the FIRST to market with the next generation AFA that can truly deliver massive mixed workload consolidation with rich application services.
- We will be covering the following best practices for why an AFA is the best array for the virtualization use case while also discussing some specific gotchas and how to overcome these.
- When you think about an AFA, the first thing that jumps to mind and it is also the thing that so many storage vendors tried to solve is to be really fast, we on the other hand, thing that being fast is a granted wish but we were focusing more on being the smartest array as well
- The reason for this is because when you look at the modern virtualized datacenter, you have the concept of the “I/O blender”, meaning that you have thousands of VMs performing IO all over the place, during this steady state IO, you also have provisioning operations that require additional / separate type of IO and lastly, the entire I/O blender is all over the place since the VMs keep moving from one host to the other using technologies like vMotion and DRS and can even move their data from one lun to the other using technologies like storage DRS.
- I want to take you a few years back to my life in a professional services team, I used to go to customer sites and analyze their storage infrastructure in a virtualized environment, and I manually tried to move the pieces round, basically, trying to eliminate hotspots, thing is that it worked for couple of months and then I had to come again, to move the pieces again because, as we covered, data in a virtualized world is very fluid and dynamic, it keep moving around, its like playing Tetris, there is always another piece that you need to manually move ..and it NEVER ends.
- You know when you design and build a storage product, there are always decisions that you can take that will male the product simpler from an engineering perspective on the expense on being a degraded end user product, this is NOT the route we chose to take and our design philosophy was backed by the famous albert Einstein..
- Lets look at a scale out architecture using an airplane, a long range airplane will typically have more than two engines, in this case we have 8 engines, all of them are working all the time < CLICK> and when an engine or engines fails, the surviving engines need to take ownership on the load. <CLICK> it wont make sense to design a product with so many engines where only one of them is working because when you design a product like an airplance, you design it for 99.999% of the time as oppose to the 0.00001% of the time which is the failure time.
- Another question is why do you need to buy the latest smartphone every two years or so, what's wrong with the iPhone 3GS for example, it can still run your corporate email, right? The reason that we rush to upgrade every year or two is that the moment a new cellphone being introduced into the market, new application will be written by developers to it that will know to take advantage of the new hardware, same apply for an AFA, you want to have the option to scale out because you are purchasing a storage array that will need to support your existing AND you FUTURE workloads, why limit yourself to a storage product that can only run some of your TODAY’s workload??
- Imagine the days of the public libraries, yes the ones you used to visit as a kid, remember that when you were looking for a book, you didn’t have to walk trough all the isles but instead you went for a catalog that told you were the book you are after is located. In essence, metadata allow you to see the actual data in a faster way.
- Using traditional metadata chunks size, we can see that we can lose a lot space
- Not only that we don’t use traditional metadata sizes, we also store the content based metadata that allow us to see the actual data in the fastest way possible.
- You want to store the metadata on the fastest media possible, e.g, RAM but since metadata seeking is expensive (done with the array controllers), dual architecture will be very limited in the amount of metadata they can store and in the number of controllers they have (two) so they have to destage the majority of metadata to the drives themselves which will make seeking the metadata much slower than if it was stored in RAM
- You want to store the metadata on the fastest media possible, e.g, RAM but since metadata seeking is expensive (done with the array controllers), dual architecture will be very limited in the amount of metadata they can store and in the number of controllers they have (two) so they have to destage the majority of metadata to the drives themselves which will make seeking the metadata much slower than if it was stored in RAM
- Lets look at a practical use case where metadata stored in RAM is important, for example, if you clone a VM using VMware XCOPY or Microsoft ODX, the XtremIO cloning will be super fast and it has nothing to do with the SSD drives, it mainly because of the fact we just create a lot of metadata pointers in the system, all stored in RAM!
- [Talk through and show the actual data services as the data flows through the array and highlight how this can only be done with a scale-out global in-memory metadata. This is the richest set of data and application services for any AFA, and they create dramatic efficiencies with data reduction that make XtremIO more cost-effective than disk-- but with none of the compromised performance consistency that Gen 2 and Gen 3 flash arrays suffer with post-processed data services. And with XtremIO, these data services are always free, bundled with the array.
- In the following section, we will cover some specific gotchas with AFAs in virtualized environments.
- One of the most requested features is Quality Of Service, aka, QoS, were going to see a demo of how XtremIO integrated with VMware QoS, aka SIOC.
- Now were going to speak about space reclamation, a question to you, Upon a deletion of a VM and / or File(s) inside a VM, you would expect the capacity to return back to the array, right? If you said No, you were right, the deletion of these will not cause of an automated return of the physical space to the storage array
- When using Virtual Provisioning Storage Array, The deletion of a VM doesn’t cause the array to claim back the storage. It’s a two layer issue, inside the guest VM and outside the guest VM (at the datastore level)
- Lets see how we can run space reclamation at the datastore level using our free VSI (Virtual Storage Integrator) plugin.
- Running space reclamation inside the VM is a bit more complex, you have two options, the free but not automated one using MS Sdelete or the automated and clever (but not free) option using a 3rd party tool like RAXCO PerfectStorage (http://www.raxco.com/products/perfectstorage )
- Here we can see how to apply ESXi host best practices (many of them exist) using our VSI plugin which will save you a lot of time and errors doing things manually.
- Many of us are not storage administrators but we still want to have an insight to the storage from the native tools we are using, for these, we have special integration with many products that will give you this insight, for example, Microsoft System Center, VMware vRealize Operations Manager, Oracle EMM