Linux world consolidation of storage infrastructures 2006
•
0 likes•1,873 views
Linux world consolidation of storage infrastructures 2006
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to Linux world consolidation of storage infrastructures 2006
Similar to Linux world consolidation of storage infrastructures 2006 (20)
Recently uploaded
Recently uploaded (20)
Linux world consolidation of storage infrastructures 2006
- 1. © 2006 Hitachi Data Systems Consolidation of Storage Infrastructures by using Virtualization Solutions Sascha Oehl Hitachi Data Systems
- 2. 2© 2006 Hitachi Data Systems Agenda What is Storage Virtualisation Business Driver Q&A Summary How it works
- 3. 3© 2006 Hitachi Data Systems SNIA: The Customers Speak
- 4. 4© 2006 Hitachi Data Systems Virtualization Overview - SNIA Storage Virtualization Definition “An act of integrating one or more (back end) services or functions with additional (front end) functionality for the purpose of providing useful abstractions. Typically virtualization hides some of the back end complexity, or adds or integrates new functionality with existing back end services.” The SNIA Dictionary http://www.snia.org/education/dictionary/v/ Defines Virtualization as Contrary to this definition the competition adds complexity and reduces functionality
- 5. 5© 2006 Hitachi Data Systems How to manage a data avalanche? Appropriate Virtualisation techniques could support you managing the data avalanche!
- 6. 6© 2006 Hitachi Data Systems Application Optimized Storage™ definiert Application Optimized Storage ist: A family of integrated storage solutions that enable alignment of IT and business objectives by providing application-centric optimization of storage performance, availability, cost, and protection.
- 7. 7© 2006 Hitachi Data Systems The AOS Storagesystmes: Tagmastore™ What is Tagmastore: (tagma) = to groupΤάγμα A family of integrated storage solutions built upon a common framework of comprehensive storage, data, content, and application services providing the appropriate infrastructure, management, and data delivery to optimize all application storage requirements A key element of this philosophy is the integration of different vendor’s storage systems and the integration of these systems into a unique approach for tiered storage. This includes a fundamental cross system and cross vendor management.
- 8. 8© 2006 Hitachi Data Systems Standard Approach Thunder 9500v Lightning 9960 Lightning 9980v Other Data Value Data Mining ERP File Service Billing Order System Email Print Service
- 9. 9© 2006 Hitachi Data Systems USP Virtualisation Approach Thunder 9500v Lightning 9960 Lightning 9980v OtherUSP Data Value Data Mining ERP File Service Billing Order System Email Print Service USP
- 10. 10© 2006 Hitachi Data Systems SNIA Storage Virtualisation
- 11. 11© 2006 Hitachi Data Systems Solution Requirements - IT View • The existing Storage Infrastructure should be reused in the new concept. • Standard Tasks should be eased up. • Secure consolidation between Vendorspaces and Customers • Usage of Storage Space regardless which vendor has supplied the Space. • A single user interface for the total storage infrastructure. • Less work on weekends. • Simplified storage management.
- 12. 12© 2006 Hitachi Data Systems Solution Requirements - DR View • Extended similar function usage for all storage infrastructure • Replication from data between different vendor storage infrastructures. • Extended Distance Replication with old or modular storage systems. • Less impact to operational IT due to replication tasks. • Usage of storage space rather than vendor space.
- 13. 13© 2006 Hitachi Data Systems Solution Requirements - Business View • Changing Service Level Objectives should be reflected in storage infrastructure. • The IT has to meet the Service Level Agreements. • Data should reside on value equivalent storage quality. • Different Regulations should be covered which requires e.g. replication of data to a data centre in a wide distance.
- 14. 14© 2006 Hitachi Data Systems Tiered Storage and Virtualization Understanding “Storage Virtualization” • Integrates a group of independent storage devices into a single pool of storage capacity independent of their physical location • Facilitates the use of storage tiers to match data life cycle needs • Simplify and Unify heterogeneous control and management under a single interface – Common volume management, security, replication and copy services for all heterogeneous storage • Dynamically allocate capacity as needed to any class of storage – Enable the matching of the storage resources to the business requirements with assurance of QOS
- 15. 15© 2006 Hitachi Data Systems Example of a current data centre
- 16. 16© 2006 Hitachi Data Systems
- 17. 17© 2006 Hitachi Data Systems Example of a virtualised data centre
- 18. 18© 2006 Hitachi Data Systems The Engine • Up to 192 FC Ports • Up to 256 GB Cache • Up to 1152 Internal Disks • Internal Raid 5, Raid 6 + Raid 10 Support • Up to 32 PB managed Storage • No port down for code upgrades B E D P A I R B E D P A I R B E D P A I R B E D P A I R Shared Memory Cache Side Processor Side Cache Side Processor Side CACHE FED Shared Memory Cache Side Processor Side Cache Side Processor Side CACHE FED Shared Memory Cache Side Processor Side Cache Side Processor Side CACHE FED Shared Memory Cache Side Processor Side Cache Side Processor Side CACHE FED
- 19. 19© 2006 Hitachi Data Systems • One physical port can support multiple virtual ports – Also called Host Storage Domains – Enables consolidation of mixed workloads – Reduction of number of ports – Higher port utilization can be achieved – Investment protection • Server Priority Manager – Allocates bandwidth to virtual ports based on QoS requirements • IOPS or MB/s • No port down for code upgrades Port Virtualisation The Basics
- 20. 20© 2006 Hitachi Data Systems Virtualisation The Concept ELUN is a LUN which is mapped to a LUN in an external storage device
- 21. 21© 2006 Hitachi Data Systems • Volume Migration: – Volume Migration allows a seamless migration of data between different Storage spaces. Every internal or attached Storage space could be used as Migration source or target. – Migration is done without interfering the server. – The Server is up an running during migration. – Volume Migration could be used for data movement for migration purposes or for realignment to storage classes. Volume Migration Example Migrating existing Storage LUN 00 LUN 00 Intern E0 Server LUN 00 Intern I0 Existing Storage USP Storagesystem Volume Migration Single Server Downtime
- 22. 22© 2006 Hitachi Data Systems Volume Migration between storage Tiers works Vol Online Volume Migration LUN 00 Intern I0 Data Access Data Access Online
- 23. 23© 2006 Hitachi Data Systems Hitachi Virtual Partition Manager The Concept • Cache Logical Partition (CLPR) – Assigned specific cache capacity – Assigned one or more Parity Groups to use the cache • Storage Logical Partition (SLPR) – Assigned one or more CLPRs – Assigned one or more Target Ports to use the CLPRs
- 24. 24© 2006 Hitachi Data Systems Hitachi Virtual Partition Manager An example FED Front End BED Back End Cache Disk Back End 32 FC 32 FC 32 FC 16 FC 16 Ficon BED BED BED BED USP Storagesystem 256 GB Virtualised Storage System
- 25. 25© 2006 Hitachi Data Systems Hitachi Virtual Partition Manager An example FED Front End BED Back End Cache Disk Back End 32 FC 32 FC 32 FC 16 FC 16 Ficon 160 GB BED BED BED BED 16 GB USP Storagesystem 256 GB 24 GB56 GB Virtualised Storage System
- 26. 26© 2006 Hitachi Data Systems Correct data location Relocate an Application Consolidate Retire an Array Add an Array Archive volumes … Exchange DB Exchange Log Order Entry DB Web Commerce Appl. Development Transaction logs Reservation Sys Manufacturing DB Help Desk Food Distribution Scheduling Logistics Mapping USP mit externen Speicher Storage-Infrastructur appears as a Storage Pool Applicationdata is stored in the approperiate Storage Tier / Class Simplification HiCommand Tiered Storage Manager in Action
- 27. 27© 2006 Hitachi Data Systems The Management Interface
- 28. 28© 2006 Hitachi Data Systems Trend: Evolution of Storage Goes Toward Consolidation and Automation
- 29. 29© 2006 Hitachi Data Systems Global Cache with separation of control and data Lightning: Introduction of first scalable crossbar switch architecture Lightning V: Introduction of Virtual Storage Ports and Host Storage Domains with second generation of crossbar switch architecture HiCommand Storage Services Manager: Introduction of Storage Area Management and heterogeneous (external) storage management Cross-System Copy is introduced to move data between Lightning V and Thunder V without host intervention Universal Storage Platform enables large-scale virtualization of externally attached storage behind third generation crossbar switch architecture 1995 2000 2002 2003 2003 2004 Hitachi Storage Virtualisation An Evolutionary Approach
- 30. 30© 2006 Hitachi Data Systems • Using Hitachi’s External Storage Virtualisation allows changing the storage location of data without changing the appearance to the server. • The Fibre Channel Addressing, Source ID, Target ID, in the Frame Header and the FCP_LUN Information in the Payload field are not changed by the migration of the data between storage level. • The device files in the Operating System are still the same. There is no impact to the server‘s IO Subsystem. • The data is unmodified. A devirtualisation is easy achievable. No vendor lock-in. Freedom for Data
- 31. 31© 2006 Hitachi Data Systems Tiered Storage Externally Reference Customers
- 32. 32© 2006 Hitachi Data Systems Summary • High reliable and stable platform • Coverage of FC and FICON • Easy integration of existing storage and server infrastructure • Storage Pooling across different Vendorspace • Single Management Interface • Single Replication Tool • Manages Storagespace rather then Vendorspace • Excellent Price / Value • Changing SLO are easy implementable • Consolidation tools between different vendor and customer
- 33. 33© 2006 Hitachi Data Systems Is your data in the right place?
- 34. Questions/Discussion © 2006 Hitachi Data Systems Thank you for your attention ! sascha.oehl@hds.com
Editor's Notes
- The Storage Networking Industry Association (SNIA) recently surveyed a number of end users on their main concerns with storage. These are the top five, in order of priority. There aren’t any surprises here. Tiered storage, as part Application Optimized Storage Solutions, addresses these pain points head on. But in order to understand the specific role tiered storage plays, we need to look at what Hitachi Data Systems means by Application Optimized Storage solutions.
- The key message is that HDS is creating solutions that enable organizations to optimize storage infrastructure based upon application requirements. It is important to differentiate between optimizing applications with storage vs. optimizing storage to match application requirements. HDS does not claim to optimize applications, as that falls outside the core competencies of a storage company. Our core competency is optimizing storage based upon application requirements, in support of top line business objectives.
- The key message is that HDS is creating solutions that enable organizations to optimize storage infrastructure based upon application requirements. It is important to differentiate between optimizing applications with storage vs. optimizing storage to match application requirements. HDS does not claim to optimize applications, as that falls outside the core competencies of a storage company. Our core competency is optimizing storage based upon application requirements, in support of top line business objectives.
- If we look at a typical enterprise system we would find data stored on potentially inappropriate hardware, the graph here shows data storage in decreasing order of reliability (and therefore value) and data in terms of organisational value, maximum at the top {CLICK} In most systems today some of the important Data is in the most appropriate storage. In this example we have the Billing and Data Mining Data on the current most sophisticated solution, the Lightning 9980v - but the ERP system, despite being potentially the most important current data asset, is on the least appropriate system, either because it was the first system to be placed in the SAN or because of the complexities of moving it elsewhere. By introducing USP {CLICK}
- We can use the USP’s management system to move the high value data immediately onto the fastest most reliable storage hardware in the system {CLICK} but, perhaps more importantly, we can tell the USP to over time realign the complete data centre against the most appropriate storage solution {CLICK}. Thus USP allows the experienced Data manager to move for the first time towards a Tiered Storage Solution, vastly improving the SAN performance and maximising the return on this considerable corporate asset {CLICK}
- The Storage Networking Industry Association defines virtualization as: “An act of integrating one or more (back end) services or functions with additional (front end) functionality for the purpose of providing useful abstractions. Typically virtualization hides some of the back end complexity, or adds or integrates new functionality with existing back end services.” Okay, maybe a bit clinical, but it does highlight the point that virtualization is suppose to hide some of the complexity of storage. It is a key enabler to implementing and managing tiered storage. Virtualization overall: Allows for all multidimensional tiers to be consolidated into one pool Enables management of storage as one pool rather than separate tiers from a central console Enables such tasks as adjusting tiers and moving data without affecting the SAN, hosts, or applications Simplifies the implementation and management of storage tiers The Universal Storage Platform and Network Storage Controller offer a unique implementation of virtualization within the storage array. Not only does the Universal Storage Platform and Network Storage Controller offer virtualization, but it has a unique capability to logically attach additional storage arrays and virtualize those volumes and present them to the SAN as one storage pool, both to Open Systems hosts via the SAN and to mainframe hosts. To understand the need for tiered storage, customers should know the problems this solution will solve.
- Hitachi Virtual Partition Manager Logical partitioning’s main enhancement is the partitioning of cache which is required to provide QoS. It prevents a heavy cache user from impacting other users who share the same TagmaStore Universal Storage Platform. With the Lightning 9900 V Series and Thunder 9500 V Series we could guarantee safe multi tenancy with Host Storage Domains. Multi tenancy means that multiple users can share the same storage port without over writing or seeing each other’s address space. Multi tenancy alone can not guarantee QoS unless the cache is also partitioned. This allows mission critical applications to share the same TagmaStore Universal Storage Platform. Critical applications used to require their own storage systems, since you would not want one application to do a data base re org while another critical application is going through peak processing. The logical partitions also have virtual serial numbers for chargeback.