Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration

  • 1,408 views
Uploaded on

Hitachi Unified Storage VM (HUS VM) and Hitachi Virtual Storage Platform (VSP) flash technology helps increase performance and decrease total disk quantity and while lowering power, cooling and space …

Hitachi Unified Storage VM (HUS VM) and Hitachi Virtual Storage Platform (VSP) flash technology helps increase performance and decrease total disk quantity and while lowering power, cooling and space costs. Attend this WebTech to learn more about how to optimize Hitachi Unified Storage and Hitachi NAS Platform performance using flash acceleration, SSD storage, and other technologies.

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
1,408
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
46
Comments
0
Likes
2

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • Several system and application drivers are increasing the demand for high-performance storage solutions going forward
  • VMware – VMFS file system (Server consolidation + VDI)VMFS on block storage requires large amounts of random IOPSVMFS and customers can have higher density of VM’s per datastore thus reducing disk wastage.Customers can leverage vSphere 5 features like SDRS for tiered storage datastores for movement of VM’s between (tiers) using vmotionCustomers can leverage all vStorage API’s that are currently supported on the VSP i.e. VAAI, VASA, SRM & MPPRed Hat (OLTP workloads) – GFS / OCFS file systemsOLTP workloads demand high read/write IO with low latencyFor an I/O constrained OLTP database, many companies add HDDs to separate the database across many drives to alleviate the I/O bottleneck.Adding more HDD for just IOPS and not for increase disk capacity increases cost.IBM - GPFS file system (Analytics + Data Mining etc)Customers use GPFS to do low latency analytics, high-speed back up and recovery, high-speed file ingest, and optimize data workflow, enabling faster business process performance. Flexibility to support a wide variety of platforms - Linux, AIX, Windows
  • And the reasons are clear. The spinning disk performance of yesterday has been leapfrogged by the flash storage performance of today. In fact, on a device-by-device basis, a single Hitachi Accelerated Flash storage module that we deploy in our storage systems is capable of about 500 times more operations per second than what we once called a ‘high performance’ disk drive.
  • This chart demonstrates the per-device expectations of common storage media, and shows how significant the technological leap is to a Hitachi Accelerated Flash storage module. Any SSD leaps over the performance bar set by spinning disk drives, but Hitachi Accelerated Flash soars further ahead providing 5X more IOPS than an industry-standard SSD at similarly astounding response times. All this is done while offering significantly more capacity per device and the advanced memory management expected in such a robust Hitachi design.
  • One of those key innovation areas is now available to users in what we call Hitachi Accelerated Flash (HAF) storage, and our own flash storage memory controller that we internally called “Ashigara” and the unique packaging that it offered us. With over 80 patents either granted or pending for flash around the designs for this purpose built flash storage, it enables us a leadership position in flash.Built from the ground up to enable cost-effective, high-performance and high-density deployments of flash storage in enterprise data center environments, our Accelerated Flash storage raised the bar high above the capabilities of industry-standard SSDs that are the norm in the industry.The ability for Hitachi Accelerated Flash to manage more flash per controller, provide high-bandwidth performance and run advanced wear-leveling and diagnostics means our customers get the flash capacity and performance they need, without sacrificing reliability.
  • But Hitachi flash innovation extends well past our Flash controller and up into our HUS VM and VSP systems. While the SPC performance numbers that Silverton Consulting mentioned earlier in the presentation already demonstrated the high performance of our HUS systems, the architectures of the VSP and HUS VM allow for even greater performance scalability and customization.For years, storage systems were built with the idea that the performance was held back by spinning disk drives, and system software was optimized to make the most out of that situation. With flash, vendors are rushing to re-architect key parts of their onboard system code to more quickly move data around the inside of storage systems to keep up with the high performance of Flash. Hitachi, however, isn’t scrambling to deliver this customization. We already have.VSP optimization was delivered in 2012 and HUS VM will be delivered in June 2013. The system code for these arrays see significant flash-focused re-engineering, with over 30 fundamental changes to the code to enable higher thread-count processing and faster movement of data. Response times improve significantly and provisioning and functions become twice as useful.Of course, in staying with Hitachi’s focus on high-availability, these changes are non-disruptively installed and become transparent to other installed storage replication or management tools.
  • A layer above the infrastructure, sits a family of offerings aimed to provide intelligent access to business content and information. These software-based products provide management, protection, archiving and searching of your files, objects and information across the complete lifecycle.
  • A layer above the infrastructure, sits a family of offerings aimed to provide intelligent access to business content and information. These software-based products provide management, protection, archiving and searching of your files, objects and information across the complete lifecycle.
  • Such high performance optimizations allow us to produce no-compromise all-flash storage performance in our HUS VM, which competes with any all flash array for high performance with sub-millisecond response time to 500,000+ IOPS, but still brings all the functionality, availability and flexibility benefits of a non-Flash HUS VM. All of this happens with no changes to the serviceability and manageability of the systems. Hitachi Command Suite manages the system and the Dynamic Provisioning, Thin Image and the full suite of Hitachi replication tools can be leveraged as required.What if you decide that you want to add tiering and cost-effective hard drive capacity? HUS VM can be upgraded to a tiered storage system.Want a unified SAN/NAS system? No problem.
  • Our king of the hill is our multi-controller, massively scalable and rock-solid VSP. It has already proven 1M+ IOPS and the ability to handle multi-platform loads including the mainframe. The optimized code for VSP helped grow the performance scalability multiple times ahead of where the product was first launched delivering significant value to our customers.Many VSP customers are deploying Flash and tiering to scale the performance of their applications without having to completely re-architect their environments. Advanced management tools enable tiering but still provide a level of control to manage quality of service across applications by defining how much cache applications can utilize and even to “pin” critical data in flash.The other leading argument for tiering is an economic one.
  • Real customers are getting theefficiency of tiered flash storage today. Turkcell, a large GSM operator in Europe, is one such example and this is really a great case study that you could spend some timewith, seeing how the power of storage virtualization really can change an IT transformation. Turkcell leveraged flash and tiering to keep mainframe performance high, while vastly shrinking the amount of disk drives and racks deployed in their infrastructure.
  • Several system and application drivers are increasing the demand for high-performance storage solutions going forward

Transcript

  • 1. Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration Nick Jarvis Director, File, Content and Cloud Solutions August 14, 2013 1
  • 2. WEBTECH EDUCATIONAL SERIES HITACHI UNIFIED STORAGE AND HITACHI NAS PLATFORM PERFORMANCE OPTIMIZATION WITH FLASH ACCELERATION Hitachi Unified Storage (HUS) VM and Hitachi Virtual Storage Platform (VSP) flash technology helps increase performance and decrease total disk quantity while lowering power, cooling, and space costs. Attend this WebTech to learn more about how to optimize Hitachi Unified Storage and Hitachi NAS Platform (HNAS) performance using flash acceleration, SSD storage, and other technologies By attending this webcast, you’ll learn how to  Increase HUS and HNAS performance by using flash technology  Identify key technologies and products needed to achieve optimum results  Locate and tune key parameters necessary for performance optimization
  • 3. UPCOMING WEBTECHS  Maximize IT WebTechs ‒ Comprehensive and Simplified Management for VMware vSphere Environments – Now, Even Better!, September 11, 9 a.m. PT, 12 p.m. ET ‒ Easily Deploy Microsoft® Private Cloud and Microsoft SQL Server® 2012 Data Warehouse on Hitachi Converged Solutions, September 25, 9 a.m. PT, 12 p.m. ET Check www.hds.com/webtech for  Links to the recording, the presentation, and Q&A (available next week)  Schedule and registration for upcoming WebTech sessions  Questions will be posted in the HDS Community - http://community.hds.com/groups/webtech
  • 4. Hitachi Unified Storage and Hitachi NAS Platform Performance Optimization with Flash Acceleration Nick Jarvis Director, File, Content and Cloud Solutions August 14, 2013 4
  • 5. Drivers for High-Performance Storage
  • 6. FLASH USE CASES SUPPORTS APPLICATIONS THAT REQUIRE “RANDOM” WORKLOADS File Shares (unstructured) SQL Server Database Analytics Apps (Unix/Linux) VMware/VDI environments Oracle Database (Red Hat/OVM) VMFS OCFS/GFS File System NFS/CIFS CSV/NTFS GPFS/GFS HDFS/JFFS  All of the above applications generate high random read/write IO and require low latency.  Match use cases to flash implementations to deliver on performance promises at lowest possible overall system cost
  • 7. WHY ARE RANDOM IOPS WORKLOADS CRITICAL?  I/O workloads are either random (many concurrent accesses to relatively small blocks of data) or streaming (sequential data transfers)  Historically, random access has been associated with transactional workloads, which often represent an enterprise’s most critical IT operations  Adoption of “scale-out” architectures with networked storage − drivers for scale-out include server and desktop virtualization, database consolidation, complex analytics, and data warehousing  Even workloads that appear to be sequential from an individual application’s point of view actually become random as they interact with other workloads using advanced disk array capabilities like de-clustered RAID, thin provisioning, and automatic storage tiering
  • 8. FUNDAMENTAL STORAGE PERFORMANCE CHANGES AVAILABLE Yesterday’s High Performance Today’s High Performance A single Hitachi Accelerated Flash storage module can deliver 500X more IOPS than a single high-performance disk drive
  • 9. A PARADIGM SHIFT IN PERFORMANCE APPROXIMATE PER-DEVICE PERFORMANCE POTENTIAL Traditional Disk Drives Solid State Capacity Capacity Drives Performance Drives Commodity SSD Hitachi Accelerated Flash storage IOPS 80 200 20,000 100,000 Resp. Time 6 2 0.2 0.2 (milliseconds)
  • 10. HITACHI INNOVATION: FLASH CAPACITY HITACHI ACCELERATED FLASH STORAGE  Unique and patented Hitachi technology 100+ Related Patents Granted or Pending  High-bandwidth, multicore architecture allows high density and predictable performance  Industry improvements regarding ‒ Enterprise durability with cost-effective capacity ‒ Highest device density ‒ 5X device IOPS to SSD CPU and Flash Management Engine Block/Page Mapping Wear Leveling Data Refresh Performance Manager Contiguous Block Write Avoidance Endurance Manager
  • 11. FLEXIBILITY FOR APPLICATIONS Adopting an “ALL-IN-ONE” enterprise storage platform provides  Hitachi flash acceleration ‒ Firmware that has been re-engineered to increase scalability for host I/O processing on exiting VSP and HUS VM ‒ Can also be implemented without the need of SSD or Hitachi Accelerated Flash; however, adding either of these will provide performance improvements  Hitachi Accelerated Flash (HAF) ‒ The HDS flash memory controller (HAF) is a multi-core, high-bandwidth architecture that uses block and page mapping, wear leveling, an endurance manager, and inline write compression that results in up to 94% write reduction ‒ Hitachi custom designed and built  Hitachi Dynamic Tiering (HDT) hybrid storage ‒ ‒ Utilize automated sub-LUN dynamic tiering for pooling storage resources for application host access Thin provisioning capability for efficient storage utilization and better performance  Storage virtualization ‒ Virtualize up to 100+ external storage arrays and obtain the benefits of preserving existing assets, migration, and/or consolidation for management
  • 12. HITACHI INNOVATION: FLASH ACCELERATION SOFTWARE REENGINEERING TO EXPLOIT FLASH CAPABILITIES  30+ fundamental software changes to turbo-charge performance with flash ‒ New “express” I/O processing Hitachi Storage ‒ Higher internal thread count support ‒ Improved wide striping capability  Significant performance impacts ‒ Up to 65% reduction in response time ‒ Up to 2X Hitachi Dynamic Provisioning (HDP) scalability  Nondisruptive installation and transparent to current applications HUS VM and VSP Optimized for Flash Today
  • 13. HITACHI FLASH SOLUTIONS PORTFOLIO ENTERPRISE HYBRID ARRAY | INTELLIGENT CACHING | TEIRING Flash Acceleration Software Hitachi Accelerated Flash Hybrid Storage Tiering Scale  Flash acceleration improves HDP wide stripping scalability with hard drives up to 25%  HAF flash enclosure <76.8TB capacity  SSD <102TB, SAS <1.8PB, NL-SAS <3.7PB Performance  HAF flash <1,000,000 random I/O, <1ms latency with high consistency  *Flash acceleration 49% to 61% increased random I/O throughput Data management and protection  Storage tiering for HAF, SSD, SAS, NL-SAS (Hitachi Dynamic Tiering)  Management with Hitachi Command Suite * Only random performance is improved by flash acceleration; sequential performance is unaffected
  • 14. HITACHI FLASH SOLUTIONS PORTFOLIO ENTERPRISE | MIDRANGE HYBRID AND ALL FLASH ARRAY | CACHING | TIERING Flash Acceleration Software Hitachi Accelerated Flash Hybrid Storage Tiering Scale  Flash acceleration improves HDP wide stripping scalability with hard drives up to 25%  HAF flash enclosure <19.2TB capacity  SSD <51TB, SAS <900TB, NL-SAS <3.4PB Performance  HAF flash <500,000 random I/O, <1ms latency with high consistency  *Flash acceleration 49% to 61% increase random I/O throughput Data management and protection  Storage tiering for HAF, SSD, SAS, NL-SAS (Hitachi Dynamic Tiering)  Management with Hitachi Command Suite * Only random performance is improved by flash acceleration. Sequential performance is unaffected.
  • 15. HUS VM ALL FLASH: NO-COMPROMISE ALL-FLASH STORAGE 500,000 Up to 154TB IOPS, <1ms flash storage response Unified and virtualized capacity Best storage optimization for flash Best flash form factor and durability More flexible than all-flash systems Hitachi flash acceleration software Hitachi Accelerated Flash Hitachi Command Suite
  • 16. HITACHI VIRTUAL STORAGE PLATFORM: FLASH-ACCELERATED, ENTERPRISE-READY ADVANCED VSP FLASH OPTIONS CONTINUE ENTERPRISE LEADERSHIP  Virtualize and flash-enable current Hitachi and 3rd-party storage  Boost performance of multiple applications and platforms (including mainframe)  Economic savings from efficient data mobility over tiers with Hitachi Dynamic Tiering and Tiered Storage Manager ‒ Automate tiering of data ‒ Pin critical workloads in flash 1 Million IOPS ~200K more than EMC 40K 3X Scalability Without a forced box-swap
  • 17. HITACHI NAS FAMILY COMPARISON Unified Storage Dedicated storage Easy to deploy and manage Utilize dynamic tiering File deduplication HUS 110 HUS 130 HUS 150 HUS VM HNAS 4060 HNAS 4080-4100 Availability Symmetric HA Symmetric HA Symmetric HA Symmetric HA Clustered Failover Clustered Failover Number of Nodes 1 to 4 1 to 4 1 to 4 1 to 4 1 to 2 1 to 4 Connectivity NFS, SMB, iSCSI, Fibre Channel NFS, SMB, iSCSI, Fibre Channel NFS, SMB, iSCSI, Fibre Channel NFS, SMB, iSCSI, Fibre Channel NFS, SMB, iSCSI, Fibre Channel NFS, SMB, iSCSI, Fibre Channel Storage HUS 110 HUS 130 HUS 150 HUS VM AMS and/or VSP AMS and/or VSP Maximum IP storage capacity 360TB raw 756TB raw 2.88PB raw 3.4PB raw 8PB usable 16PB usable FM = File Module
  • 18. HNAS – STANDARD FILE SYSTEM File System Meta Data SAS User Data  Traditional file system approach  Mixed IO on the same media  All or nothing footprint  One type of disk for all types of I/O
  • 19. Optimized File System HNAS – TIERED FILE SYSTEM Meta Data FLASH/ SSD / SAS User Data SAS/NL -SAS  Optimized file system approach  Mixed IO placed on most effective and cost effective storage platform  Best TCO for workflow performance  Provides cost efficiency with equal performance by using fewer or lower cost disks  Can be deployed with or without SSD drives  New installation with no degradation in I/O performance  Performance benefits depend on application  Improved spindle efficiency (achieve performance target with less storage)  Metadata intensive operation (e.g. backup, replication or data migration)  Large Files (VMware, Oracle, etc..)
  • 20. Cluster Wide Read Cache HNAS – CLUSTER READ CACHING  Cluster wide read cache Read Caches Enabled 4 x Bandwidth  Accelerate read intensive I/O at scale  Cluster wide FLASH/SSD/ SAS  NFS v3 environments Read Caching Copy1 Meta Data User Data Copy2 Copy3 Slow Copy Copy4
  • 21. HNAS – LEVERAGING HDT FLASH  Optimized back-end storage ‒ Driven by HUS, HUS-VM and/or VSP ‒ Economic savings from efficient data mobility over tiers with Hitachi Dynamic Tiering, Tiered Storage Manager ‒ Automate tiering of data ‒ Pin critical workloads in flash FLASH/SSD HDT User Data TIER 1 DISK TIER 2 DISK
  • 22. FLASH + VIRTUALIZATION AT TURKCELL 3rd-largest GSM operator in Europe; 34.7 million subscribers
  • 23. Drivers for High-Performance Storage
  • 24. QUESTIONS AND DISCUSSION
  • 25. UPCOMING WEBTECHS  Maximize IT WebTechs ‒ Comprehensive and Simplified Management for VMware vSphere Environments – Now, Even Better!, September 11, 9 a.m. PT, 12 p.m. ET ‒ Easily Deploy Microsoft® Private Cloud and Microsoft SQL Server® 2012 Data Warehouse on Hitachi Converged Solutions, September 25, 9 a.m. PT, 12 p.m. ET Check www.hds.com/webtech for  Links to the recording, the presentation, and Q&A (available next week)  Schedule and registration for upcoming WebTech sessions  Questions will be posted in the HDS Community - http://community.hds.com/groups/webtech
  • 26. THANK YOU