Uploaded byBjorn Andersson
High-Throughput Storage for Production Environments
This document discusses scalability and availability challenges for high-throughput storage in production environments. It presents Hitachi's portfolio and solutions to meet these challenges, including unified storage platforms, file and content solutions, and a high-throughput storage solution with Lustre. This Lustre solution combines Hitachi's high availability with Lustre's scalability using pre-architected building blocks for easy design and deployment, simplified management, and support from a single vendor.
More Related Content
Similar to High-Throughput Storage for Production Environments
![JAP-IT-Solution-Document-SSD[81939].pptx](https://cdn.slidesharecdn.com/ss_thumbnails/jap-it-solution-document-ssd81939-250626060608-e27e6313-thumbnail.jpg?width=640&height=640&fit=bounds)
High-Throughput Storage for Production Environments
- 1. 1 HIGH-THROUGHPUT STORAGE FOR PRODUCTION ENVIRONMENTS BJORN ANDERSSON,HITACHI DATA SYSTEMS INTERNATIONAL SUPERCOMPUTING CONFERENCE 2013, LEIPZIG © Hitachi Data Systems Corporation 2013. All Rights Reserved.
- 2. SCALABILITY AND AVAILABILITY −THE CHALLENGES Scale-up and scale-out ‒ Different applications require different approaches Beyond the physics of a single system or small cluster ‒ More complexity (hundreds to many thousands of parts) ‒ More vulnerability (things break, bad things happen) Bottom line: You need to architect for it from the start ‒ Higher-quality sub systems for higher reliability ‒ Design for resiliency and high availability ‒ Use the right technology in the right place ‒ How does a technology refresh impact availability? SCALABILITY AND AVAILABILITY – OPPOSING FORCES?
- 3. ELEVEN INDUSTRY SEGMENTS GROUPREVENUE BY INDUSTRY SEGMENT 11％ 9％ 7% US$112B 8% 13% 7% 8% 9% 4％ 7% Power Systems Social Infrastructure and Industrial Systems Electronic Systems and Equipment Construction Machinery High-Functional Materials and Components Component and Devices Automotive Systems Digital Media and Consumer Products Financial Services Others 17％ Information and Telecommunication Systems WHO IS HITACHI? HITACHI, LTD. ORGANIZATION
- 4. HITACHI ENTERPRISE-CLASS HERITAGE R&D innovation and leadership ‒ A big user of HPC ‒ Key HPC vendor in Japan, expanding globally Quality and reliability Service and support A 50+ YEAR HERITAGE OF LEADERSHIP IN THE ENTERPRISE-CLASS COMPUTE MARKET 1957: HIPAC-MK1 – First Hitachi Digital Computer
- 5. INTEGRATED SCALABLE STORAGE PORTFOLIO SPECIALIZED APPLIANCES HDISINGLE HDI SOFTWARE HDI DUAL CONTENT PLATFORM HCP 300 HCP 500 HITACHICOMMANDSUITE BLOCK-ONLY PLATFORMS VSP FILE-ONLY PLATFORMS HNAS 3080 HNAS 3090 HNAS 3200 UNIFIED PLATFORMS HUS 110 HUS 130 HUS 150 HUS 110 HUS 130 HUS 150 HUS VM HUS VM
- 6. UNIFIED MANAGEMENT ACROSSALL STORAGE SYSTEMS INTEGRATED SCALABLE PORTFOLIO Hitachi Unified Storage VM Hitachi Unified Storage 100 Hitachi Virtual Storage Platform Midrange Entry-Level Enterprise Enterprise
- 7. HITACHI COMPUTE PORTFOLIO HIGH-END BLADE MIDRANGE BLADES RACK- OPTIMIZED High availability, performance and scalability for the enterprise Optimized for virtualization, maximizing utilization in the data center Highly dense chassis design optimized for virtualization and consolidation Compact and flexible with a variety of blade and connectivity options Compact and flexible application server platform Available in Hitachi file and content solutions CB 2000 CB 500 CR 220 CB 320 CR 210
- 8. FOUNDATION |DATA CENTER DELIVERY CLOUD INTELLIGENT ACCESS FILE |CONTENT | SEARCH File and content storage Indexing and search Intelligent object management CONVERGED INFRASTRUCTURE STORAGE | COMPUTE | NETWORK Integrated components include Hitachi servers Fast time to value Predictable, reliable results ENTERPRISE | MIDRANGE STORAGE INFRASTRUCTURE Reliability and performance Sustainability Superior economics MANAGEMENTSOFTWARE OUR PORTFOLIO IS YOUR FOUNDATION: SOLUTIONS WHEN AVAILABILITY MATTERS
- 9. HDS HIGH-THROUGHPUT SOLUTIONWITH LUSTRE Combines HDS high availability with Lustre scalability Easy design and deployment with pre-architected building blocks Simplified management with included management tools Streamlined vendor management with single infrastructure vendor Global presence and support COMPLEMENTS HNAS FOR THE MOST CAPABLE FILE STORAGE OFFERING Hitachi NAS Platform (HNAS) High-Performance NAS HDS High-Throughput Solution with Lustre Scalability Functionality
- 10. HITACHI DATA SYSTEMSHIGH-THROUGHPUT STORAGE SOLUTION WITH LUSTRE SINGLE-RACK CONFIGURATION Second High-Availability Object Storage Server Pair First High-Availability Object Storage Server Pair High-Availability Metadata Server Cluster Management and Network 2RU x86 Rack Server 2RU x86 Rack Server HUS 150 5RU 84-Disk Tray 5RU 84-Disk Tray OSS BUILDING BLOCK 1RU x86 Rack Server 1RU x86 Rack Server HUS 110 (Internal Disk) MDS BUILDING BLOCK 1RU x86 Rack Server (Running Intel Chroma and Hitachi Command Suite) Network Switch SOLUTION FRAMEWORK 12GB/Sec Target Performance, 760TB Usable Capacity (1PB raw)
- 11.
Editor's Notes
- #2 Hello, I’m Bjorn Andersson with Hitachi Data SystemsThank you Intel for inviting me, we have a great partnerships where we use Intel technology in many of our products and solutions, storage and serversMy talk today will primarily focus on Production HPC environmentsWe typically sell to customers who care about uptime and availability as well as scalability. They are often commercial enterprises or a larger user community depends on their services being availableI only have limited time today so I can only give you a glimpse into what we’re doing, I invite you to discuss with me afterwards or visit our booth for a deeper discussion
- #3 The title of my talk is about scalability in production environments – where availability matters – which if you think about it may seem like a challenge/contradictionTwo options for scaling, bigger more capable building blocks or many of lesser building blocksWe have hardware accelerated NAS systems and large memory blade systems with 1.5TB, so we can do scale-up alsoAt some point you have to go beyond the capabilities of a single system or small cluster though and then you’re definitely into scale-outScale-out can potentially mean more complexity and with that more vulnerabilityArchitect for scalability with availability (and manageability) from the startLook at your applications and use the right technologyPlan forward for technology refreshesWe have a broad portfolio, including systems we sell to banks and other environments where high availability is a must
- #4 Hitachi’s fiscal year runs from April to March.Total FY10 revenue: $112B (17% Y/Y growth)20% of overall R&D investment is in Information Systems and Telecommunications segmentsFY09: $96BFY08: $102BFY07: $112.2B FY06: $87BAny investment made in information technology, whether it’s networking, telecommunications, enterprise servers, super computers, storage systems, other storage solutions, etc., Hitachi Data Systems utilizes cross-pollination to reap the benefits of that investment and leverages it for the development of other products.Taking a look now at the composition of Hitachi, Ltd’s business and the vertical markets it competes in. Hitachi, Ltd. has 11 distinct business segments, which comprise the over 20,000-strong product portfolio. Comprising about 17% of total sales for last fiscal year is the Information Systems and Telecommunications Group. This is the most strategic business segment for Hitachi, and many times, the most profitable as well. This comprises storage systems, storage consulting services, super computers, telecommunications equipment, gigabit Ethernet routers, SONET switches, enterprise blade servers, which are now being sold in North America, Korea, as well as Japan and other geographies. Basically, all information systems in telecommunications, IT and networking all unified in one group spanning servers, networking and storage. Powerful unification amongst these three facilitates great cross-pollination efforts. NOTE: HGST is included in Component & Devices segment, not Information & Telecommunication Systems.Power Industrial Systems and Social Infrastructure & Industrial Systems are very profitable business segment for Hitachi, Ltd. This comprises everything ranging from Shinkansen Bullet Trains (the trains in Tokyo and other regions of the world that can go in excess of 150 to 160 miles-per-hour), thermonuclear fusion reactors; heavy earth-moving equipment; various turbines that are being made in conjunction with General Electric; and so forth. If your customer is interested in earth moving equipment, Hitachi produces bulldozers and cranes and other earth-moving equipments. (Note Caterpillar competes with Hitachi).There is also the financial services business segment comprised of various capital and leasing corporations, within Hitachi Ltd., which constitutes about 4% of overall total sales. The Electronic Systems and Equipment segment covers primarily semiconductor manufacturing equipment contributed to 9% of overall revenues. Hitachi, Ltd. has its own semiconductor fabrication operation which provides a distinct advantage over competitors. While many competitors rely upon third-parties for semiconductor chip manufacturing, we have our own fabrication plants, which gives us a powerful story from a vertical integration perspective.High Functional Materials & Components and Automotive Systems are a rather interesting group with tremendous industry expertise not many people are aware of. For one, Hitachi, Ltd. is a key supplier to automotive companies such as Honda, Toyota, Mazda, and General Motors. Case in point, Toyota recently turned to Hitachi, Ltd. for hybrid motors for its Lexus RX 400H hybrid.The turbo chargers in the Mazda Miata; the hoses and rubber materials in many of the Nissan cars leverage manufacturing innovations from Hitachi, Ltd. Another example, Hitachi, Ltd. owns a subsidiary called the Xanavi (Spelled x-a-n-a-v-i) which is a leading provider of navigation systems for automobiles. In fact, if you go to your local Infinity or Nissan dealer, all the navigation systems in those vehicles are from Xanavi, owned by Hitachi.
- #5 In 1957 Hitachi developed it’s first digital computer HIPAC-MK-1In 1964 – The same year IBM announced the S/360 - Hitachi introduced the HITAC 5020 – The first large general purpose computer in JapanHITAC 8000 followed in 1965, with HITAC 8100 for small business.1967 HITAC 8210 – First medium scale general purpose compute using integrated circuits1979 – M200 – World’s fastest large general purpose computerSource: IPSJ Computer Museum: http://museum.ipsj.or.jp/en/computer/main/index.html
- #6 As well look at the HDS portfolio, The new HUS products will be establishing a new category of unified storage. We will continue to sell our AMS2000 and VSP as our midrange and enterprise block storage offerings. Over time, the block only configurations of HUS will replace the AMS2000. The HNAS product line will continue to be our file only line. Dedicated content storage can be delivered by HCP. This is a very good solution for cloud infrastructure and/or archiving. HDI is our data ingestor that is capable of moving data from the edge to the core where it can be better protected.By the 2nd half of 2012, all of these platforms will be managed by Command Suite. 7 years ago Hitachi announced a vision of a common management platform that will enable one platform for all data. The administrative efficiencies of this approach provides a lot of cost savings to our customers.
- #7 Within our integrated, scalable storage portfolio, this new platform fills the gap between enterprise and midrangeIt will be positioned as a new, entry level enterprise storage platformIt is a unified extension to our new family of HUS products and bridges the gap to our VSP enterprise systemIt is complemented by the rest of the portfolio of NAS, HCP, HDIAnd unified management across the line creating a comprehensive architecture for all data
- #8 Overview, from rackmount to high end blades, using Intel arhcitecture
- #9 We have a broad portfolio addressing both traditional data center environments and functionality that we put under the Cloud umbrella, Infrastructure cloud, content cloud, information cloudA layer above the infrastructure, sits a family of offerings aimed to provide intelligent access to business content and information. These software-based products provide management, protection, archiving and searching of your files, objects and information across the complete lifecycle.