Hp - The Future For Scale Out Computing


Published on

Mr Dennis Ang, General Manager High Performance Computing of Hewlett-Packard
Dennis Ang is the General Manager, High Performance Computing (HPC) for Hewlett-Packard's Asia-Pacific Region. He has been with HP since 2001 and has been responsible for business development activities to drive adoption of HPC across the region.

Dennis' career in IT span more than 25 years including technical, business development and management roles and responsibilities with several major IT companies.

Topic - The Future of Scale-Out Computing

This presentation will highlight key aspects of Scale-Out Computing. It includes an update on the growth of High Performance Computing by the engineering and scientific community brought about by the fast adoption of industry-standard cluster computing technology and also the advent of Cloud Computing. It will also introduce key technologies, services and research collaboration from HP and its partners to address Scale-Out Computing requirements.

Published in: Technology, Business

Hp - The Future For Scale Out Computing

  1. 1. The Future For Scale-Out Computing Dennis Ang Hewlett-Packard Asia-Pacific Region Dec 11, 2008 Technology for better business outcomes © 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
  2. 2. Key Topics • Drivers of Scale-Out Computing − HPC Trends − Advent Of Cloud Computing • The Challenges Of Scale- Out Computing • HP In Scale-Out Computing 2 15 December 2008
  3. 3. Drivers of Scale-Out Computing 3 15 December 2008
  4. 4. Top Trends in HPC HPC hit an all-time high of $11.5 billion in 2007 19% CAGR in server factory revenue over last 4 years X86 and Linux still dominate Clusters continue to gain shares across all segments Mid- to low-end of the market continue to fuel the growth Blades are making in-road to all segments Oil/Gas, CAE, DCC and EDA are high growth areas New challenges for datacenters: Power, cooling, real estate, system management, system consolidation Storage and data management continue to grow in importance IDC data; market remains hot; growing in strategic importance. 4 15 December 2008
  5. 5. TOP500 Performance Projections 1 Eflop/s 100 Pflop/s 1 Pflop/s 10 Pflop/s 1 Pflop/s 100 Tflop/s 10 Tflop/s SUM 1 Tflop/s 6-8 years 100 Gflop/s N=1 10 Gflop/s 1 Gflop/s N=500 100 Mflop/s 1993 1995 1997 1999 2001 2003 2005 2007 2009 2011 2013 2015 5 15 December 2008
  6. 6. Some interesting data Eight years ago: ASCI White Today: one rack full of Bl2x220c •#1 on the Top500 in June 2001 Peak performance: 12,288 Gflop/s Peak performance: 12,288 Gflop/s Weight: 106 Tons (w/ 160 TB storage) Weight: ~2000 lbs (~1 ton) – 100x lighter Power: 3MW Power: ~30KW – 100x less power Cost: US$110 million Cost: ~ US$1M -- more than 100x lower cost 6 15 December 2008
  7. 7. From rack-mount to blade Example configuration: 256-node cluster w/ InfiniBand BladeSystem Advantage Power: up to 30% saving Floor space: from 8 racks to 5 racks Network cables: up to 78% less And excellent manageability! 7 15 December 2008
  8. 8. HP in the Top500 (Nov’07) HP BladeSystem www.top500.org @ 28% share 1 20 21 40 41 60 61 80 • From launch in 81 101 121 100 120 140 June 2006 141 161 181 160 180 200 201 220 • Most popular 221 241 240 260 261 280 single platform, 281 301 300 320 with 151 entries 321 341 361 340 360 380 381 400 401 420 421 440 FootNote : TOP500 (Nov’ 08) 441 460 461 480 -209 entries for HP overall 481 500 -201 c-Class Blades @ 40% Share HP c-Class HP other 8 15 December 2008
  9. 9. ‘EKA’, the world’s 13th fastest supercomputer and #2 in Asia, delivering 175 Tflops peak performance, used for: Advanced modeling and simulation in computational sciences Cutting edge R&D in HPC, Petascale design Cloud computing research Based on highly scalable, high efficiency HP core technologies HP Cluster Platform 3000BL 1822 HP ProLiant BL460c server blades with 28 terabytes memory InfiniBand 4X DDR HP XC cluster management, HP MPI message passing libraries EKA in CRL’s Rajiv Gandhi InfoTech 140 terabytes storage, HP SFS parallel file system Park HPC Facility, Hinjewadi, Pune HP Smart Cooling data center services “Computational Research Laboratories (CRL), a wholly-owned company of the Tata Group, India’s largest conglomerate, used HP blades, cluster OS and technical assistance to design and implement the high performance, high efficiency system EKA, the 8th fastest supercomputer in the world. HP’s highly scalable core technologies, such as BladeSystem c-Class server blades and data center cooling services, have helped CRL design and deploy EKA’s supercomputing infrastructure for cloud computing research with Yahoo. This is the world's largest system used for research in cloud computing.” S. Ramadorai, 2008 9 Chairman of CRL 15 15 December 2008 December
  10. 10. Cloud Computing is Changing the Game reach The Cloud The virtualized services Web information & e-commerce The Internet connectivity time 1970 1980 1990 2000 2005 2010 2020 10 15 December 2008
  11. 11. What do we mean by cloud? Service providers Service users The cloud is a means by which certain types of highly scalable and flexible services can be delivered and consumed over the internet through a as-needed, pay-per-use business model What’s new? New access: New capabilities: New connections: everything is a multi-tenant software information in context service 11 11 15-Dec-08 15 December 2008
  12. 12. Adaptive Infrastructure is the foundation to all technology-enabled services… Business outcomes Business outcome Technology-enabled services Traditional applications Cloud-based applications Infrastructure as a service Internally hosted Externally hosted Infrastructure Utility Infrastructure Utility Adaptive Infrastructure standardized – optimized – Adaptive Infrastructure standardized – optimized – automated automated automated Pooled resources -- shared infrastructure Pooled resources -- shared infrastructure 12 12 15-Dec-08 15 December 2008
  13. 13. Targeting the Convergence of Massive Scale-Out Emerging business models: Best performance = Enterprise/HPC • Engineering & Massive faster time to revenue New metrics: • Geo-Sciences Life & Materials Sciences Scale-Out Best performance per $/watt/sq. ft. • Defense/Security • Financial Analytics • Scientific Research • Digital Content Creation • Streaming Media Extreme pain points: Data center constraints Photo/Video of power, cooling, space, Sharing Web 2.0 manageability & automation • Internet Commerce of dynamic workloads • Interactive Media • On-Line Gaming Market Requirements : Optimized supply chain & unique products and services 13 15 December 2008
  14. 14. The Challenges Of Scale-Out Computing 14 15 December 2008
  15. 15. Scale-Out Changes Everything Traditional IT Scale-Out Single core Multi-core Single site Multi-site 100s of nodes 1,000s of nodes Proprietary Commodity HW resiliency SW resiliency Max performance Max efficiency Data Marts Data Super Centers Systems Grids/Cloud Static Dynamic Cost-Center Revenue-Center Shared storage Replicated storage Facility costs Power costs 15 15 December 2008
  16. 16. Scale-Out challenges • Grow the business – Scale performance – Rapidly integrate new capacity – Deploy globally • Physical data center constraints – Power – Cooling – Density • Control IT spend – Reduce TCO – Reduce software costs – Ease of management and automation – Vendor reach & reliability Bridge the gap between scale and performance 16 15 December 2008
  17. 17. Data Center Challenges • Datacenters constraining growth − Density, power, and cooling demands outpacing capacity in many data centers • More energy efficiency needed − Increasing energy costs driving focus on improving power efficiency • Faster capacity expansion required − Companies outgrowing data center capabilities and need immediate expansion space • Increased focus on capital expense Belady, C., “In the Data Center, Power and Cooling Costs More than IT Equipment it Supports”, Electronics Cooling Magazine (Feb − Pay as you grow enables capex postponement, 2007) and more efficient procurement 17 4/1/2008 15 December 2008 HP Confidential
  18. 18. HP In Scale-Out Computing 18 15 December 2008
  19. 19. HP Adaptive Infrastructure for Scale- Out Designed for massive scale-out Automate the environment for Dense Software dynamic workloads Servers Infrastructure & Storage Next-Generation Data Center Data Center Data Center New baselines Infrastructure Services Provide new business for energy, models for delivering floor space technology as a & cooling service 19 15 December 2008
  20. 20. Recent additions to HP’s Scale-Out portfolio Announced Announced July 16, 2008 May 28, 2008 Performance Optimized Proliant BL2x220c Datacenter (POD) • Double compute density • Industry-standard Flexibility • Infrastructure costs in half • Best-in-class Density • Maximum power & cooling • Fast & easy deployment efficiency • Energy Effectiveness StorageWorks ExDS9100 Extreme scalability Unified manageability Extreme affordability Announced May 6, 2008 20 15 December 2008
  21. 21. Double the Compute Power in the same 20MW Data Center Expects the 2-in-1 blade to save ½ a data center Deliver movies to market faster, faster rendering, increase creative productivity, take on more projects at once • Installed the first order for over 100 TeraFlops of BL2x220c • Recently deployed 200TF more of BL2x220c due to success of first implementation • 2x the performance - Same amount of power in half the space • Designed, tested, integrated, shipped and rapidly deployed internationally 21 15 December 2008
  22. 22. HP innovating across the Scale-Out value chain Successful Scale-Out Deployments HP process innovation HP technology innovation ISV partnerships & joint applications & development tools HP-MPI, multi-core initiative development provisioning, monitoring, resource proprietary & open source s/w, streamline for scale-out scheduling & mgmt integrated OS stacks OS & networking integrated OS stacks, direct R&D with customers IB in c-class rapid & flexible deployment flexible compute services, customized supply chain cluster platform energy efficiency chip to chiller energy portfolio, design for TCO c-class blades data center consulting & services performance optimized EYP MCF datacenter compute & storage infrastructure c-class infrastructure, scale-out custom engineered nodes optimized compute & storage 22 15 December 2008
  23. 23. The HP-Intel-Yahoo Open Cloud Computing Research Test Bed What is it? An open, scalable, secure, large scale global test bed for cloud computing research and education Collaborative research focused on software, data center management, hardware issues at a larger scale than ever before; as well as support research on cloud applications and services Scalable, multi-continent, multi-datacenter, cloud computing system A broad base research community including HP, Intel, Yahoo and other partners and academic researchers 23 15 December 2008
  24. 24. Open Cloud Computing Research Testbed Initial 6 “Centers of Excellence” around the globe Singapore IDA, UIUC, KIT, Intel Lab, Yahoo and HP Labs Specific research agenda to each region external + internal nodes; fluid boundary Each center: 1000-4000 cores and few PB storage base service: PRS (physical resource set) required services: EC2, S3, and Hadoop-on- demand plus additional local extensions/variants/service types 24 15 December 2008
  25. 25. HP - The Leader for Scale-Out Environments • Expertise in scale-out computing • Superior economics • Innovative products and services to address emerging PetaScale & Cloud Computing • Global research initiative and technology partnership 25 15 December 2008
  26. 26. 26 15 December 2008