Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

2018 bsc power9 and power ai

737 views

Published on

PowerAI and Power 9

Published in: Technology
  • If you’re looking for a great essay service then you should check out ⇒ www.WritePaper.info ⇐. A friend of mine asked them to write a whole dissertation for him and he said it turned out great! Afterwards I also ordered an essay from them and I was very happy with the work I got too.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • I am really happy with the car I got at auction. What a great deal. Thanks for your service and for your help. 》》》 https://w.url.cn/s/Aaxmqpl
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

2018 bsc power9 and power ai

  1. 1. © 2018 IBM Corporation IBM Cognitive Systems IBM OpenPOWER foundation Barcelona Supercomputing Center Power9 and PowerAI Ander Ochoa – ander.ochoa.gilo@ibm.com Cognitive Systems Technical Architect for SPGI https://es.linkedin.com/in/anderotxoa @AnderOtxoa IBM 2018
  2. 2. © 2018 IBM Corporation IBM Cognitive Systems 2
  3. 3. © 2018 IBM Corporation IBM Cognitive Systems IBM and AI • IBM Cognitive Systems SPGI team • The History of IBM and A.I. • AI, Machine Learning and Deep Learning • IBM current proposal for Deep Learning • HW, SW & Storage for AI workloads • What brings the near future
  4. 4. © 2018 IBM Corporation IBM Cognitive Systems IBM Cognitive Systems SPGI team 4 Ander Ochoa Architect Ander.ochoa.gilo2@ibm.com Carmen Recio Data scientist Carmen.recio.valcarce@ibm.com Cristina Gil Storage Cristina.gil.ortiz@ibm.com Any sufficiently advanced technology is indistinguishable from magic. “Hazards of prophecy: the failure of imagination” (Arthur C. Clarke) Ivan Peacock Technical Leader ivan_peacock@uk.ibm.com Hardware • POWER • Mainframe • … Software • PowerAI • DSX • … Services • PoCs • Projects • … Jordi Caubet HPC jordi.caubet@es.ibm.com
  5. 5. © 2018 IBM Corporation IBM Cognitive Systems IBM and AI • IBM Cognitive Systems SPGI team • The History of IBM and A.I. • AI, Machine Learning and Deep Learning • IBM current proposal for Deep Learning • HW, SW & Storage for AI workloads • What brings the near future
  6. 6. © 2018 IBM Corporation IBM Cognitive Systems  Deep Blue  Blue Geen  Playstation 3  Watson The History of IBM and A.I. Cluster of PS3s, U.S.A.F. 2,000 Console Supercomputer Image courtesy: U.S. Air Force IBM Deep Blue 1997 - chess playing computer defeated Kasparov A Blue Gene/P supercomputer at Argonne National Laboratory Watson, the computer program that crushed the human competition on the “Jeopardy!” quiz .
  7. 7. © 2018 IBM Corporation IBM Cognitive Systems
  8. 8. © 2018 IBM Corporation IBM Cognitive Systems IBM and AI • IBM Cognitive Systems SPGI team • The History of IBM and A.I. • AI, Machine Learning and Deep Learning • IBM current proposal for Deep Learning • HW, SW & Storage for AI workloads • What brings the near future
  9. 9. © 2018 IBM Corporation IBM Cognitive Systems HPC, Artificial Intelligence, Machine Learning, Deep Learning Artificial Intelligence Deep Blue Machine Learning Video/Audio Regressions Support Vector Machines Clustering H.P.C. (High Performance Computing) Optimization Deep Learning (Neural Networks)
  10. 10. © 2018 IBM Corporation IBM Cognitive Systems
  11. 11. © 2018 IBM Corporation IBM Cognitive Systems Very Computing intensive Algorithm Raw data Info • New paradigm of how computers interact with us. • So far traditional computing has been deterministic: Pre training Training Inference Process Pretrained Data Set A.I. framework A.I. Algorithm Infered data Responses Raw data Accuracy! Machine learning process Raw data Raw data Big Data Uses 80% time Big Data
  12. 12. © 2018 IBM Corporation IBM Cognitive Systems Algorithm Millions of photos Inferenced data In your Data Center 12 In the field Process Pretrained data A.I. framework A.I. Algorithm Infered data Responses Raw data Video streams Deep learning process example How Autonomous Cars are created
  13. 13. © 2018 IBM Corporation IBM Cognitive Systems
  14. 14. © 2018 IBM Corporation IBM Cognitive Systems Tesla Autopilot 2.0 hardware for inference – Nvidia Drive PX 2
  15. 15. © 2018 IBM Corporation IBM Cognitive Systems IBM and AI • IBM Cognitive Systems SPGI team • The History of IBM and A.I. • AI, Machine Learning and Deep Learning • IBM current proposal for Deep Learning • HW, SW & Storage for AI workloads • What brings the near future
  16. 16. © 2018 IBM Corporation IBM Cognitive Systems Very Computing intensive Pre training Training Inference Process Pretrained data A.I. framework A.I. Algorithm Infered data Responses Raw data Raw data Uses 80% time Hardware  Power Systems  Mainframe  Storage Software  Platfom computing  DataBases  ETLs  Data Mining Tools  DSX  PowerAI Vision Services  Data Miners  Data Scientists Hardware  Special Power Systems (AC922)  NVMe Storage Software  PowerAI  PowerAI Vision  Platfom computing Services  Data Scientists  3rd Party Special A.I. Teams Hardware  Special Power Systems (Newell)  NorthGate  3rd Party products (Nvidia Jetson TXn)  NVMe Storage Software  PowerAI Services  Data Scientists/Customer SPECIAL HW needed IBM Offering play ground Very Computing intensive
  17. 17. © 2018 IBM Corporation IBM Cognitive Systems Open Source Workloads Now hyper-focused on expanding Cognitive/AI industry applications Enterprise Support/Subscription model OpenPOWER 300 OpenPOWER members contribute to 87 OpenPOWER ready products and 17 servers, delivering choice to industry Close partnership with major AI/accelerator industry leader Nvidia OpenCAPI High bandwidth open interconnect to attach to accelerators and SCM Open Frameworks Highly optimized & accelerated Cognitive/AI frameworks Cognitive/AI SDK for deployment and deployment tools IBM Offering context
  18. 18. © 2018 IBM Corporation IBM Cognitive Systems What is our current base offering? https://goo.gl/ZtS81g https://public.dhe.ibm.com/software/server/POWER/Linux/mldl/ubuntu/
  19. 19. © 2018 IBM Corporation IBM Cognitive Systems 19 Transform & Prep Data (ETL) AI Infrastructure Stack Applications AI APIs (Eg: Watson) In-House APIs Machine & Deep Learning Libraries & Frameworks Distributed Computing Data Lake & Data Stores Segment Specific: Finance, Retail, Healthcare Speech, Vision, NLP, Sentiment TensorFlow, Caffe, SparkML Spark, MPI Hadoop HDFS, NoSQL DBs Accelerated Infrastructure Accelerated Servers Storage PowerAI
  20. 20. © 2018 IBM Corporation IBM Cognitive Systems Simplifies adoption of DL Fast time to deploy a DL environment Simplified Installation Precompiled DL libraries & frameworks Optimized performance: IBM Sytems unique capabilities Distributed DL Large Model Support Designed for Enterprise deployments Enterprise-ready software distribution for DL and AI
  21. 21. © 2018 IBM Corporation IBM Cognitive Systems Servers Roadmap
  22. 22. © 2018 IBM Corporation IBM Cognitive Systems Operator Interface • 1 USB 3.0 • Power Button • Service LED’s 4X - Cooling Fans • Counter- Rotating • Hot swap • 80mm Memory DIMM’s (16x) • 8 DDR4 IS DIMMs per socket Power 9 Processor (2x) • 190W & 250W BMC (Service Processor Card) • IPMI • 2x 1 Gb Ethernet • 1 VGA • 1 USB 3.0 PCIe slot (4x) • Gen4 PCIe • 2, x16 HHHL Adapter • 1, x8,x8 Shared HHHL Adapter • 1 x4 HHHL Adapter NVidia Volta GPU • 2 per socket • SXM2 form factor • 300W • NVLink 2.0 • Air Cooled Power Supplies (2x) • 2200W • Configuration limits for redundancy • Hot Swap • 200VAC, 277VAC, 400VDC input Storage • Optional 2x SFF SATA Disk • Optional 2x SFF SATA SSD • Disk are tray based for hot swap Note: Front Bezel removed 22 High level System Overview  2-Socket, 2U Packaging  40 P9 Processor cores  2/4/6 NVIDIA Volta 2.0 GPUs  2 TB Memory (16x - 64GB DIMMs)  4 PCIe Gen4 Slots  2x SFF (HDD/SSD), SATA, Up to 7.7 TB storage  Supports 1.6TB and 3.2TB NVMe Adapters  Redundant Hot Swap Power Supplies and Fans  Default 3 year 9x5 warranty, 100% CRU AC922 server Newell - POWER9 with increased GPU and IO bandwidth for differentiation
  23. 23. © 2018 IBM Corporation IBM Cognitive Systems
  24. 24. © 2018 IBM Corporation IBM Cognitive Systems https://www.nvidia.com/en-us/data-center/tesla-v100/ Volta architecture fits in the same power envelope and form factor as the previous Pascal generation GPU with 1.5x the memory performance, 2x the NVLink performance, and 7.8 teraflops of FP64 processing (15.7 teraflops at FP32) on the GPU (CUDA) cores and a total of 125 teraflops of processing performance with the tensor cores. The GPU
  25. 25. © 2018 IBM Corporation IBM Cognitive Systems 25 32-140+GB/s 64GB/s
  26. 26. © 2018 IBM Corporation IBM Cognitive Systems NVMe Storage Network technologies as transport OP OP SCSI / SAS / SATA IB ETH OP SCSI / SAS / SATA FC SCSI / SAS / SATA TCP IP HPC LPC L1 L3 L2 Storage 1 Instruction queues 32/256 command depth
  27. 27. © 2018 IBM Corporation IBM Cognitive Systems Evolution NVMe Storage Network technologies as transport OP OP SCSI / SAS / SATA IB ETH OP SCSI / SAS / SATA FC SCSI / SAS / SATA TCP IP HPC LPC L1 L3 L2 Storage NVMe NVMeNVMe 64K Instruction Queues 64K Instructions supported, each
  28. 28. © 2018 IBM Corporation IBM Cognitive Systems NVMe benefits • NVMe provides much greater bandwidth than SAS and SATA SATA SAS NVMe Throughput 6Gbps 12Gbps >120Gbps (in PCIe v3) Command Queue dephts 32 256 64.000 Queues 1 1 64000 • Lower latency • Lower power consumption
  29. 29. © 2018 IBM Corporation IBM Cognitive Systems IBM and AI • IBM Cognitive Systems SPGI team • The History of IBM and A.I. • AI, Machine Learning and Deep Learning • IBM current proposal for Deep Learning • HW, SW & Storage for AI workloads • What brings the near future
  30. 30. © 2018 IBM Corporation IBM Cognitive Systems TPU2 = Tensor Processing Unit Accelerates neural network computations IBM TrueNorth Neuromorphic CMOS integrated circuit
  31. 31. © 2018 IBM Corporation IBM Cognitive Systems TrueNorth neuropsynaptic chip http://www.research.ibm.com/articles/brain-chip.shtml TrueNorth, once loaded with a neural network model, can be used in real-time as a sensory streaming inference engine, performing rapid and accurate classifications while using minimal energy. TrueNorth’s 1 million neurons consume only 70 mW, which is like having a neurosynaptic supercomputer the size of a postage stamp that can run on a smartphone battery for a week.
  32. 32. © 2018 IBM Corporation IBM Cognitive Systems Where do we go from here: Summit & Sierra The United States Department of Energy together with Oak Ridge National Laboratory and Lawrence Livermore National Laboratory have contracted IBM and Nvidia to build two supercomputers, the Summit and the Sierra, that will be based on POWER9 processors coupled with Nvidia's Volta GPUs. These systems are slated to go online in 2018 http://www.teratec.eu/actu/calcul/Nvidia_Coral_White_Paper_Final_3_1.pdf IBM Summit #1 !! IBM Sierra #3 !!
  33. 33. © 2018 IBM Corporation IBM Cognitive Systems 33
  34. 34. © 2018 IBM Corporation IBM Cognitive Systems Part of Mare Nostrum 4 • 3 Racks • 54 Power9 Systems • 54 AC922 servers • 4x Nvidia V100 • 512 GB RAM • 6.4 TB NVMe storage • 1.48 Pflops ! BSC Mare Nostrum 4
  35. 35. © 2018 IBM Corporation IBM Cognitive Systems THANK YOU!
  36. 36. © 2018 IBM Corporation IBM Cognitive Systems Notice and disclaimers  Copyright © 2017 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM.  U.S. Government Users Restricted Rights — use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM.  Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. This document is distributed “as is” without any warranty, either express or implied. In no event shall IBM be liable for any damage arising from the use of this information, including but not limited to, loss of data, business interruption, loss of profit or loss of opportunity. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided.  IBM products are manufactured from new parts or new and used parts. In some cases, a product may not be new and may have been previously installed. Regardless, our warranty terms apply.”  Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice.  Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary.  References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business.  Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation.  It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law.
  37. 37. © 2018 IBM Corporation IBM Cognitive Systems Notice and disclaimers continued Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM expressly disclaims all warranties, expressed or implied, including but not limited to, the implied warranties of merchantability and fitness for a particular, purpose. The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right. IBM, the IBM logo, ibm.com, AIX, BigInsights, Bluemix, CICS, Easy Tier, FlashCopy, FlashSystem, GDPS, GPFS, Guardium, HyperSwap, IBM Cloud Managed Services, IBM Elastic Storage, IBM FlashCore, IBM FlashSystem, IBM MobileFirst, IBM Power Systems, IBM PureSystems, IBM Spectrum, IBM Spectrum Accelerate, IBM Spectrum Archive, IBM Spectrum Control, IBM Spectrum Protect, IBM Spectrum Scale, IBM Spectrum Storage, IBM Spectrum Virtualize, IBM Watson, IBM z Systems, IBM z13, IMS, InfoSphere, Linear Tape File System, OMEGAMON, OpenPower, Parallel Sysplex, Power, POWER, POWER4, POWER7, POWER8, Power Series, Power Systems, Power Systems Software, PowerHA, PowerLinux, PowerVM, PureApplica- tion, RACF, Real-time Compression, Redbooks, RMF, SPSS, Storwize, Symphony, SystemMirror, System Storage, Tivoli, WebSphere, XIV, z Systems, z/OS, z/VM, z/VSE, zEnterprise and zSecure are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at: www.ibm.com/legal/copytrade.shtml. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.

×