Klaus Gottschalk from IBM presented this deck at the 2016 HPC Advisory Council Switzerland Conference. "Last year IBM together with partners out of the OpenPOWER foundation won two of the multi-year contacts of the US CORAL program. Within these contacts IBM develops an ac- celerated HPC infrastructure and software development ecosystem that will be a major step towards Exascale Computing. We believe that the CORAL roadmap will enable a massive pull for transformation of HPC codes for accelerated systems. The talk will discuss the IBM HPC strategy, explain the OpenPOWER foundation and the show IBM OpenPOWER roadmap for CORAL and beyond." Watch the video presentation: http://wp.me/p3RLHQ-f9x Learn more: http://e.huawei.com/us/solutions/business-needs/data-center/high-performance-computing See more talks from the Switzerland HPC Conference: http://insidehpc.com/2016-swiss-hpc-conference/ Sign up for our insideHPC Newsletter: http://insidehpc.com/newsletter

2. Fundamental forces are accelerating change in our industry
Processor technology alone can no longer provide
the price performance gains necessary to sustain
Moore’s Law
Scale-out & Hyperscale
Data Centers
Hybrid Cloud
Open Solutions
IT consumption models
are expanding to:
A better processor and full
system stack open
innovation required
Price/Performance
Moore’s Law
Processor
Technology
2000 2020
Firmware / OS
Accelerators
Software
Storage
Network
2

3. • Data & infrastructure silos
• Data induced bottlenecks
• Blindly adding capacity
• Data duplication and more silos
• Ad hoc cloud usage
Complexity
Cost
Availability
Traditional compute & storage approaches won’t suffice…
3

4. Price/Performance
Semiconductor
Technology and
Processors
2000 2020
IBM HPC strategy
POWER8
era
Shift back towards the Moore’s Law prediction through:
1. IBM HPC Innovation (processor architecture enhancement, scalable filesystems, workflow management)
2. Acceleration through partner ecosystem (e.g. NVIDIA GPUs deliver 2X perf/watt and ~3X performance)
POWER9
era
IBM HPC
Innovation
Acceleration
Moore’s Law,
Client
Expectations
4

5. IBM Vision: Data-Centric Computing
• Hardware and software to support & enable compute in data
• Allow workloads to run where they run best
Minimize Data Motion
• Introduce “active” system elements including network,
memory, storage
• Global access to shared data
Enable Compute
Everywhere
• Balanced, composable architecture
• Modular and upgradeable design scalable up to 100s of racks
Modularity
• Use real workloads/workflows to drive design points
• Co-design for customer value
Application-driven
design
5

6. IBM HPC Innovations and Investments:
Our Commitment to HPC
Processor Design
• POWER8, POWER9, 14nm
Processor Design
Processor Interfaces
• CAPI, POWER with NVLink
Technology
Filesystems& Storage
Solutions
• IBM Spectrum Scale
• Elastic Storage Server
• HPSS
• IBM FlashSystem
Compilers, Development,
Libraries
• IBM XL, Parallel Environment,
ESSL
MPI and Cluster
Programming
• IBM Platform MPI, OpenMP 3.1
and 4.0 Development
Workload & Cluster
Management
• IBM Platform Cluster Manager,
xCAT
• IBM Platform LSF Power and
Data-Aware Scheduling
6

7. Highlights: IBM HPC around the World 2014-2015
IBM, Mellanox, and NVIDIA
awarded $325M U.S.
Department of Energy’s
CORAL Supercomputers
GENCI announces
collaboration with IBM on
speeding the path to
exascale computing.
DESY collaborates with IBM
Research selects Software
Defined Storage SDI, IBM
Power for particle
accelerator data
UK Government Invests £115
Million in Big Data &
Cognitive Computing
Research with STFC and IBM
Leading oil and gas firm
selects IBM for workload
management
LSU selects a comprehensive
IBM HPC solution for
genomics research
Integrated Portfolio:
IBM Power Systems
Software Defined
Infrastructure
IBM Storage
IBM Research
With many, many more around the world… 7

8. OpenPOWER: Open Architecture for HPC & Big Data
Processor IP
Licensing
Open
Interfaces
Systems
& Software
Licensing IP to enable semiconductor partners like Suzhou
Powercore to build POWER chips
Tight integration using CAPI & NVLink with Accelerators
(NVIDIA, Xilinx, Altera), Networking (Mellanox), Storage (CAPI
Flash)
Enabling Innovative POWER-based servers from Partners &
OpenCompute and Sharing Open Source Software including
Firmware & Hypervisor
8

9. Major Wins Endorse the Strategy and Establish the Path Forward
IBM, Mellanox, and
NVIDIA awarded $325M
U.S. Department of
Energy’s CORAL
Supercomputers
IBM & UK’s STFC Partner
for Big Data & Cognitive
Computing Research in
£313M Partnership
CORAL: Leadership Class
Supercomputers5X – 10X HIGHER APP PERF THAN CURRENT SYSTEMS
US, UK, German Scientific Research Communities Select OpenPOWER or Commit to OpenPOWER Collaboration
PADC Opening
October 12th, 2015
Jülich Supercomputing Centre
POWER Acceleration
and Design Center (PADC) Roadmap Toward CORAL

10. 190+ Open Power Foundation Members
10

11. 1900+ Applications Run on POWER
Big Data &
Machine Learning
Cloud Mobile Enterprise
Major Linux Distros
HPC
miniDFT
CTH
BLAST
Bowtie
BWA
FASTA
HMMER
GATK
SOAP3
STAC-A2
SHOC
Graph500
Ilog
CHARMM
GROMACS
NAMD
AMBER
RTM
GAMESS
WRF
HYCOM
HOMME
LES
MiniGhost
AMG2013
OpenFOAM
11

12. POWER8: Processor Performance Leadership
Memory
Buffer
DRAM
Chips
POWER8
12 Cores, 96 Threads
4 Level Large Caches
Up to 1 TB per socket
Up to 230 GB/s sustained
Faster Cores
8 Threads Per Core
Larger Caches
Direct Accelerator
Interconnect
3x Higher Memory
Bandwidth, 1 TB
Memory per Socket
12

13. HPC Application Performance
0,0
0,5
1,0
1,5
2,0
2,5
3,0
Relative Performance
Haswell Based POWER8 – S822LC
POWER8: Up to 2.5x Faster on Applications over
Intel Haswell x86 CPUs
13

14. Shared System Memory via Coherent Interface 2.5x Faster CPU-GPU Connection via NVLink
OpenPOWER: Tight integration using CAPI & NVLink
POWER
CPUs
Memory
FPGA
CAPI
Coherent Accelerator
Processor Interface
14

15. IBM OpenPOWER-based HPC Roadmap
2015 2016 2017
POWER8
POWER8+
POWER9
OpenPower
CAPI Interface
NVLink
Enhanced
CAPI &
NVLink
Connect-IB
FDR Infiniband
PCIe Gen3
ConnectX-4
EDR Infiniband
CAPI over PCIe Gen3
ConnectX-5
Next-Gen Infiniband
Enhanced CAPI over PCIe Gen4
Mellanox
Interconnect
Technology
IBM CPUs
NVIDIA GPUs Kepler
PCIe Gen3
Volta
Enhanced NVLink
Pascal
NVLink
IBM Nodes
15

16. New IBM “LC” Power Systems for Linux
812LC
CPU
Memory
1x POWER8 CPU
10 cores, 2.9-3.3 GHz
Up to 1 TeraByte Memory
115 GB/s Memory Bandwith
14 Drives (84TB, HDD, SSD)
Optimized for Hadoop, Spark,
In-Memory Analytics
822LC
CPU
Memory
Optimized for Databases and
Cloud Workloads
CPU
2x POWER8 CPU
10 cores each, 2.9-3.3 GHz
Up to 1 TeraByte Memory
230 GB/s Memory Bandwith
2 Drives (2 TB, HDD, SSD)
822LC
HPC
CPU
Memory
Built for HPC and Deep
Learning
CPU
2x POWER8 CPU
10 cores each, 2.9-3.3 GHz
Up to 1 TeraByte Memory
230 GB/s Memory Bandwith
2x NVIDIA Tesla K80 GPUs
GPU GPU
16

17. IBM Software Defined Infrastructure for diverse workloads
IBM Platform Computing
Big Data /
Hadoop
High
Performance
Analytics
High Perf
Computing
Make lots of computers
& storage look like
one resource pool
Scale Up and Out
Prioritized matching of
supply with demand
Benefits
ü Efficient utilization
ü High Availability
ü High Throughput
ü High Performance
ü SLA Prioritization
ü Reduced cost
IBM Spectrum Storage
x86 Linux on z
IBM FlashSystem
IBM Hybrid Storage IBM Tape Storage
On-premise, On-cloud, Hybrid Infrastructure
(heterogeneous distributed computing and storage environment)
Other
Commercial
Other
New Gen
App
Framework
Other
17

18. IBM Platform LSF 10.1 (Q2 2016)
• Productivity-centric, enterprise-class workload
management for HPC environments
• Intelligent policy-based data management
• Optimized for both high throughput and traditional
HPC applications
12x less work
150x less work
6x less work
LSF 9.1.2 (2013) LSF 9.1.3.3 (2015) 5.8 million jobs/hr
High throughput synthetic benchmark externally audited and verified
Superior repeatable performance = better business outcomes
IBM Confidential until announced
Ease of Use
•Understand why
workload is not
running
•Understand when
work will run
HPC Accessibility
•Web enabled workflows
•Simplify migration
to the cloud
Performance
at Scale
• Delivering next
evolution of
performance and
scalability
18

19. Wellcome Trust Sanger Institute
Using analytics to optimize high performance computing capacity across 15,000 cores
Problem
The Wellcome Trust Sanger Institute, a non-profit research organization
based in Hinxton, England, wanted to accelerate results to meet scientific
journal publication deadlines and secure funding for future projects.
Solution
• Platform LSF® policy-based scheduler
• IBM® Platform™ Analytics with Custom dashboards showing cluster
utilization according to criteria such as job, job submitter & memory use
• IBM® Platform™ Process Manager for workflow design and execution
Outcome
• Each job runs on the optimal compute node increasing throughput across
the HPC environment
• Researchers understand the factors that reduce processing efficiency,
and take action to improve performance
• A clear record of efficient compute utilization enables a
strong business case for future growth investments
Industry: Research
Products: IBM Platform™ LSF®
IBM Platform Analytics
IBM Platform Process Manager
Overview
Profile
“Analytics is one of the most significant IT
investments that we have made. We needed
the IBM solution to deliver the HPC utilization
required to help our research teams generate
results rapidly, meet their publication
deadlines and, ultimately, secure new
funding.”
Dr. Peter Clapham
Principal Systems Administrator, Informatics Systems
Group, Wellcome Trust Sanger Institute
19

20. IBM Spectrum Scale 4.2 and IBM Elastic Storage Server
• Reduce capital and operating expense for storage supporting very large scale data
• Enable a common pool of storage for modern workloads with unified file and object storage
• Policy-driven compression and Qualities of Service
• Accelerate analytics applications
• Eliminate need to move data back and forth from Hadoop/HDFS
storage silos with integrated HDFS
• Automate Big Data deployment with Apache Ambari support
• Speed and simplify deployment
• New Spectrum Scale GUI consistent with Spectrum Storage family
• Expand management options with Spectrum Control integration
• Fully functional virtual machine demonstration lowers barriers to adoption
Available since November 20 (IBM Spectrum Scale)
November 6 (IBM Elastic Storage Server)
20

21. DESY - Research institute in Germany
Accelerating experimental outcomes with IBM Software Defined Infrastructure
Solution components
The Challenge
Deutsches Elektronen-Synchrotron needed a solution that
could keep up with one of the most powerful x-rays in the world,
rapidly delivering experimental results to researchers
The Solution
A high-performance IBM storage and compute solution to support
increasingly sophisticated experiments and offers analysis-as-a-
service, allowing scientists to tap into DESY’s particle accelerator
facilities and access the data from anywhere in the world.
The Results
§ Accelerates research with data available for analysis in
4 minutes, down from 2-3 days
§ Accommodates more demanding projects, handling 20GB/second
§ Scales up for continuing innovation
• IBM® Elastic Storage™ Server
• IBM Spectrum Scale
• IBM Platform HPC
• IBM Power Systems™ running Linux
• IBM Advanced Business Partner:
MCS Moorbek Computer Systeme GmbH
"The ability to provide scientists with data on very short time scales
has changed the way experiments are done at the beam line.”
--Steve Aplin, senior scientist 21

22. Actionable Intelligence with Optimized Performance
IBM FlashSystem and Spectrum Scale
IBM FlashSystem powered by FlashCore™ Technology
is optimized to deliver extreme performance, reliability,
and low latency in the most demanding environments
IBM FlashSystem
All active files
Eliminate costly performance bottlenecks
IBM
FlashSystem
Hot Files
HDD Storage All other files
Data Metadata
IBM
FlashSystemSpectrum Scale
Primary storage
1 Million
IOPS
Response
Times under
0.5 millisecond
Over 6 GB/s
sequential
read
throughput
As a cache device As a storage tier As a metadata storage device
22

23. Leading Object Storage Innovation: Spectrum Scale and Cleversafe
IBM offers complementary Object storage offerings - each delivering
industry leading innovations for different workloads / use cases
• Cleversafe is designed to enable secure, large scale active archives and
cloud-based content repositories where focus is on lowest cost at scale
• Erasure coding delivers cost-efficient reliability, requiring less space than triple copy approaches
• Unique keyless encryption technology provides strong security for Object archives
• Spectrum Scale offers large scale File & Object storage that supports
high performance processing and big data analytics
• Supports multiple architectures: storage rich servers; NAS clusters; globally distributed grids
• POSIX support for scale-out OLTP databases and data warehouses
• Integrated lifecycle management across Flash, Disk and Tape tiers
23

24. High Performance Storage System (HPSS)
Improved storage economics and data availability
OpenStack Swift
• Oak Ridge National Laboratory cut redundant tape costs by 75% with 4+P
HPSS RAIT and up to 872 MB/s file-transfers
• Enterprise tape recommended access order (RAO) for faster tape recalls
• HPSS Trash Can
• File system and traditional disk storage tiers
• Production ready on Power8
• OpenStack “Swift On HPSS” provides object interface for file sharing
• Stop corrupted files from making it to tape with end-to-end data integrity
• 219 MB/s per tape drive using 2.6 MB files
24

25. IBM is helping our clients…
ü Expand from traditional compute-centric to a data-centric HPC model
ü Efficiently manage the lifecycle of all data including files and objects
ü Achieve new insights from all data while improving data economics
ü Store, analyze and protect data with a hyperscale converged infrastructure
Maximize
Performance
Enable New
Workloads
Optimize
Efficiency
25

26. More Information
For more information:
• High performance computing (HPC) and technical computing solutions
• http://www-03.ibm.com/systems/power/solutions/high-performance-computing/
• http://www-03.ibm.com/systems/technicalcomputing/
• FindIT: your gateway to find and use the top assets you need for any given sales situation
• https://findit.cloud.dst.ibm.com
• Redbook: Implementing an IBM High-Performance Computing Solution on
IBM POWER8
• http://www.redbooks.ibm.com/abstracts/sg248263.html?Open=
26

27. Questions?
27