© 2013 SGI®
1
SGI®
HPC Update
Bill Mannel
VP, Servers
© 2013 SGI®
2
Speed and Scale
∞	
  0	
  
Human	
  Scale	
  Atomic	
  to	
  Cellular	
   Astronomical	
  Subatomic	
  
106	
  10-­‐6	
  10-­‐15	
  
1024	
  
1016	
  
1018	
  
Exascale	
  
Femtometer	
  
Lightyear	
  
YoDascale	
  
Finding Answers™
© 2013 SGI®
3
Agenda
• SGI® UV™
• SGI® ICE™ X
© 2013 SGI®
4
SGI UV 2: The Big Brain
Computer
•  Focus on Solving Your Problems,
Not IT Problems
•  No-Limit Computing, Built on
Industry Standards
•  World's Largest In-Memory System
for Data-Intensive Applications
World-leading Capability for Data Intensive Work, now
with Intel® Xeon® Processor E5-4600 Product Family.
© 2013 SGI®
5
SGI UV
“Anything Is
Possible … with
Effort”
Enterprise
SMP
“No Limit Computing: Anything is possible”
“Anything Is
Possible … at a
Price”
SGI® UVTM 2000
Commodity
Clusters
Workstation
“Some Things are
Possible”
Big Brain Computer
© 2013 SGI®
6
SGI UV
Open Source
Analytics
Workgroup Development
KVM Virtualization	

Neo4j
© 2013 SGI®
7
June 2013 SGI® ICE™ X Top500
Entries
•  #11, Pangea, Total Exploration
Production, Pau, France, Xeon
E5-2670 8C, FDR Infiniband
•  Top commercial system on the list!
•  http://www.sgi.com/products/servers/ice/x/
feature.html
•  #14, Spirit, U.S. Air Force Research
Laboratory, Dayton, OH, Xeon
E5-2670 8C, FDR Infiniband
•  Both Intel® Xeon® x86 standard
technology
© 2013 SGI®
8
M-Cell Notable Features (w/ M-Rack)
•  “Closed-Loop Airflow”
–  Hot aisle containment eliminates data center CRAC unit,
pump and chiller
–  Can eliminate cooling tower with secondary process
•  Supports Warm Water Cooling
•  Large, Efficient “Unified” Cooling Racks
•  Acoustically Treated
–  Leave your ear plugs out and…
–  have a conversation in your data center again
Complete Cell
Compute Rack
Cooling Rack
Blower
(One of three)
Cooling Rack
(Blowers removed)
Water Coil
(One of two)
© 2013 SGI®
9
June 2013 Top500
Rank Name Site Manufacturer Country CPU Cores Other Cores Rmax Rpeak Eff (%) Power Mflops/Watt Processor
1 Tianhe-2 (MilkyWay-2)National University of Defense Technology NUDT China 3120000 2736000 33862700 54902400 61.68 17808 1901.54 Intel IvyBridge
2 TitanDOE/SC/Oak Ridge National Laboratory Cray Inc. United States 560640 261632 17590000 27112550 64.88 8209 2142.77 AMD x86_64
3 SequoiaDOE/NNSA/LLNL IBM United States 1572864 0 17173224 20132659.2 85.3 7890 2176.58 PowerPC
4 RIKEN (AICS) Fujitsu Japan 705024 0 10510000 11280384 93.17 12659.89 830.18 Sparc
5 MiraDOE/SC/Argonne National Laboratory IBM United States 786432 0 8586612 10066330 85.3 3945 2176.58 PowerPC
6 StampedeTACC Dell United States 462462 366366 5168110 8520111.6 60.66 4510 1145.92 Intel SandyBridge
7 JUQUEENForschungszentrum Juelich (FZJ) IBM Germany 458752 0 5008857 5872025.6 85.3 2301 2176.82 PowerPC
8 VulcanDOE/NNSA/LLNL IBM United States 393216 0 4293306 5033165 85.3 1972 2177.13 PowerPC
9 SuperMUCLeibniz Rechenzentrum IBM Germany 147456 0 2897000 3185050 90.96 3422.67 846.42	
   Intel SandyBridge
10 Tianhe-1ANational Supercomputing Center in Tianjin NUDT China 186368 100352 2566000 4701000 54.58 4040 635.15 Intel Nehalem
11 PangeaTotal Exploration Production SGI France 110400 0 2098090 2296320 91.37 2118 990.6	
   Intel SandyBridge
12 FermiCINECA IBM Italy 163840 0 1788878 2097152 85.3 821.88 2176.57 PowerPC
13 DARPA Trial SubsetIBM Development Engineering IBM United States 63360 0 1515000 1944391.68 77.92 3575.63 423.7 Power
14 SpiritAir Force Research Laboratory SGI United States 73584 0 1415470 1530547.2 92.48 1606 881.36 Intel SandyBridge
117%	
  
Efficiency	
  advantage	
  of	
  M-­‐cell	
  over	
  IBM	
  liquid	
  cooled	
  idataplex	
  
© 2013 SGI®
10
Large Scale HPC:
M-Cell
Traditional Data Center:
D-Rack
Rack Environmental Options
Container Environments:
Leverage Cell Solutions
© 2013 SGI®
11
SGI ICE X
Design Innovations Summary
•  IP-115 Twin-Node Compute Blade
•  Independently Scalable Power
Architecture
•  Separable Cooling Solutions
•  Unified Backplane Fabric
•  Ground-Breaking Density
•  Multiple Data Center Environment
Support
© 2013 SGI®
12
SGI ICE X Compute Node: IP-119
(MedinaQ Twin) for “M-Rack”
Balanced
throughput	

• Two Intel® Xeon® processor E5-2600 series
• Two Intel® Xeon Phi™ 5120D Coprocessor
• FDR InfiniBand - single or dual plane
• Four DDR3 DIMMs/ socket @ up to 1600 MT/s
•  Expect 1866 MT/s support w/1 DPC populated (w/ Ivy Bridge-EP)
•  Up to one 2.5” SATA HDD/ SSD drive
• Liquid cold sinks
FDR + 1:1 processor to coprocessor ratio
= Balanced Throughput
One dual socket node w/
two coprocessors in
one blade slot!
© 2013 SGI®
13
IP-119 Compute Blade
One	
  dual	
  socket	
  node	
  with	
  
two	
  coprocessors	
  in	
  
one	
  blade	
  slot!	
  
	
  
	
  
Two	
  Intel®	
  Xeon	
  Phi™	
  
Coprocessors	
  
(DFF	
  Assemblies)	
  	
  
© 2013 SGI®
14
IP-119 Compute Blade
(Top Mother Board Detail)
24X	
  PCIe	
  	
  
Header	
  
QPI	
  Interposers	
  
Between	
  Sockets	
  (4)	
  
PCIe	
  	
  
Interposer	
  
To	
  FDR	
  HCA	
  
© 2013 SGI®
15
24X	
  PCIe	
  	
  
Header	
  
Interposer	
  
For	
  PCIe	
  
to	
  FDR	
  IB	
  
HCA	
  	
  
QPI	
  	
  
Interposers	
  
Between	
  
Sockets	
  (4)	
  
Back	
  Plane	
  	
  
Power	
  &	
  
Control	
  
interface	
  
IP-119 Compute Blade
(Bottom Mother Board Detail)
© 2013 SGI®
16
IP-119 Compute Blade
(Complete Assembly)
Top	
  Board	
  
BoDom	
  Board	
  
(FDR	
  IB	
  HCA	
  card	
  
removed)	
  
Two	
  Intel®	
  
Xeon	
  Phi™	
  
Coprocessors	
  
© 2013 SGI®
17
IP-119 Compute Blade
(Rear ISO View) Top	
  Board	
  
BoDom	
  Board	
  

SGI HPC Update for June 2013

  • 1.
    © 2013 SGI® 1 SGI® HPCUpdate Bill Mannel VP, Servers
  • 2.
    © 2013 SGI® 2 Speedand Scale ∞  0   Human  Scale  Atomic  to  Cellular   Astronomical  Subatomic   106  10-­‐6  10-­‐15   1024   1016   1018   Exascale   Femtometer   Lightyear   YoDascale   Finding Answers™
  • 3.
    © 2013 SGI® 3 Agenda • SGI®UV™ • SGI® ICE™ X
  • 4.
    © 2013 SGI® 4 SGIUV 2: The Big Brain Computer •  Focus on Solving Your Problems, Not IT Problems •  No-Limit Computing, Built on Industry Standards •  World's Largest In-Memory System for Data-Intensive Applications World-leading Capability for Data Intensive Work, now with Intel® Xeon® Processor E5-4600 Product Family.
  • 5.
    © 2013 SGI® 5 SGIUV “Anything Is Possible … with Effort” Enterprise SMP “No Limit Computing: Anything is possible” “Anything Is Possible … at a Price” SGI® UVTM 2000 Commodity Clusters Workstation “Some Things are Possible” Big Brain Computer
  • 6.
    © 2013 SGI® 6 SGIUV Open Source Analytics Workgroup Development KVM Virtualization Neo4j
  • 7.
    © 2013 SGI® 7 June2013 SGI® ICE™ X Top500 Entries •  #11, Pangea, Total Exploration Production, Pau, France, Xeon E5-2670 8C, FDR Infiniband •  Top commercial system on the list! •  http://www.sgi.com/products/servers/ice/x/ feature.html •  #14, Spirit, U.S. Air Force Research Laboratory, Dayton, OH, Xeon E5-2670 8C, FDR Infiniband •  Both Intel® Xeon® x86 standard technology
  • 8.
    © 2013 SGI® 8 M-CellNotable Features (w/ M-Rack) •  “Closed-Loop Airflow” –  Hot aisle containment eliminates data center CRAC unit, pump and chiller –  Can eliminate cooling tower with secondary process •  Supports Warm Water Cooling •  Large, Efficient “Unified” Cooling Racks •  Acoustically Treated –  Leave your ear plugs out and… –  have a conversation in your data center again Complete Cell Compute Rack Cooling Rack Blower (One of three) Cooling Rack (Blowers removed) Water Coil (One of two)
  • 9.
    © 2013 SGI® 9 June2013 Top500 Rank Name Site Manufacturer Country CPU Cores Other Cores Rmax Rpeak Eff (%) Power Mflops/Watt Processor 1 Tianhe-2 (MilkyWay-2)National University of Defense Technology NUDT China 3120000 2736000 33862700 54902400 61.68 17808 1901.54 Intel IvyBridge 2 TitanDOE/SC/Oak Ridge National Laboratory Cray Inc. United States 560640 261632 17590000 27112550 64.88 8209 2142.77 AMD x86_64 3 SequoiaDOE/NNSA/LLNL IBM United States 1572864 0 17173224 20132659.2 85.3 7890 2176.58 PowerPC 4 RIKEN (AICS) Fujitsu Japan 705024 0 10510000 11280384 93.17 12659.89 830.18 Sparc 5 MiraDOE/SC/Argonne National Laboratory IBM United States 786432 0 8586612 10066330 85.3 3945 2176.58 PowerPC 6 StampedeTACC Dell United States 462462 366366 5168110 8520111.6 60.66 4510 1145.92 Intel SandyBridge 7 JUQUEENForschungszentrum Juelich (FZJ) IBM Germany 458752 0 5008857 5872025.6 85.3 2301 2176.82 PowerPC 8 VulcanDOE/NNSA/LLNL IBM United States 393216 0 4293306 5033165 85.3 1972 2177.13 PowerPC 9 SuperMUCLeibniz Rechenzentrum IBM Germany 147456 0 2897000 3185050 90.96 3422.67 846.42   Intel SandyBridge 10 Tianhe-1ANational Supercomputing Center in Tianjin NUDT China 186368 100352 2566000 4701000 54.58 4040 635.15 Intel Nehalem 11 PangeaTotal Exploration Production SGI France 110400 0 2098090 2296320 91.37 2118 990.6   Intel SandyBridge 12 FermiCINECA IBM Italy 163840 0 1788878 2097152 85.3 821.88 2176.57 PowerPC 13 DARPA Trial SubsetIBM Development Engineering IBM United States 63360 0 1515000 1944391.68 77.92 3575.63 423.7 Power 14 SpiritAir Force Research Laboratory SGI United States 73584 0 1415470 1530547.2 92.48 1606 881.36 Intel SandyBridge 117%   Efficiency  advantage  of  M-­‐cell  over  IBM  liquid  cooled  idataplex  
  • 10.
    © 2013 SGI® 10 LargeScale HPC: M-Cell Traditional Data Center: D-Rack Rack Environmental Options Container Environments: Leverage Cell Solutions
  • 11.
    © 2013 SGI® 11 SGIICE X Design Innovations Summary •  IP-115 Twin-Node Compute Blade •  Independently Scalable Power Architecture •  Separable Cooling Solutions •  Unified Backplane Fabric •  Ground-Breaking Density •  Multiple Data Center Environment Support
  • 12.
    © 2013 SGI® 12 SGIICE X Compute Node: IP-119 (MedinaQ Twin) for “M-Rack” Balanced throughput • Two Intel® Xeon® processor E5-2600 series • Two Intel® Xeon Phi™ 5120D Coprocessor • FDR InfiniBand - single or dual plane • Four DDR3 DIMMs/ socket @ up to 1600 MT/s •  Expect 1866 MT/s support w/1 DPC populated (w/ Ivy Bridge-EP) •  Up to one 2.5” SATA HDD/ SSD drive • Liquid cold sinks FDR + 1:1 processor to coprocessor ratio = Balanced Throughput One dual socket node w/ two coprocessors in one blade slot!
  • 13.
    © 2013 SGI® 13 IP-119Compute Blade One  dual  socket  node  with   two  coprocessors  in   one  blade  slot!       Two  Intel®  Xeon  Phi™   Coprocessors   (DFF  Assemblies)    
  • 14.
    © 2013 SGI® 14 IP-119Compute Blade (Top Mother Board Detail) 24X  PCIe     Header   QPI  Interposers   Between  Sockets  (4)   PCIe     Interposer   To  FDR  HCA  
  • 15.
    © 2013 SGI® 15 24X  PCIe     Header   Interposer   For  PCIe   to  FDR  IB   HCA     QPI     Interposers   Between   Sockets  (4)   Back  Plane     Power  &   Control   interface   IP-119 Compute Blade (Bottom Mother Board Detail)
  • 16.
    © 2013 SGI® 16 IP-119Compute Blade (Complete Assembly) Top  Board   BoDom  Board   (FDR  IB  HCA  card   removed)   Two  Intel®   Xeon  Phi™   Coprocessors  
  • 17.
    © 2013 SGI® 17 IP-119Compute Blade (Rear ISO View) Top  Board   BoDom  Board