 NF5288M5(AGX-2) NF5288M5 is a 2U two-sockets rack server consists 8 NVLink GPU or 8PCIe GPU which is specially designed for AI/HPC • Highest Density: 8 FHFL GPU get emerged in the limited space of 2U chassis • Highest Performance: support the latest optimized NVLink2.0 with fully connection topology, up to 960 Tensor FLOPs and 376 TOPS on INT8. • Highest Flexibility: abundant topology for GPU to meet different work load, free to choose different GPUs. Application scenarios: • AI field----Intelligent Security, Intelligent Traffic, Intelligent Finance, Intelligent Medical and Intelligent Manufacture that need data analysis and training • HPC------High performance clusters pursuing ultra-high performances, such as rendering operation, CAD and CAE. • Video acceleration------Complex and diverse video processing that need paralleled operation for government, education.

1. Inspur AGX-2
AI Supercomputer

2. NVLink Upgrade and optimized interconnecting
50%
Number of lanes
25%
Transfer Speed
NVIDIA® Tesla® P100
NVIDIA® Tesla® V100
GPU0 GPU2
GPU1 GPU3
GPU4 GPU6
GPU5 GPU7
GPU0 GPU2
GPU1 GPU3
GPU4 GPU6
GPU5 GPU7
NVLink™2.0
NVLink™1.0
6 NVLink™ port Per GPU
25GB/s per NVLink™
4 NVLink™ port Per GPU
20GB/s per NVLink™

3. 8*NVIDIA GPU 8* PCIe GPU
AGX-2 Components

4. NVIDIA® Tesla® V100
HBM2 Stacked Memory
900GB/s
NVIDIA® Tesla® P40
GPU Memory
Up to 24GB
NVIDIA® Tesla® P4
40x Efficient vs CPU
8x Efficient vs FPGA
NVIDIA® Tesla® V100
NVLink™2.0 Enabled
120 Tensor TFLOPS
Fast Data Swapping
In GPU Memory
Large Amount
of Training Data
Higher Efficiency
for DL Inference
Large Amount
of Data Parallel
Flexible GPU choice to meet various application

5. Air Cooling
Supports up to 35°C (95°F)
Up to 8*300W GPU
100 square feet of room air cycle in 1 minute
Air-liquid Hybrid Cooling
Provides lower PUE in data centers
Optimized Thermal Design

6. ClusterEngine
Management
100G InfiniBand Switch
Optimized for NVIDIA® GPUDirect
Supports 1-4*100G InfiniBand
InfiniBand Card Connection
• 1*InfiniBand card on IB 0 or 1, for lite data transfer
• 2*InfiniBand cards on IB 2,3, for mid data transfer
• All 4*InfiniBand Cards for mass data transfer
PCIe
Switch
GPU GPU
GPU GPU
PCIe
Switch
PCIe
SwitchIB 0 IB 1
IB 2 IB 3
PCIe x16 uplink
Linear Scalability
Scale-out Optimized

7. Inspur AGX-2 Specifications
Model Number NF5288M5
GPU 8*NVIDIA® Tesla® NVLink™ V100/P100 or 8*PCIe P100/P40/P4
Tensor TFLOPS / TOPS on INT8 960 / 376
CPU 2*Intel® Xeon® Scalable Processors
Memory 16*DDR4-2666
Storage
8*2.5” U.2/SAS/SATA
2*M.2 PCIe & SATA on Board
Network
4*10G Ethernet on board
Up to 4*100G RDMA NIC for NVIDIA® NVLink™ GPU
Up to 2*100G RDMA NIC for PCIe GPU
Cooling
Redundant Hot Swap System Fans
Air cooling /Air-Liquid Hybrid cooling
Power Supply Unit 2*3000w PSU 80plus Titanium
System Dimensions 448W*87.5H*899.5D (mm) / 17.64W*3.44H*35.41D (in)
Operating Temperature Range 5 - 35oC / 41 - 95oF

8. To Buy Inspur Server Please Call：400-860-6078
Visit：www.inspur.com
Intel ® Inside Powerful Productivity Outside.
Cooperate With Intel ®