This document discusses the NetApp E5500 storage solution for Lustre file systems. It provides three key points: 1) The NetApp E5500 is designed to meet the demands of large Lustre file systems including supporting over 100TB of storage, 100,000 clients, and independent scaling of clients, storage, and bandwidth. 2) Lustre is an open source parallel file system used on over 60% of the world's largest supercomputers that separates data from metadata to deliver scale and performance. 3) Test results show the E5500 can deliver over 7,200 sustained MBps of throughput from compute nodes to a 250TB Lustre file system, demonstrating its

1. June, 2013
Alexander Sammer, Product Manager
Blazing Fast Lustre
Storage

2. Why Lustre?
 Demand for >100TB file
systems
 Demand for >100,000 clients
 Independently scale
– Clients
– Storage
– Bandwidth
 Stable, reliable, and scales
– Storage can be added to a live file
system
2NetApp High-Performance Computing Solution for Lustre

3. Lustre: The Premiere Parallel File System
 Used on ~60% of world’s
largest supercomputers
 Open source software
 Runs on top of Linux®
 Lustre separates “data”
from metadata to deliver
scale and performance
3NetApp High-Performance Computing Solution for Lustre
Client
Compute Node
1 – 250K
Object Storage
Server (OSS)
Object Storage
Target (OST)
Metadata
Storage Server
(MDS)
Metadata
Storage Target
(MDT)
FC, IB, SAS FC, IB, SAS
Data Metadata

4. Why NetApp E5500?
 Designed for wide-ranging compute-
and bandwidth-intensive applications
 Leading rack density saves data center
floor space and lowers operational costs
 Modular flexibility supports configurations
customized for customer needs
 Bullet-proof reliability and availability
designed to make sure of continuous
high-speed data delivery
 SANtricity® software combines robust
performance tuning with ease of use
4
High-Performance Storage for Data-Intensive Workloads

5. Intel Xeon® E5-2418L processor
with built-in XOR/P+Q RAID parity
engine
PCI Express Gen 3.0 x8 buses
between processor and external
interfaces provide 24GB/s of
internal bandwidth per controller
DDR3 SDRAM DIMMs (three)
provide up to 12GB of cache
memory per controller
Battery-backed cache is destaged
to flash upon power loss
1
2
3
4
The E5500 Architecture
5
2
3
4
2 22
1

6. The E5500 Lustre Test bed (Boulder)
6NetApp Confidential - Internal Use Only
Dell R420
Dell R420
Dell R320
Dell R320
Dell R320
Dell R320
E-
2600A
E-
2600B
IB Switch
E-
5560A
E-
5560B
Dell R520
Dell R520
Boulder Lab test
 16x Compute Nodes (Dell R320)
 4x OSS Nodes (Dell R520)
 2x MDS Nodes (Dell R420)
 1x E2600 MDS Storage
 1x E5560 OSS Storage with 120 x 3TB drives
 File system size: 250TB
 Bandwidth File system >= 10GB/s (through CN)
IB Switch
Dell R320
Dell R320
Dell R320
Dell R320
Dell R320
Dell R320
Dell R320
Dell R320
Dell R320
Dell R320
Dell R320
Dell R320
Dell R520
Dell R520

7. E5500 and Lustre
7
 Leading Industry Efficiency and Performance
– Highest data throughput per footprint / spindle / watt / $
– 7,200 sustained MBps Lustre (IOzone) from Compute Node
– Performance optimized with SSD Cache option
 Modular, scalable, and dense architecture
– 35% smaller footprint / Best density per MB/s
– Granular, nimble, and virtually limitless expansion path
– 50% lower power / cooling costs
– IB and SAS connectivity
 Greater uptime
– New AutoSupportTM feature to enhance NetApp service
– Reliable and serviceable architecture (99.999% availability)
– Drive Encryption for secure performance supporting AES-256
– Data Assurance with T10 Diff Protection Information
– Dynamic Disk Pools for faster rebuilds
Proven #1 in Performance
per Spindle!

8. 8