The document discusses DDN's A3I accelerated AI solutions, highlighting their capabilities in handling large-scale data ingestion and processing for various AI applications such as deep learning and fraud detection. It emphasizes the importance of high performance, flexible data management, and optimized resource utilization while showcasing DDN's ability to scale from small to large configurations. Additionally, it addresses the challenges faced by the AI community regarding data management and the need for efficient solutions to optimize AI workloads.

1. ©2018 DataDirect Networks, Inc.
How Would it Impact Your Business if You Could
Seamlessly Extract a Lot More Answers per Hour
From Your Data at Any Scale?
A3I
ACCELERATED, ANY-SCALE AI SOLUTIONS FROM DDN

2. ©2018 DataDirect Networks, Inc.
DDN: LEADING DEPLOYMENTS ACROSS ALL AI & DEEP LEARNING
Data Security
Fraud Detection
Augmented
Reality
Healthcare
Diagnostics
Personalized
Marketing
Scalable Storage PlatformsData-at-scale Services
Delivered Real-time
Resource Optimized
Flash/GPU/CPU/Network
Line Speed Performance
Tiered Storage At Scale
Extended Flash Life
Natural
Language
Massive Scale Out.
Real Time Ingest &
Process
Fast Flash
High IO/Client
Security
Globally
Distributed
Optimized IO
Sensor Data
Live Diagnostics
Security
Distributed
Analytics
Resilient
Massive Ingest
Flash/Disk
Large Datasets
Driverless
Cars

3. ©2018 DataDirect Networks, Inc.
AI NOW AND TRENDS IN AI
Many Institute starting up in AI - struggle to
gain knowledge and build datasets
AI community outside HPC less knowledgeable
about scalable computing
Strong GPU usage, Containerised Workflows,
Rapidly Developing AI Frameworks
Neural Network Training, Inference
Simplified Operation, Data
Managament
Images getting larger,
More parallelization across multiple GPUs
and across GPU systems
More inclusion of HPC-style parallelism
Data Management Issues come to the fore
Continued Requirements for Fast Flash
Combined with Good Capacity Economics
Heavily Qualified and Testing with a wide
variety of Popular AI Frameworks
Multiple GPU Platforms tested against
DDN AI Solutions
Tighter Integration with GPU workloads
Performance Optimisation large scale
read workloads
Scale Any Way platforms
DDN

4. ©2018 DataDirect Networks, Inc.
One Solution,
Fully Integrated &
Fully Optimized
Multi GPU Scale-
Out
Scale-out Performance Flash
Cost Optimized Capacity
0
0
1
0
1
0
0
0
0
1
0
0
0
0
1
1
0
1
0
1
0
1
1
0
1
0
1
0
1
0
0
1
1
1
1
1
0
1
0
0
1
0
1
0
0
0
0
1
0
0
0
0
1
1
0
1
0
1
0
1
1
0
1
0
1
0
1
0
0
1
1
1
1
1
0
1
0
0
1
0
1
0
0
0
0
1
0
0
0
0
1
1
0
1
0
1
0
1
1
0
1
0
1
0
1
0
0
1
1
1
1
1
0
1
0
0
1
0
1
0
0
0
0
1
0
0
0
0
1
1
0
1
0
1
0
1
1
0
1
0
1
0
1
0
0
1
1
1
1
1
0
1
0
0
1
0
1
0
0
0
0
1
0
0
0
0
1
1
0
1
0
1
0
1
1
0
1
0
1
0
1
0
0
1
1
1
1
1
0
1
0
0
1
0
1
0
0
0
0
1
0
0
0
0
1
1
0
1
0
1
0
1
1
0
1
0
1
0
1
0
0
1
1
1
1
1
0
1
HDD
SSD
A3IACCELERATED, ANY-SCALE AI SOLUTIONS FROM DDN

5. ©2018 DataDirect Networks, Inc.
DDN | WHOLE AI LIFECYCLE DATA SOLUTIONS
Training Validation
Inference
Regression
Training
Prep
DDN AI Solutions allow
flexible scaling of
performance and/or
capacity for all phases of
the AI Data Lifecycle
Competing Solutions
resort to loosely coupled
solutions to meet
affordable capacity
needs
Ingest at Highest
Data Rates to
Handle Feeds and
Continued Scaling
20GB/S ALL FLASH SYSTEM STARTS AT $90K ASP!

6. ©2018 DataDirect Networks, Inc.
DDN | HOW IMPORTANT IS 10X MORE ANSWERS PER MINUTE?
Ingest, Store, Format
Process, Sample Reduce, Tag
Manipulate and Prepare
Build & Test Learning
Framework
Production Service
Optimize for More
Answers per Minute
Grow quickly and simply to limitless scale
with great economics and efficiency
Scale Volume
Flexible
Access
Scale
Speed
Always meets demand
GPU SCALE OUT

7. ©2018 DataDirect Networks, Inc.
SCALE UP, SCALE OUT OR SCALE BOTH
DDN AI400
SPEED VOLUME
DDN AI7990
ULTIMATE FLEXIBILITY
Scale
Capacity
Scale
Performance
Scale Performance
and Capacity
DDN
Disk
DDN
Flash
Competitor
limitations
DDN AI200

8. ©2018 DataDirect Networks, Inc.
DDN | IMAGE CLASSIFICATION, GENOME ANALYSIS
AUTOMATED
CHECKOUT
Ingest, process 2D, 3D models,
manage tomography scans and
other images.
Customer Needs • Flexible data Ingest
• Large Repository for NN training
• Intense GPU-based inferences
IB Network
Server0 Server1
40G Network
Inference Ingest

9. ©2018 DataDirect Networks, Inc.
DDN | AUTONOMOUS DRIVING DATACENTER
40GbE Network
Server0
SSDSSD SSDSSD SSDSSD SSDSSD
SSDSSD SSDSSD SSDSSD SSDSSD
Server1
HDD HDD HDD HDD HDD HDD HDD HDD HDD HDD
HDD HDD HDD HDD HDD HDD HDD HDD HDD HDD
…
HYBRIDSCALE-OUT
Scalable metadata Scalable Data
Global Scale
Autonomous
Driving
High Performance, Multiple Sites, Large
growth and Ingest Rates. Pre-processing – Sub
Sampling and Training – Machine Learning
Customer
Pain Points
• Achieving Web Scale File System Speed
• Management of hundreds of Ethernet-
Attached Parallel File Appliances
• 1.6TB/s Performance
• Economical Very Large Data Pool > 170PB
• Flat Namespace Speed for Each Region
Our AI and Storage Experts Will Fully
Optimize Your Environment, From
Applications to Workflows, Compute,
Containers, Network

10. ©2018 DataDirect Networks, Inc.
DDN | REAL TIME CONSUMER DETECTION & BILLING
AUTOMATED
CHECKOUT
Cameras identify shoppers and bill
them real time. Hosting on site.
Customer Needs • Continuous Data Acquisition
• Ease of deployment/Integration
• Low-latency On-Prem Flash Tier

11. ©2018 DataDirect Networks, Inc.
BUILD YOUR AI DATACENTER WITH DDN’S DATA PLATFORMS FOR AI
Small – Medium - Large configurations: 40 – 80 – 150TB
Start with 1 system, Scale to 100+
Infiniband or Ethernet
AI200 - 20GB/S
100% NVME FLASH STARTING
IN JUST 2U
AI200

12. ©2018 DataDirect Networks, Inc.
BUILD YOUR AI DATACENTER WITH DDN’S DATA PLATFORMS FOR AI
Small – Medium - Large configurations: 40 – 80 – 150TB
Start with 1 system, Scale to 100+
Infiniband or Ethernet
AI400 -
40GB/S
100% NVME FLASH
STARTING IN JUST 2U
AI400

13. ©2018 DataDirect Networks, Inc.
0
50
100
150
200
S M L
Capacity(TB)
AI200 and AI400 Capacity
AI200 AND AI400: SCALABLE AI PLATFORMS
• Choose your starting option
from as small as 20TB
• Or start at 38, 77 or 150TB
Start with a complete
All Flash, Parallel AI
Data Platform DDN in
just 2RU
S M L
38T
77T
150T

14. ©2018 DataDirect Networks, Inc.
AI200 AND AI400: SCALABLE FILE PLATFORMS
• Start from a system of just 2U
• Scale your starting system by
adding further units, each
bringing additional linear
capacity and performance
Scale your AI
Platform Linearly to
100s of TBs per
second
S M L 2
L
4
L
8
L
AI200and AI400 Platform Scaling

15. ©2018 DataDirect Networks, Inc.
BUILD YOUR AI DATACENTER WITH DDN’S DATA PLATFORMS FOR AI
Hybrid Configurations : Mix High Capacity Disk with SSD Pools
Start with 1 system, Scale to 100+
Infiniband or Ethernet
AI7990
HYBRID SSD/HDD COMPLETE AI
DATA SOLUTION STARTING AT 4U AI7990

16. ©2018 DataDirect Networks, Inc.
WHAT DOES AN AI WORKLOAD LOOK LIKE?
DL PLATFORM
S C A L A B L E
F L A S H
1 0 0 G B
N E T W O R K
S C A L A B L E
C A P A C I T Y
Scalable export services
Parallel Data movements
Bursty & Streaming Ingest
HDFS, NFS, CIFS, S3
Few kb random reads from large binary
Random read Large multi MB files
Mmap, POSIX, Shared file,
Hot datasets
of any sizeSSD
HDD
Warm data of
any size
Super Fast
Networking

17. ©2018 DataDirect Networks, Inc.
DDN: PARALLEL BY DESIGN
DDN Parallel AI
Platforms
AI Platform and Containers AI Platform and Containers
NFS Based Flash
Platforms
Hotspots
Fully Parallel Balanced I/O
non-parallel I/O
Fully Parallel End-to-End
Fast Native Protocols –
IB/100GbE/40GbE
Extremely scalable Single
Namespace
MIX HDD and SSD
Limited Namespace
expansion and
higher complexity
Weaker
protocols

18. ©2018 DataDirect Networks, Inc.
DDN A3I SOLUTIONS: INTEGRATED AND OPTIMIZED
End-to-End AI System
Enablement
Extreme amounts of performance and
capacity through a tight integration
between DDN and AI Compute platforms
Every layer of hardware and software
engaged is optimized for fast, responsive
and reliable file access
Highly optimized parallel data paths run
from containerized applications, all the way
to disk drives

19. ©2018 DataDirect Networks, Inc.
BEST PERFORMANCE TO A SINGLE APPLICATION
10GB/s to 1
Container
EXAScaler client demonstrates over 10GB
per second to a single container and over
100K IOPs.

20. ©2018 DataDirect Networks, Inc. DDN Confidential
I/O PATH OPTIMIZATION BOOSTS WHOLE SYSTEM
PERFORMANCE
Linear Acceleration of GPU’s and Containers For the Full Business Value of Your AI System
0
5000
10000
15000
20000
25000
30000
35000
40000
container
1
container
2
container
3
container
4
TOTAL
Throughput(MB/s)
TOTAL AI Throughput
• DDN AI Solutions achieve saturation level
performance for containerized workloads on
NVIDIA DGX-1
Application
containers
38GB/
s

21. ©2018 DataDirect Networks, Inc.
SATURATION-CLASS I/O FROM A3I SOLUTIONS
Consistent, Linear AI
Performance
AI benchmarking of standard test sets
demonstrates images per second rates
60% higher than competing systems

22. DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.
AI BENCHMARKING: DDN ENABLES AND
ACCELERATES
73
543
0 100 200 300 400 500 600
ImagesPerSecond
CAFFE GOOGLENET TRAINING THROUGHPUT
7.5X MORE IMAGES WITH DDN STORAGE
DDN Storage Other Storage Products
16
3
0 2 4 6 8 10 12 14 16 18
Time(inminutes)
CAFFE GOOGLENET TRAINING TIME
5.5X FASTER WITH DDN STORAGE
DDN Storage Other Storage Products

23. DDN ConfidentialDDN Storage | ©2018 DataDirect Networks, Inc.
AI BENCHMARKING: OPTIMIZED TENSORFLOW DATA SETS
67
23
0 10 20 30 40 50 60 70 80
Time(inminutes)
TFRECORD CONVERSION BENCHMARK
3X FASTER WITH DDN STORAGE
DDN Storage Other Storage Products
1614
671
0 200 400 600 800 1000 1200 1400 1600 1800
Time(inseconds)
TENSORFLOW RESNET-50 TRAINING PERFORMANCE
2.5X FASTER WITH TFRECORDS
TFRecord Data Set Discrete Data Set
Optimized Data Sets,
Accelerated Training
Convert discrete data and metadata asset
collections into series of streamlined binary
files for TensorFlow
Maximize DL training and validation
efficiency while minimizing data
management and preparation overhead
Achieve more accurate results by
eliminating manual data shuffle bias

24. ©2018 DataDirect Networks, Inc.
A3IACCELERATED, ANY-SCALE AI SOLUTIONS FROM DDN
Eliminate Your I/O Bottlenecks
Your AI Should Not be Bottlenecked by Slow I/O
With DDN Achieve Full I/O Saturation All the Time
Remove AI Slowdown, Inter-GPU Traffic
NFS Creates Congestion and Gridlock. DDN’s Smart
Path Mgmt Makes Your Systems Hyper-Efficient
Reduce Latencies, Accelerate Write Speeds
DDN Speed Up Neural Net Training From GPU Straight
to SSD, Delivering Wire Speed Deep Learning Data
Scale SSD, HDD Reliably & Cost Effectively
Execute Faster on New Insights. Merge Active Data and
Warehouse for Full Speed Access to Everything
Achieve Deeper Workflow Integration
Only DDN’s System and Domain Expertise Fully Optimizes
Your AI Software for Your Specific Needs
Flexible Access (RDMA, NFS, IB, Ethernet)
Use the Best Network For Your Needs. Don’t Burn CPU
Cycles with NFS, Use Native I/O for CPU Bypass

25. ©2018 DataDirect Networks, Inc. DDN Confidential
QUESTIONS?