This document summarizes SUSE Enterprise Cloud Storage and Docker running on Cavium ThunderX servers. Key points include: - SUSE Enterprise Storage 3.0 and Docker 1.9.1 were tested on ThunderX servers with 384 cores, 1TB RAM, and 4TB SSD storage. Over 300 containers were run. - SUSE has collaborated with Cavium since 2014 to bring ARM64-based software defined storage to cloud and enterprise using SUSE Enterprise Storage. - Benefits of running Docker on ThunderX include lower overhead, latency, and startup/shutdown times compared to virtualization. - Various storage pricing points are calculated based on ThunderX configurations, showing how costs can be reduced through

1. SUSE Enterprise
Cloud Storage and
Docker on Gigabyte
Cavium ThunderX
Alex Lau (劉俊賢)
Software Consultant
alau@suse.com

2. SUSE Linux Enterprise Server 12-SP1
Docker + SUSE Enterprise Storage 3.0
H270-H70
- 48 Core * 8 : 384 Cores
- 32G * 32: 1T Memory
- 256G * 16: 4T SSD
- 40GbE * 8 Network
SES v3
- SLES12 SP1 on AArch64
- Kernel 4.1.27
- Ceph Jewel Release
-3 MONs, 12 OSDs
- Docker 1.9.1 Release
- Over 300 running containers

3. ARM64 build begin with
SUSE Enterprise Storage 2
SUSE has been collaborating with Cavium
since 2014 to bring ARM64 base software
define storage for cloud and enterprise.
ARM64 build begin with SES2 for internal
testing and technical preview.
A highly scalable and resilient software-based
storage solution that enables organizations of
any size to build cost-efficient, highly scalable
storage using off-the-shelf servers and disk
drives.

4. Block
Storage
File
System
Object
Storage
Support object, block or file system
storage in the same cluster
Remote Cluster
Data Encrypted
at Rest
Monitor
Nodes
Management
Node
Heterogeneous
OS Access
Automated
management
Automatic
Rebalance &
Recovery

5. Scale storage from
terabytes to hundreds of
petabytes without downtime
SOCIAL
MEDIA
BUSINESS
OPERATIONS
MOBILE
DATA
CUSTOMER
DATA
%UPTIME

6. Use storage with multiple tiers
Writing Quickly Application like:
• e.g. Video Recording
• e.g. Lots of IoT Data
Reading Quickly Application like:
• e.g. Video Streaming
• e.g. Big Data analysis
Write Tier
Hot Pool
Normal Tier
Cold Pool
Read Tier
Hot Pool
SUSE Enterprise Storage Cluster
Normal Tier
Cold Pool

7. Control Costs
How SES reduce cost? $
Copy Copy Copy
Replication Pool
SES CEPH CLUSTSER
Control CostsErasure Coded Pool
SES CEPH CLUSTSER
Data Data Data Data
Parity Parity
Multiple Copy of stored data
• 300% cost of data size
• Low Latency, Faster Recovery
Single Copy with Parity
• 150% cost of data size
• Data/Parity ratio trade of CPU

8. Docker on AArch64 with
SUSE Linux Enterprise 12 SP1
Docker is a lightweight virtualization solution to
run multiple virtual units (containers)
simultaneously on a single control host.
Containers are isolated with Kernel Control
Groups (cgroups) and Kernel Namespaces.

9. 9
Start SUSE Docker with an images
verified distributed by SUSE
Base
OS
SUSE Linux Enterprise Server
Continuous
Updates
Up-to-date
and secure
images
No
revalidation

10. Why Docker on ThunderX
• Less overhead
• Without guess kernel
• Without virtualization management
• Lower latency
• Application/ Daemon startup and shutdown time
• Memory only need for running application

11. Calculate multiple storage price point?
1000$ = 1000G 2000MB rw
4 PCIe = 4000$ = 8000MB rw
4T Storage 400,000 IOPS
4$ per G
250$ = 1000G, 500MB rw
16 Driver = 4000$ = 8000MB rw
16T Storage 100,000 IOPS
1$ per G
250$ = 8000G 150MB rw
16 Driver = 4000$ = 2400MB rw
128T Storage 2000 IOPS
0.1$ per G

12. Public Cloud Setup
H270-H70 - 40000$
- 48 Core * 8 : 384 Cores
- 32G * 32: 1T Memory
- 1T * 16: 16T SSD
- 40GbE * 8
R120-T30 - 5700$ * 7
- 48 Core * 7 : 336 Cores
- 8 * 16G * 7 : 896G Memory
- 1T * 2 * 7 : 14T SSD
- 8T * 6 * 7 : 336T HDD
- 40GbE * 7
- 10GbE * 14
1000 Customer Running
5$ - Web Hosting = 5000$
8 Months = 40000$
EC 5+2 is about 250T
2500 Customer 100GB
2$ Storage = 5000$
8 Months = 40000$

13. Reduce costs and management with
SUSE Enterprise Solution with ThunderX
Manage
Less
Adapt
Quickly
Control
Costs