2. #ibmedge
In the early days of IT, storage
was internal to its server, over
time, storage outgrew its
container, and we started
have externally attached
storage, and benefits like
RAID and clustered servers
for high availability. Then,
SANs, LANs and WANs took
the main stage, allowing for
greater connectivity and
distance.
But now, it seems the
pendulum is swinging back
with converged and
hyperconverged systems.
This session will provide the
motivations, advantages and
disadvantages of these new
configurations.
Abstract
1
3. #ibmedge
This week with Tony Pearson
Day Time Topic
Monday
2:30pm
All Flash is Not Created Equal:
Tony Pearson Contrasts IBM FlashSystem and SSD
Grand Garden Arena, Lower Level, MGM Grand - Studio A
Wednesday
11:00am
All Flash is Not Created Equal:
Tony Pearson Contrasts IBM FlashSystem and SSD
Grand Garden Arena, Lower Level, MGM Grand - Studio 2
1:15pm
Tony Pearson Presents
IBM Cloud Object Storage System (Cleversafe) and Its Applications
MGM Grand - Room 114
2:30pm
The Pendulum Swings Back: Tony Pearson Explains Converged and
Hyperconverged Environments
MGM Grand - Room 113
Thursday
09:00am
Tony Pearson Presents
IBM's Cloud Storage Options
MGM Grand - Room 116
2
5. #ibmedge
The Pendulum Swings on Infrastructure Design
Internal Storage
• Personal
Information
Managers (PIM)
• Mainframe
• AS/400
Advantages
Simple, self-contained
Disadvantages
• Simple, self-contained
• Scalability limited to what can fit
inside the hardware container
• Single Point of Failure (SPOF)
(unless you keep 2 or more copies
of data across independent
systems)
• Backups, Security and other Policy
enforcement is done on a system-
by-system basis individually
4
6. #ibmedge
The Pendulum Swings to External Storage
External Storage
• Mainframe
• AS/400
• Linux, UNIX,
Windows
Advantages
Two or more servers can directly
attach to external storage
High-availability clusters
RAID for data protection and
performance
Shared Cache
More room for storage growth
Centralize features, snapshots and
tape drives for backups
Disadvantages
• Scalability limited to number of
hosts attached
• Limited distance for external cables
5
7. #ibmedge
IBM Entry-Level and Midrange Storage Positioning
DCS3700 Performance
• Host: FC, SAS, iSCSI
• 360 Nearline drives
• DCS3700 Expansion
DCS3860
• Host: FC, SAS, iSCSI
• 360 Nearline drives
• DCS3860 Expansion
DCS3700
• Host: FC, SAS, iSCSI
• 180 Nearline drives
• DCS3700 Expansion
Storwize V7000
• Host: FC, FCoE,
iSCSI
• Up to 1,056 SSD,
15K, 10K, Nearline
• Storwize
Expansion
Storwize V5000
• Host: FC, FCoE,
SAS, iSCSI
• Up to 1,008 SSD,
15K, 10K, Nearline
• Storwize
Expansion
Random workloads Sequential workloads
Deep Computing Storage (DCS)Storwize family
built with IBM Spectrum Virtualize™
12 or 24 drives
in 2U rack space
60 drives
in 4U rack space
6
8. #ibmedge
Inheriting Features from IBM’s Enterprise-Class Systems
Inherited RAID
functionality already
developed for the
DS8000 series for
3.5” and 2.5” disk
drives
RAID 5, 6, 10
RAS services and
diagnostics
Inherited architecture and
software features from SAN
Volume Controller (SVC)
Innovative ease-of-use
GUI influenced from the
field-proven interface of
IBM XIV
Storwize V7000
(block only) V700
0
Unifie
d
V700
0
Unifie
d
Storwize V7000 Unified
(block and file access)
Inherited NAS,
ILM and
Active File
Management
from Spectrum
Scale
Enterprise-Class Systems
Midrange Systems
Storwize V5000
(block only)
7
9. #ibmedge
IBM Spectrum Virtualize™ – Key Features
Easy Tier
• Automatically moves extents between
Flash, Enterprise and Nearline disk
Real-time Compression
• Inline compression for active primary workloads
• Up to 80% Savings - More effective than Data
Deduplication
• Ideal for Databases, VMs, CAD/CAM, etc.
Data-at-Rest Encryption
• AES 256 bit encryption implemented in
SAS chip of V700 Gen2 Hardware
• Storwize software for block, and Spectrum
Scale for file modules
• Supports internal and external storage
• Works with all other features including
Real-time Compression and Easy Tier
– Data is compressed first, then
encrypted
• Encryption keys stored on USB memory
sticks
• No performance impact to
applications!
8
10. #ibmedge
Real-time Compression implementation on Spectrum
Virtualize
IBM Random Access Compression Engine™
Benefits
• Hardware-assisted real-time
compression
• Compressed data in cache to
increase hit ratios
• More capacity savings than data
deduplication for active data
• Compress existing data without
downtime
• Compress before Encryption to
optimize benefits of both
Upper cache
Lower cache
• Stretch Cluster forwarding
• Metro Mirror, HyperSwap
• Compression
offloaded to
Intel® QuickAssist
FPGA
• FlashCopy
• Global Mirroring
• Thin Provisioning
5x
effective
capacity!
• Encryption
9
11. #ibmedge
Storwize V5000 Gen2 models
Up to 2 Control Enclosures
Add up to 20 Expansion Enclosures
per controller
Storwize V5030 and V5030F
Supports thin provisioning, FlashCopy, Easy
Tier, remote mirroring, encryption,
compression and external virtualization
1 Control Enclosure
Add up to 10 Expansion
Enclosures
Storwize V5010
Supports thin provisioning, FlashCopy,
Easy Tier and remote mirroring
Storwize V5020
Supports thin provisioning, FlashCopy,
Easy Tier, remote mirroring, and
encryption
up to 264 internal drivesup to 1,008 internal drives
10
12. #ibmedge
The Pendulum Swings to Networked Storage
SAN
LAN
Advantages
Many more hosts can be attached
Greater distances enables Disaster
Recovery
Fewer, larger systems like Tape
Libraries easier to manage
Disadvantages
• SANs and LANs requires different
skill sets
• OS-specific and device-specific
management tools
Networked Storage
• SAN and NAS attached
flash, disk and tape systems
• IBM Spectrum Scale
• IBM Spectrum Virtualize and
SAN Volume Controller
11
13. #ibmedge
The Problem: Islands of Volume, File and Object data
Volume-level Storage
OS-specific file systems on direct -attach
or SAN-based devices
Sharing requires file transfers
Provides “Context” for Analytics of Social
and Mobile transactions
File-level Storage
NAS encourages sharing
across social networks
Desire for file sync-and-
share across desktops
and mobile
HDFS requires transfer
(ingest) from other
sources
JFS2
EXT4
NTFS
SMB
HDFS
NFS
Object-level Storage
New Web and Mobile
apps prefer Object-level
access
Amazon S3
OpenStack
Swift
12
14. #ibmedge
IBM Spectrum Scale – Flexible File and Object Storage
FS1 FS256. . .
Exabyte-Scale,
Global
Namespace
One big file system or divide into
as many as 256 smaller file/object
systems
Each file system
can be further
divided into fileset
containers
Network Shared Disk
(NSD) refers to:
• Flash and Disk LUNs
• Servers connected to
these LUNs
• Protocol between clients
and servers Metadata can be
separated to its own Pool
or intermixed with data
Files and objects
can be migrated
to Tape, Object
store, or Cloud*
13
15. #ibmedge
IBM Spectrum Scale™ – Supported Topologies
Twin-tailed
SAN
Internal, Direct-Attach
Shared PoolsShare-Nothing Pools
NSD Servers
Access files on direct,
twin-tailed or SAN
attached disk
Can export files to
application nodes
File Placement
Optimization
(FPO) Servers
Access files on
direct attached disk
Exports files to
other FPO servers
Hyperconverged
External Clients
Access data via file and object
protocols over IP network
TCP/IP
NSD Clients
For Linux, AIX,
and Windows
Access files via
SAN, TCP/IP or
RDMA
TCP/IP or RDMA network
14
16. #ibmedge
IBM Spectrum Scale™
replaces other POSIX file systems
SAN
Direct-Attach
SAN-level Storage
JFS2
EXT4
NTFS
• Works like OS-specific file systems
• No file transfers required between OS
• Linux on x86, POWER and z Systems
TCP/IP or RDMA Network
Twin-tailed
15
17. #ibmedge
IBM Spectrum Scale™ – More than just a file system!
ROBO
Other NAS
Other
Datacenters
Scale
Active File
Management
(AFM) caches data to
where it is needed,
can be used to
migrate from other
NAS devices
Hierarchical Storage
Management (HSM)
migrates infrequently
accessed files to tape,
automatically recalls back
when accessed
Local Read-Only Cache
(LROC) and Highly Available
Write Cache (HAWC) caches the
busiest blocks of files on local flash
Disaster Recovery (DR)
asynchronously mirrors data to
remote locations
Migrate/Recall Tape, Object, Cloud
NSD Client
Information Lifecycle
Management (ILM)
moves data across tiers of
flash and disk
Cloud
16
18. #ibmedge
SAN
Twin-tailed
Protocol Servers
NFS v3/v4
SMB2, SMB3
AIX, Linux, Mac OS,
Windows, VMware,
z/OS, etc.
Feature of IBM Spectrum Scale on
Linux nodes
Share files with clients using NFS,
SMB and Object protocols
All nodes can share the same data
If Protocol Server Node fails,
client connections are moved to
another server
Protocol Server Node(s) need
“NSD Server” License
External clients need no Spectrum
Scale License
Files can be accessed as objects,
objects can be accessed as files!
Clustered Protocol Servers for File and Object access
TCP/IP
OpenStack
Amazon S3
17
19. #ibmedge
The Pendulum Swings to Converged Systems
SAN
LAN
Advantages
• Converged Systems can also
connect to existing SAN/LAN
• Solution Focus
• Fewer servers required with
virtualization
• Portability to Cloud
Disadvantages
• Lose some of the gains from
SAN/LAN
• Backup and Disaster Recovery?
• Islands of processing and data?
Converged Systems
• Switches, Servers and
Storage equipment
packaged into a single
rack
18
20. #ibmedge
Converged Systems – Introducing VersaStack
vBlock
Cisco and EMC
Flexpod
Cisco and NetApp
PureSystems
IBM POWER
+ IBM Storage
VersaStack
Cisco and IBM
• Cisco Nexus and MDS switches
• Cisco UCS x86 servers
• Cisco UCS Director software
• FlashSystem
StorwizeV7000,
V7000 Unified, V5000
19
21. #ibmedge
Local Area
Network Data Center
Network
Host Bus Adapter
(HBA)
Network Interface
Card (NIC)
10/100/1000
1GbE
10GbE
2 Gbps
4 Gbps
8 Gbps
16 Gbps
Storage Area
Network
Converged Network
Adapter (CNA)
10GbE
40GbE
100GbE
Data Center Bridging (DCB)
• Data, Voice, Video
NFS, SMB, iSCSI, FCoE,
OpenStack Swift / Amazon S3
Convergence of Networks
20
22. #ibmedge
Cisco UCSD Turn-Key Solution Overview
Self Service
Portal
UCSD Unified Infrastructure Controller
Multi-tenant & integrated cloud platform
Admin
Console
Dashboard
Cloud Infrastructure
Amazon,
Rackspace, …
VMware
vCenter System Center
System
Integration
Admins
End
Users Operations
LDAP, Single Sign On
RBAC
IT Ticketing Systems
CMDB,
Metering/Chargeback
Server
Managers
Network
Manager
Storage
APIs
UCS
UCS Director
Integrated Multi-tenant Cloud Platform
Infrastructure
Nexus
Public Clouds
Provider API
Mobile Devices
Hyper-V
Custom
Connector
Open
Automation
REST API
KVM
RHE-Virtualization
Manager
21
23. #ibmedge
Subject Matter Experts
Define Policies
Policies Used to
Create Service
Profile SAN and
Storage
2
vSwitch
Nexus 1000v
VI
SME
Storage
SME
Server
SME
Network
SME
Server Name
UUID, MAC, WWN
Boot Information
LAN, SAN Config
Firmware Policy
SAN Zoning
Create and MAP LUN
Provision Physical and
Virtual
3
System is ready for Use
4
Server Name
UUID, MAC, WWN
Boot Information
LAN, SAN Config
Firmware Policy
Storage Configuration
Virtual Infrastructure
Configuration
Network Configuration
Application Profile
Virtualization Policy
Server Policy
Network Policy
Storage Policy
Service Profile like the SIM card
in your phone!
Ease & Efficiency with Cisco UCS Director
22
24. #ibmedge
Each can have up to 20
Expansion Enclosures
Storwize V7000 Upgrade Options
Start with 1 Control Enclosure
Add up to 20 Expansion Enclosures
Cluster up to 4 Control Enclosures
together into a single system
Block-only
FCP, FCoE and iSCSI, up to 1,056 drives
Drive choices
2.5-inch (SFF) 24-bay
• 200/400/800/1600 GB SSD
2TB/4TB Read-Intensive
• 300/600 GB 15K RPM SAS
• 3600/900/1200/1800 GB 10K RPM SAS
• 1and 2 TB 7,200 RPM NL-SAS
Drive choices
3.5-inch (LFF) 12-bay
• 2/3/4/6/8 TB 7,200 RPM
NL-SAS
Mix and Match!
Mix 12-bay and 24-bay
behind the same controller
Mix any drive types within shelf
23
25. #ibmedge
V70
00
Unif
ied
V70
00
Unif
ied
Block-and-File
Add Spectrum Scale v4.1.1 file modules to add support for
FTP, HTTPS, SCP, NFS, SMB
As well as block-level FCP, FCoE and iSCSI, up to 1,056 drives
IBM Spectrum Scale for Storwize V7000 Unified R1.6
Start with 1 Control Enclosure
Add up to 20 Expansion Enclosures
Cluster up to 4 Control Enclosures
together into a single system
Each can have up to 20
Expansion Enclosures
Attachment options
Direct attach or SAN attach to Storwize V7000
24
26. #ibmedge
IBM FlashSystem V9000
IBM introduces a fully integrated, flexible, feature rich all-flash storage system
Introducing IBM’s choice for open system tier 1 storage
• Scalable all-flash architecture accelerates applications and entire
infrastructures
• Performs at up to 2.5M IOPS with IBM MicroLatency
• Up to 57TB usable (285TB effective capacity) in only 6U and scales to
456TB usable (2.28PB effective capacity) in only 34U
• New licensing structure to simplify ordering and planning for External
Data Virtualization, FlashCopy, Metro Mirror, and Real-time Compression
• FlashSystem Tier 1 Guarantee
Scalable Performance Agile IntegrationEnduring Economics
Powered by IBM
FlashCore™ Technology
25
28. #ibmedge
The Pendulum Swings to Hyperconverged Systems
Advantages
Commodity off-the-shelf (COTS)
server and storage hardware
Servers can now hold sufficient
Flash and Disk capacity
Easy to re-purpose servers as
needed
Disadvantages
• SPOF requires 2 or more copies
across independent servers
• High-speed Ethernet or InfiniBand
network for connectivity
• Distance and Scalability issues on
some deployments
Hyperconverged
Systems
• Storage-rich
servers with
software to connect
across other
servers
27
29. #ibmedge
VMware Virtual SAN (VSAN)
• VSAN cluster consists of
2-64 VMware ESXi hosts
• At least 2 must have disk groups
• Each host has 0 to 5 disk groups
• Disk Group is 1 SSD plus 1-7 HDD
• 70% SSD as Read cache
• 30% SSD as Write cache
• IP Network used to make three copies
(replication) of data
• L2 Multicast required
• 1GbE can be used
• Jumbo Frames and 10GbE
recommended
• Only members in the cluster can access the
data
28
31. #ibmedge
Virtual Storage Control Virtual Storage Control
Virtual Machine/Virtual Disk
Flash HDD
Enterprise Storage
Snapshots, clones,
replication, compression,
thin provisioning ,
deduplication
Data Management
Data locality, tiering,
balancing, tunable
resilience
Hyperviso
r Agnostic
vSphere,
KVM,
Hyper-V
3-64
nodes
Nutanix Distributed File System (NDFS)
30
32. #ibmedge
Servers + VMware
Storage Switch
HA Shared
Storage
SSD Array
Backup Appliance
WAN Optimization
Cloud Gateway
Storage Caching
Backup Apps
Legacy Stack
Pre-integrated
storage and
server resources Converged
storage and server
resources
Converge entire
stack into single
resource pool
Simplivity
Best of
Both
Worlds
Cloud
Economics
Web-Scale
Enterprise
Capabilitie
s
HyperconvergedConverged
1-8 nodes per datacenter,
32 max federated
31
34. #ibmedge
VM
2
Spectrum Accelerate for Block-Level Hyperconvergence
Enables the IT administrator to single-
handedly manage the entire data center
stack
Allows hardware standardization of
network, compute, storage, power and
environmentals
Leverages existing Data Center services
and maintenance contracts
Simplifies the architecture when lacking
specialized, domain-specific skill sets
Available as Software-only and
Supermicro® Hyperconverged Appliance
pre-built system
Ethernet
Interconnect
Hypervisor
Spectrum
Accelerate
Spectrum
Accelerate
Spectrum
Accelerate
Hypervisor
iSCSI
Hypervisor
VM
1
VM
4
VM
6
iSCS
I
iSC
SI
VM
3
VM
5
iSCSI
33
35. #ibmedge
Extend Access beyond the IBM Spectrum Accelerate
cluster
Spectrum Accelerate iSCSI volumes available to
other hypervisor and bare metal hosts (AIX,
Windows, Linux, VMware, Hyper-V, KVM..)
AIX
and
PowerVM
Linux
and
KVM
Windows
and
Hyper-V
VMware
34
36. #ibmedge
App
2
Spectrum Scale File Placement Optimization (FPO) for
clustered file and object storage
Enables the IT administrator to
single-handedly manage the
entire data center stack
Allows hardware
standardization of network,
compute, storage, power and
environmentals
Bare metal deployments for
AIX, Windows and Linux
Supports Hyper-V and Linux
KVM hypervisors, Docker and
LXC Containers
Ethernet
Or
Infiniband
Interconnect
Server
Spectrum
Scale
Spectrum
Scale
Spectrum
Scale
Server
POSIX
Server
App
1
App
4
App
6
POSIX
POSIX
App
3
App
5
35
37. #ibmedge
The Pendulum Swings to meet Client Requirements
SAN
LAN
Internal Storage
Networked Storage
• IBM Flash, Disk and Tape
storage systems
• IBM Spectrum Storage
• IBM Cloud Object Storage
System
External Storage
• Storwize family
• DCS3700/DCS3860
Converged Systems
• VersaStack by
Cisco and IBM
• IBM PureSystems
Hyperconverged Systems
• IBM Spectrum Accelerate
• IBM Spectrum Scale
• Supermicro® Hyperconverged
Appliance
36
39. #ibmedge
IBM Redbooks on VersaStack
38
IBM FlashSystem
V9000 in a
VersaStack
Environment
VersaStack with
Oracle RAC, IBM
FlashSystem
V9000 and IBM
Spectrum Protect
IBM
PureApplication
Software on
VersaStack
VersaStack with
SQL, IBM
Spectrum Control
and IBM Spectrum
Protect
VersaStack with
IBM DB2, IBM
Spectrum Control
and IBM Spectrum
Protect
www.redbooks.ibm.com
40. #ibmedge
IBM Redbooks on IBM XIV and Spectrum Accelerate
39
IBM XIV Storage
System Architecture
and Implementation
IBM Spectrum
Accelerate Reference
Architecture
IBM Spectrum
Accelerate Deployment,
Usage and
Maintenance
Deploying IBM
Spectrum Accelerate in
the Cloud
www.redbooks.ibm.com
41. #ibmedge
IBM Redbooks on IBM Spectrum Scale
40
IBM Spectrum
Scale (formerly
GPFS)
Implementing IBM
Spectrum Scale
IBM Spectrum
Scale in an
OpenStack
Environment
IBM Spectrum
Scale – Big Data
and Analytics
Solution
IBM Spectrum
Scale and ECM
FileNet Content
Manager
www.redbooks.ibm.com
42. #ibmedge
IBM Redbooks on IBM FlashSystem
41
Implementing IBM
FlashSystem 900
Introducing and
Implementing IBM
FlashSystem V9000
IBM FlashSystem
A9000 Product Guide
IBM FlashSystem
A9000R Product Guide
www.redbooks.ibm.com
43. #ibmedge
IBM Redbooks on IBM Spectrum Virtualize
42
IBM Storwize V7000,
Spectrum Virtualize,
HyperSwap and
VMware Implementation
Introducing and
Implementing IBM
FlashSystem V9000
Implementing the IBM
Storwize V7000 Gen2
Implementing the IBM
Storwize V5000 Gen2
(V5010, V5020 and
V5030)
www.redbooks.ibm.com
44. #ibmedge
IBM Tucson Executive Briefing Center
• Tucson, Arizona is home for storage
hardware and software design and
development
• IBM Tucson Executive Briefing Center
offers:
• Technology briefings
• Product demonstrations
• Solution workshops
• Take a video tour!
• http://youtu.be/CXrpoCZAazg
43
45. #ibmedge
About the Speaker
Tony Pearson is a Master Inventor and Senior Software Engineer for the IBM Storage product line. Tony joined IBM
Corporation in 1986 in Tucson, Arizona, USA, and has lived there ever since. In his current role, Tony presents briefings on
storage topics covering the entire IBM Storage product line, IBM Spectrum Storage software products, and topics related to
Cloud Computing, Analytics and Cognitive Solutions. He interacts with clients, speaks at conferences and events, and leads
client workshops to help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and
virtualization products.
Tony writes the “Inside System Storage” blog, which is read by hundreds of clients, IBM sales reps and IBM Business Partners
every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1
most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume
I through V.
Over the past years, Tony has worked in development, marketing and customer care positions for various storage hardware and
software products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in
Electrical Engineering, both from the University of Arizona. Tony holds 19 patents for inventions on storage hardware and
software products.
9000 S. Rita Road
Bldg 9032 Floor 1
Tucson, AZ 85744
+1 520-799-4309 (Office)
tpearson@us.ibm.com
Tony Pearson
Master Inventor
Senior Software
Engineer
IBM Storage
44
47. #ibmedge
Please Note: Edge 2016 Disclaimers
• IBM’s statements regarding its plans, directions, and intent are subject to change or
withdrawal without notice and at IBM’s sole discretion.
• Information regarding potential future products is intended to outline our general product
direction and it should not be relied on in making a purchasing decision.
• The information mentioned regarding potential future products is not a commitment, promise,
or legal obligation to deliver any material, code or functionality. Information about potential
future products may not be incorporated into any contract.
• The development, release, and timing of any future features or functionality described for our
products remains at our sole discretion.
• Performance is based on measurements and projections using standard IBM benchmarks in
a controlled environment. The actual throughput or performance that any user will
experience will vary depending upon many factors, including considerations such as the
amount of multiprogramming in the user’s job stream, the I/O configuration, the storage
configuration, and the workload processed. Therefore, no assurance can be given that an
individual user will achieve results similar to those stated here.
46