- The document discusses IBM's cloud storage options, including IBM XIV, SAN Volume Controller, Elastic Storage Server, IBM Spectrum Archive, and IBM Spectrum Storage software-defined storage offerings. It also covers unified file and object storage with IBM Spectrum Scale and IBM Cloud Object Storage.
- The presentation covers topics such as business continuity, IBM's cloud storage options, IBM Cloud Object Storage, converged and hyperconverged environments, storage tiering, and IBM Spectrum Scale for file and object storage.
- IBM offers various cloud storage solutions including block, file, object, reference, hosted, ephemeral, and persistent storage options that can be deployed on-premises or off-premises.
Unblocking The Main Thread Solving ANRs and Frozen Frames
IBM Cloud Storage Options Overview
1. IBM Power Systems
and IBM Storage
Technical UniversityIBM’s Cloud Storage
Options
Tony Pearson
Master Inventor and Senior IT Architect,
IBM Corporation
2. Abstract
This session covers private, hybrid, and public cloud storage
options, including IBM XIV, SAN Volume Controller, Elastic
Storage Server, IBM Spectrum Archive (LTFS) and the rest of
the IBM Spectrum Storage family of Software Defined
Storage offerings.
Unified File and Object storage with IBM Spectrum Scale,
combined with IBM Cloud Object Storage will also be
presented.
2
3. This week with Tony Pearson
Day Time Topic
Monday 10:15am
Business Continuity – The seven tiers of business
continuity and disaster recovery
1:45pm IBM’s Cloud Storage Options
4:30pm
Introduction to IBM Cloud Object Storage System
and its Applications (powered by Cleversafe)
Tuesday 10:15am
The Pendulum Swings Back – Understanding
Converged and Hyperconverged Environments
11:30am
New generation of storage tiering: Simpler
management, Lower costs and Increased
performance
3:15pm
Introduction to IBM Cloud Object Storage System
and its Applications (powered by Cleversafe)
Wednesday
9:00am IBM Spectrum Scale for File and Object Storage
3
4. The Technology and the Business Side of Cloud
Cloud computing is a model for
enabling convenient,
on-demand network access to a
shared pool of configurable
computing resources (e.g., networks,
servers, storage, applications, and
services) that can be rapidly
provisioned and released with
minimal management effort or service
provider interaction.*
* Source: U.S. National Institute of Standards and Technology (nist.gov)
Technology Side… … Business Side
4
5. Clients are Moving to Hybrid Cloud Deployments
Infrastructure
Traditional IT
The IT department is
in direct competition
with alternatives off
premises for Lines of
Business funding
On-Premises
Some workloads require a level of
security, availability or government
compliance
Off-Premises
Some workloads might prefer more
agile, flexible and scalable
environment
Dedicated
(Private)
Public
Local
(Private)
On-premises
Off-premises
51IBM cloud
data centers
around
the globe
Cloud-
enabled IBM
servers and
storage
5
6. OpenStack IBM Solutions Partnerships
IBM is a platinum sponsor of
OpenStack Foundation
OpenStack open source code
can manage IBM compute,
network and storage resources
OpenStack supports x86, POWER
Systems and z System mainframe
IBM offers OpenStack Cinder
interfaces on most of its major
storage products and OpenStack
Swift interfaces for object access
IBM offerings are based on
OpenStack open source code with
value-added proprietary
features from IBM
IBM Cloud Orchestrator
supports a variety of server
hypervisors. IBM BlueBox and
IBM PowerVC provide additional
features
IBM Spectrum Control™ provide
reporting, provisioning, trouble
shooting and chargeback
capabilities for storage
VMware and Microsoft are
entirely proprietary, but have a
large market share for x86-based
server infrastructure
IBM was VMware’s first partner
since 1998. IBM has expanded its
partnership with VMware, offering
new cloud tools to make it even
easier for enterprises.
IBM and Microsoft agreement to
offer SQL Server and .NET on
IBM Cloud and IBM software on
Microsoft Azure
“Some assembly required” Enterprise-ready out of the box
x86, POWER systems and z System mainframe Concerns about vendor lock-in
IBM is Focused on these Software Defined
Environments
6
7. Deliver Management Solutions
Perform Optimizations
Contribute Platform Support
IBM Cloud Orchestrator
IBM BlueBox
IBM PowerVC
IBM Spectrum Control
Live upgrades
Security and authentication
OVF Images
Membership services
Globalization translation integration
QA enhancements
PowerKVM, KVM, z/VM
IBM DS8000, Storwize, SVC, XIV
IBM Spectrum Storage
IBM FlashSystem
IBM SDN for VE, OpenFlow Switches
IBM OpenStack Platform
IBM Contributions
HEAT Orchestration
OpenStack IaaS APIs
TOSCA
Nova Cinder Neutron
IBM Unique Value
Swift
Drivers Drivers Drivers Drivers Drivers
Manila
IBM is committed to OpenStack with contributions and
added value
7
8. Cloud Storage Taxonomy
Reference Storage
• Archives
• Images/Video
• WORM/NENR
Compliance
Ephemeral Storage
• Typically boot volumes,
page files and temporary data
• Goes away when VM
is shutdown
Persistent Storage
• Persists across
VM reboots
• Can be shared
between VMs
• Transactional
• High Performance
Storage as the Storage CloudStorage for Compute Cloud
Hosted Storage
• File and Object access
• Enterprise File Sync & Share
• Backup/Disaster Recovery
8
9. Cloud Storage Overview
Block
File
Object
Reference
Hosted
Ephemeral
Persistent
• Block storage offerings are differentiated by speed/throughput (as measured in
IOPS) and segmented by lifecycle of the disk. Device location does not matter.
• Ephemeral storage is tied to the lifecycle of a single VM (i.e. it is provisioned
when the VM is provisioned and destroyed when the VM is destroyed)
• Persistent storage has a lifecycle independent of any single VM and can be
provisioned/destroyed at any time and attached/detached to many VMs during it’s life
• File-based offerings are uncommon among providers, especially among those
targeting cloud native applications
• Primarily targeted at cloud enabled workloads
• Usage is being replaced in new application development with online object
storage
• Object storage offerings are differentiated by the durability of the data (i.e. odds of
irrecoverable loss) and segmented by the availability of the data (i.e. time required
to retrieve)
• An object in online storage is immediately accessible
• An object in archival storage may require minutes to hours to be accessible
9
10. Software Defined Storage – Block level Access
XIV
FICON
z/OS
z/TPF
z/VSE
z/VM
Linux on z
FCP
Linux
Windows
UNIX
VMware
…
iSCSI
Linux
Windows
UNIX
VMware
…
LAN
InfiniBand
DS8000
FlashSystem
900
Software Defined Environment
OpenStack Solutions Partners
IBM Spectrum
Accelerate™
SAN
FlashSystem
A9000 and A9000R
10
11. IBM Storage Portfolio – XIV and IBM Spectrum
Accelerate
IBM Spectrum Scale
Elastic Storage Server
IBM Spectrum Virtualize
FlashSystem
IBM
Spectrum
Accelerate
XIV
DS8000
All-Flash
Flash/Disk
Hybrid
Pre-built system,
• FCP and iSCSI volumes
• OpenStack Cinder
• VMware VAAI, VASA,
SRA, VVols
• Hyper-Scale manager,
mobility, consistency
• Real-time Compression
• Microsoft and Hyper-V
integration
• Data-at-Rest Encryption
XIV Gen3
Software deployed on
client-choice x86 servers:
• Hyperconvergence
• iSCSI volumes
• OpenStack Cinder
• VMware VAAI, VASA,
SRA
• Hyper-Scale manager,
mobility, consistency
11
13. VM 2
IBM Spectrum Accelerate for Block-Level
Hyperconvergence
Enables the IT administrator to
single-handedly manage the entire
data center stack
Allows hardware standardization of
network, compute, storage, power
and environmentals
Leverages existing Data Center
services and maintenance contracts
Simplifies the architecture when
lacking specialized, domain-specific
skill sets
iSCSI volumes can also be used by
bare metal servers and other
hypervisors
Available as software-only or
Supermicro® Hyperconverged
Appliance pre-built system
Ethernet
Interconnect
Hypervisor
IBM
Spectrum
Accelerate
IBM
Spectrum
Accelerate
IBM
Spectrum
Accelerate
Hypervisor
iSCSI
Hypervisor
VM 1
VM 4
VM 6
iSCSI
iSCSI
VM 3
VM 5
iSCSI
13
14. IBM Spectrum Accelerate – as a Service!
• Single order for Accelerate on IBM SoftLayer
• Operating Expense (OPEX) - no capital required
• Ordered:
– Base of 50TiB*
– Increments of 20 TiB
• Two configurations are offered:
– Capacity oriented (for archive type of applications)
– Performance oriented (for real time processing applications)
– Each package includes all features and unlimited traffic
Capacity oriented servers
Dual CPU 6 cores
32 GB RAM
11 x 4TB SATA drives
10GbE dual private links
Performance oriented servers
Dual CPU 8 cores
64 GB RAM
11 x 4TB SATA drives
800GB SSD
10GbE dual private links
…
14
* 1 Tebibyte (TiB) = 240 bytes = 1 099 511 627 776 bytes
15. …
…
IBM Spectrum Accelerate
on customer-choice HW
or Supermicro®
Hyperconverged Appliance
IBM
XIV
Gen 3
IBM Spectrum Accelerate
running off-premise
Unified Management Experience
• Remote Office, Branch Office. Provide high
availability storage to smaller or distributed
organizations such as banks and schools through
disaster recovery and other capabilities, using less
expensive hardware.
• Flexible deployment. Deploy test/dev or ad-hoc
project environments and later repurpose hardware
for other needs. Mix online transaction processing
and new applications like analytics.
• Hybrid Cloud. Seamlessly move workloads between
on-premise and off-premise deployments.
• Disaster recovery. Mirror to the cloud or to a data
center server running IBM Spectrum Accelerate. Use
powerful snapshots to execute backup to
on-premise servers
IBM
FlashSystem
A9000
A9000R
15
16. Software Defined Storage - Virtualization
XIV
DS8000 FlashSystem 900
Other
IBM and
non-IBM
Flash/Disk
systems
IBM Spectrum Virtualize™
SVC, Storwize, FlashSystem V9000, VersaStack
FCP
z/VSE
z/VM
Linux
Windows
UNIX
VMware
…
iSCSI
Linux
Windows
UNIX
VMware
…
SAN
FCoE
Linux
Windows
UNIX
VMware
…
Software Defined Environment
TCP/IP
OpenStack Solutions Partners
16
17. IBM Storage Portfolio – Spectrum Virtualize
IBM Spectrum Scale
Elastic Storage Server
IBM Spectrum Virtualize
FlashSystem
Spectrum
Accelerate
XIV
DS8000
All-Flash
Flash/Disk
Hybrid
Common Advanced Virtualization Code Base
Many Different Packages
FlashSystem V9000
SAN Volume
Controller
Storwize V7000
Storwize V7000F
Storwize V5000
Storwize V5030F
17
18. Mon Tue Wed
Full and
incremental
snapshot
copies
• Interface on-premise block storage into cloud
• IBM Cloud, Amazon S3, Openstack Swift
• Transform economics for storage
• Backup, archive, transfer volumes
• Full and incremental restore from cloud snapshots
• Supports volume groups for mutual consistency
Over 400 storage systems
from IBM and others
Transparent Cloud Tiering
IBM Spectrum Virtualize Transparent Cloud Tiering
18
19. IBM Spectrum Virtualize as Software
In
x86 server
IBM
supplied
Client
supplied
Host
systems
Storage
pool
UPS
Storage
management
Thin provisioning
Local and remote
replication
Compression
Encryption
Automated tiering
High availability
FC
HBA
iSCSI
HBA
• Run Spectrum Virtualize software
natively on Industry Standard x86
Servers
• Initial Release is Bare Metal
Only – Lenovo and SuperMicro
• Pretested systems to ensure
timely operation by IBM.
Equivalent mode of operation to
SVC today
• Delivered as a downloadable software
install through Passport Advantage
• Customer supplies Intel server with
specified HBAs (Host Bus Adapter)
• Customer or Partner Installable
• Perpetual or Monthly Licensing
Options, Fully Inclusive License.
19
20. Private Cloud /
Traditional Data Center
Cloud
Service Provider
Spectrum Virtualize Software bridges the gap for
Real-Time Replication Storage Infrastructure!
Storage X
Storage Y
IBM Spectrum
Virtualize Software
Makes the Impossible
Possible*
* At storage replication layer leveraging Global Mirror
Low Cost / SDS
20
21. Global Namespace for Block, File and Object Storage
XIV
DS8000 FlashSystem
Internal,
Direct
Attach
JBOF/
JBOD
FPO,
RAID
IBM Spectrum Scale™
POSIX
Windows
Linux
AIX
NFS
SMB
iSCSI
Hadoop
Spark
Single Drive
Library
IBM Spectrum Scale™,
Elastic Storage Server
Other
IBM and
non-IBM
Flash/Disk
systems
Software Defined Environment
Enterprise
Object
OpenStack
Swift,
Amazon S3
IBM Spectrum Virtualize™
SVC, FlashSystem V9000,
Storwize, ant VersaStack
IBM Cloud
Object Storage
LTFS
OpenStack Solutions Partners
21
22. IBM Spectrum Scale – Flexible File and Object Storage
FS1 FS256. . .
Exabyte-Scale, Global Namespace,
one big file system, or up to 256 file
systems Each file system
can be further
divided into fileset
containers
Metadata can be separated
to its own Pool or
intermixed with data
Files and objects
can be migrated
to Tape, Object
store, or Cloud
22
Remote Office/
Branch Office
Other
Datacenters
Scale
Cloud
Tape
Object
Cloud
23. Native Encryption and Secure Erase
Application
IBM Security Key
Lifecycle Manager (SKLM)
TCP/IP or
RDMA
Node-to-Node Encryption
Complies with NIST SP 800-131A
Data-at-Rest Encryption
• Files are encrypted by application node
• Each file assigned random File-key
• Master-key granularity by file or fileset,
determined by policies
• IBM SKLM stores Master-keys, and nodes must
have appropriate RKM credentials
• Data is encrypted from application node all the
way to NSD (flash or disk) media
• FIPS 140-2 certified
Secure Erase
• Files are cryptographically erased by deleting
their Master-key
• Files that “stay” are re-Mastered to new key
23
24. IBM Spectrum Scale supports OpenStack
Glance
• VM images
• Disk images
Cinder
• Volumes
Swift
• Objects
Manila
• File systems
Global Name Space
Volume-on-file Object-on-file
• Create, Delete and Extend volumes
• Take snapshots (FlashCopy) and clones
• Volumes Images, Images Volumes
• Attach and Detach to/from VM instances
• Create and Delete containers in account
• Upload, Download and Delete objects
• List containers or objects in a container
• Display and update metadata
Keystone
• Access control
24
25. IBM Spectrum Scale™
for Enterprise File Sync-and-Share (EFSS)
SAN
Internal,
Direct-Attach
No IT Control:
• Servers and storage
• Security
• Access control
• User provisioning
• Sensitive data
TCP/IP or RDMA network
Twin-tailed
25
26. IBM Spectrum Scale on any Cloud
Active File
Management
Private VLAN
NSD Clients and Servers can be deployed within a
Private VLAN
IBM: HPC Cloud Service
Amazon: Bring-your-Own-License (BYOL) model
• Standard Edition: 4 vCPU 1 Socket
• Data Management Edition:
use TiB capacity of EBS storage
26
27. Storage Positioning – Filling a Gap
Unified file and
object storage.
Optimized for high
performance, across
flash and disk
Flash 15K
Unified file and object
storage on tape
Information Lifecycle
Management (ILM) across tiers
HighestPerformance
Lowest cost
Tape
IBM was looking to offer easy to
manage, scalable disk-based object
storage for unstructured data
• Moderate performance
• Moderate cost
10K 7200 rpm
27
28. How is Object Storage Different?
Block and File Storage
– Decide where to put it
• For block, which array/volume/LUN
• For file, which filer/subdirectory
– Remember where it is to get it back
– Read/Write records, append data
– Limits on LUN size, number of files
Object Storage
– Provide data over to the Object
storage
• Get “claim stub” reference locator
– Use or share “claim stub” to access
data HTTP, Openstack Swift, S3
– Get/Put/Delete object in its entirety
– Effectively “unlimited” scalability
28
29. Object storage is dominant in cloud
0
50
100
150
200
250
2012 2013 2014 2015 2016 2017 2018
File-based software, appliances, and gateways
Object-based software and appliances (includes self-built/SaaS/cloud NAS)
IDC: Worldwide file- and object-based storage
2014–2018 Forecast (EB)
29
30. Object Store for Unstructured data
Hot Data
High-IOPS and Low-Latency
All-Flash and Hybrid Flash/Disk
Information Lifecycle Management
(ILM)
Structured data / Random-Access
Virtual Machines and VDI
Single-Tenancy
Static and Stable data
Backups, Files, Archives
Seismic, Research, Telemetry, HPC
Video, Animation, Body Cams
Photos, Images, CAD/CAM, GIS
Music, Audio
Genomic, Medical Images
Multi-tenancy
Object Store provides a
• Secure
• Reliable
• Scalable
• Cost Effective
Platform For Unstructured data
Object Store
is not designed for
• High IOPS workflows
• Transaction
Processing
• Inherent ILM
30
31. Data Protection Schemes
Tolerate 1 drive failure Tolerate 2 drive failures Tolerate “M” failures
RAID-1 / RAID-10
K pieces 2 x K slices
RAID-5
K pieces K + 1 slices
2.0X
1.2X
3.0X
1.5X
1.7XTriplication
K pieces 3 x K slices
RAID-6
K pieces K + 2 slices
Erasure Coding
K pieces K+M =
N slices
31
32. Data Growth at Petabyte (PB) Scale
PB of data
3 to 5x
Data Protection
RAID, Mirrors,
Replication, Tape Backups
Data Protection
High Availability & Disaster Recovery
Geo-Distribution & Erasure Coding
Infrastructure
Proprietary, specialized
hardware, multiple systems
Operations
More than 1 FTE per PB
Maintenance outages
Infrastructure
Software Defined,
Commodity Hardware,
Single System
Operations
Less than 1 FTE per 6 PB
Single system, Secure
Self-healing
1.7 x
60% Less
Hardware &
Rack space
Traditional
Approach
IBM Cloud
Object Storage
Approach
70%
Lower
TCO
32
33. IBM Spectrum Storage and
IBM Cloud Object Storage System
Unified file and object
storage. Optimized for
high performance, across
flash, disk and object
store
Flash
Object
Store
15K
Object storage on disk
( File, backup and archive interfaces
available through variety of options )
IBM Cloud
Amazon Web Services
Microsoft Azure
Swift S3 emulation
OpenStack Swift
Unified file and object
storage on tape
Transparent Cloud Tiering
Information Lifecycle
Management (ILM) across tiers
HighestPerformance
Lowest cost
Tape10K 7200
33
34. IBM Cloud Object Storage public cloud services
IBM Cloud Object Storage Flex
DataAccessPattern
IBM Cloud Object Storage
Standard
IBM Cloud Object
Storage
Vault
Variable data access
pattern / Mixed
workloads
Predictable
data access
pattern /
workload
Frequent
data access
Less frequent
data access
Minimal
data access
IBM Cloud Object
Storage
Cold Vault
• High Availability – Cross Regional USA
• Low Latency – Regional (Dallas)
35. IBM Spectrum Protect –
Cloud and Object Store Capabilities
35
Client nodes
• IBM Cloud Object Storage System
• IBM Spectrum Scale / ESS
Off-premises:
• IBM Bluemix Cloud
• Amazon Web Services
• Microsoft Azure
On-premises
IBM Spectrum
Protect Server
36. Cloud Storage Taxonomy
Storage as the Storage CloudStorage for the Compute Cloud
Persistent
Storage
• Persists across
VM reboots
• Can be shared
between VMs
• Transactional
• High
Performance
Reference
Storage
• Archives
• Images Video
• NENR and
WORM
Ephemeral
Storage
• Typically boot
volumes,
page files and
temporary
• Goes away when
VM is shutdown
Hosted Storage
• File Storage
• Object Storage
• Backup
• Disaster
Recovery
IBM Spectrum Accelerate, XIV
FlashSystem, DS8000, SVC
IBM Cloud Object Storage System,
IBM Spectrum Archive
IBM Spectrum Scale, Elastic Storage ServerTransactional
Performance
Universal Access
Lowest
TCO
36
40. IBM Tucson Executive Briefing Center
• Tucson, Arizona is
home for storage
hardware and
software design and
development
• IBM Tucson
Executive Briefing
Center offers:
– Technology
briefings
– Product
demonstrations
– Solution workshops
• Take a video tour!
– http://youtu.be/CXr
poCZAazg
https://www.ibm.com/it-infrastructure/services/client-centers
ccenter@us.ibm.com
40
41. About the Speaker
41
Tony Pearson is a Master Inventor and Senior IT Architect for the IBM Storage product line. Tony joined IBM Corporation in
1986 in Tucson, Arizona, USA, and has lived there ever since. In his current role, Tony presents briefings on storage topics
covering the entire IBM Storage product line, IBM Spectrum Storage software products, and topics related to Cloud Computing,
Analytics and Cognitive Solutions. He interacts with clients, speaks at conferences and events, and leads client workshops to
help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and virtualization
solutions.
Tony writes the “Inside System Storage” blog, which is read by thousands of clients, IBM sales reps and IBM Business Partners
every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1
most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume
I through V.
Over the past years, Tony has worked in development, marketing and consulting for various storage hardware and software
products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in Electrical
Engineering, both from the University of Arizona. . Tony is an inventor or co-inventor of 19 patents in the field of electronic data
storage.
9000 S. Rita Road
Bldg 9032 Floor 1
Tucson, AZ 85744
+1 520-799-4309 (Office)
tpearson@us.ibm.com
Tony Pearson
Master Inventor
Senior IT Architect
IBM Storage
44. Notice and disclaimers continued
Information concerning non-IBM products was obtained from the
suppliers of those products, their published announcements or
other publicly available sources. IBM has not tested those
products in connection with this publication and cannot confirm
the accuracy of performance, compatibility or any other claims
related to non-IBM products. Questions on the capabilities of
non-IBM products should be addressed to the suppliers of those
products. IBM does not warrant the quality of any third-party
products, or the ability of any such third-party products to
interoperate with IBM’s products. IBM expressly disclaims all
warranties, expressed or implied, including but not limited
to, the implied warranties of merchantability and fitness for
a particular, purpose.
The provision of the information contained herein is not intended
to, and does not, grant any right or license under any IBM
patents, copyrights, trademarks or other intellectual
property right.
IBM, the IBM logo, ibm.com, AIX, BigInsights, Bluemix, CICS,
Easy Tier, FlashCopy, FlashSystem, GDPS, GPFS,
Guardium, HyperSwap, IBM Cloud Managed Services, IBM
Elastic Storage, IBM FlashCore, IBM FlashSystem, IBM
MobileFirst, IBM Power Systems, IBM PureSystems, IBM
Spectrum, IBM Spectrum Accelerate, IBM Spectrum Archive,
IBM Spectrum Control, IBM Spectrum Protect, IBM Spectrum
Scale, IBM Spectrum Storage, IBM Spectrum Virtualize, IBM
Watson, IBM z Systems, IBM z13, IMS, InfoSphere, Linear
Tape File System, OMEGAMON, OpenPower, Parallel
Sysplex, Power, POWER, POWER4, POWER7, POWER8,
Power Series, Power Systems, Power Systems Software,
PowerHA, PowerLinux, PowerVM, PureApplica- tion, RACF,
Real-time Compression, Redbooks, RMF, SPSS, Storwize,
Symphony, SystemMirror, System Storage, Tivoli,
WebSphere, XIV, z Systems, z/OS, z/VM, z/VSE, zEnterprise
and zSecure are trademarks of International Business
Machines Corporation, registered in many jurisdictions
worldwide. Other product and service names might
be trademarks of IBM or other companies. A current list of
IBM trademarks is available on the Web at "Copyright and
trademark information" at:
www.ibm.com/legal/copytrade.shtml.
Linux is a registered trademark of Linus Torvalds in the United
States, other countries, or both. Java and all Java-based
trademarks and logos are trademarks or registered
trademarks of Oracle and/or its affiliates.
44