S100295 reporting-monitoring-orlando-v1804a

IBM Systems Technical University © 2018 IBM Corporation
2018 IBM Systems
Technical University
Reporting and Monitoring:
How to verify your storage is
being used efficiently
—
Tony Pearson, IBM
Master Inventor and Senior IT Architect,
Bryan Odom, IBM
Technical Pre-Sales
April 30 – May 4, 2018
Orlando, Florida

This session explores three
scenarios for optimizing storage
and using the thousands of
performance data records that
you have collected but have no
time to examine in detail. Based
on real-world customer
experiences with the analytics
functions in Spectrum Control
Advanced Edition, we share key
scenarios that show how you can
leverage the Advanced Edition to
help you in each of these cases:
1. When you need more storage
what type and tier does you
workload actually need?
2. After new storage added,
what's the best way to evenly
redistribute the workload?
3. When it's time to retire an aging
storage device, where should
you move the volume to?
Abstract
2

This week with Tony Pearson
3
Day Time Topic
Monday 10:15am The 7 tiers of Business Continuity and Disaster Recovery
11:30am IBM Hybrid Cloud Storage Options
3:15pm
Reporting and Monitoring:
How to verify your storage is being used efficiently
Tuesday 11:30am
Introduction to IBM Cloud Object Storage System (powered by
Cleversafe)
Wednesday 3:15pm
Information Lifecycle Management: Why Archive is different
than Backup
Thursday 4:30pm Storage Meetup: Cloud and Object Storage BOF
Friday
9:00am Managing risks with Data Footprint Reduction
10:15am
The Pendulum Swings Back – Understanding Converged and
Hyperconverged Integrated Systems

Device Perspective:
Looking at storage
environment from the
device level, for
performance and
replication functions
Data Perspective:
Looking at storage
environment from the
host level, for data
stored in file systems
and databases
Fabric Perspective:
Looking at storage environment from the
fabric level, how it all gets connected together
IBM Spectrum Control – Different Perspectives
4

IBM Spectrum Connect, Control and Virtual Storage Center
IBM Virtual
Storage
Center
• Storage Analytics
• Policy-based
Automation
• Service level
provisioning
IBM Spectrum
Control
Advanced
Edition
IBM
Spectrum
Connect
• Vmware
• Microsoft
Powershell
• Docker
• IBM Cloud
Private
IBM
Spectrum
Virtualize
IBM Spectrum
Control
Standard
Edition
• Capacity Planning
and Provisioning
• Performance
Monitoring and Alerts
IBM Copy
Services
Manager
Spectrum
Connect
IBM
Spectrum
Snapshot
Standard
Edition
IBM
Spectrum
Snapshot
Standard
Edition
IBM Storage
Insights Pro
• Reclaim space
• Optimize data
placement
• Monitor capacity
and performance
On-premises
Off-premises
5
IBM Storage
Insights
Foundation
• Reclaim space
• Optimize data
placement
• Monitor capacity
and performance

Spectrum Control Advanced Analytics
Cloud Configuration
– Assigning Tiers to storage
– Creating service classes
Provisioning
– Leveraging service classes to provision storage
– Prevents create a hot spot for new volumes
Optimization
– Volume migration based on work load at the volume or pool level
Data Transformation
– Migrating volumes based on workload
– Migrating volumes to newer hardware
Space Reclamation
– Identifying orphaned LUNs that can be reclaimed
6

Is your data on the ‘right’ storage tier?
Requirements change over time
Data owners are risk averse
Users don’t see the total cost
Rationing resources is unpopular
… but the biggest challenge has been:
No objective way to determine what the ‘right
tier’should be!
…so data stays on top tier storage (expensive)
• Resources that should be spent on innovation
are wasted on infrastructure inefficiencies
Challenges:
50-60%
Optimal Storage Tier Distribution
Tier 0
Tier 2
Tier 3
Tier 1
20-25%
15-20%
1-5%
-0 - 1%
Typical Storage Tier Distribution
70%
Tier 0
Tier 2
Tier 3
Tier 1
Storage Optimization: Tiering Overview
7

Benefits of using Spectrum Control
Reduced labor costs
– Helps to identify problems in the storage environment
– Single step execution reduces multiple manual steps needed to resolve issues
– Scheduled execution enable optimizations to be run at less disruptive times
without manual oversight
Reduced storage costs
– Re-tiering and balancing will result in a better utilized storage environment
– Transform actions can re-characterize volumes to achieve higher storage
utilization
Proactive and reactive performance resolution
– Identifies and addresses performance problems caused by unbalanced storage
pools and improperly tiered volumes
8

SVC Easy Tier versus Spectrum Control Analytics
Why should you not simply create one hybrid storage pool in SVC?
Here are some reasons that might prevent you from using the most easiest
setup of a tiering implementation with just one large hybrid storage pool:
– You might have more than one location, so you will need more than one storage pool
– You might have to separate internal customers from one another (multi tenancy) so you need
more than one pool
– If availability is a concern for you, than you probably don’t want to add more than one storage
system into one pool
– Workload isolation
– If you have: You will likely use:
or a combination of Easy Tier and VSC Tiering because the two are complementary
Use Easy
Tier
Use
Spectrum
Control
–A small number of pools
–Only hybrid pools (with mirroring)
–Many different drive technologies:
SSD/Flash, 146GB 15krpm, 600GB 10krpm,
1,2TB 10krpm,
2TB NL-SAS, 4 TB NL-SAS
and/or multiple RAID levels
9

Use Cases
capacity, what type and tier
does you workload actually
need?
you move the volume to?
10

Storage Optimization: Tiering across pools
Spectrum Control will only give one recommendation per volume.
Volume movement could be up or down multiple tiers based on
performance data analysis.
Spectrum Control Optimization can help determine the
best place to move the volumes based on the real work
load
11

When will you need more storage?
Go to:
Groups Tiers
Look for dates in
“Zero Capacity”
Note: you can sort
on this column
– <Date> when no
free
space is left
– None – no or
negative growth
– Depleted – no space
left in tier
The “Growth”
columns provide
a trend
12

Tier Capacity Charts
Tab Capacity shows how the Tier
capacity changed over time
13

Storage Optimization: Tiering at the volume level
Hot Data
Once a hot (very active) volume is found, how is
a more appropriate location (tier) found for that
volume?
Moving the volume to a higher tier of storage
with capacity may cause other problems:
The target pool could be pushed past
acceptable response based on the added load
Volumes that were performing well in the target
may degrade due to contention
Cold Data
The same situation occurs for cool
volumes, how is a more
appropriate location (tier) found for
that volume?
Blindly moving a volume to
another storage pool without any
metrics is just a guess … there is a
better way
14

Volume Optimization: Analyze Tiering
Identify the volume(s)
to be analyzed
Take note of the
current Tier
Right click the
volume(s) and select
Analyze Tiering
15

Determining Optimized Placement
Select the storage
pools from a list.
Another option
would be to select
the target location
based on capacity
pools.
16

Select the storage
destination pools from
a list.
Targets can include
one or more storage
pools spanning
multiple tiers of
storage.
17

Introducing I/O Density – Performance measurement
18
• For each LUN, the amount of IOPS is divided by
the amount of resident data
• IOPS = I/O (read/write) per second
• IO Density = IOPS per Gigabyte of data for a given
volume
• What is I/O Density?
• I/O Density (IOPS/GB) provides a level-set view of
performance regardless of volume size allowing a
uniform unit of measurement for analysis
• IOPS and GB tend to grow at similar rates, keeping
IO Density constant for each application
• The I/O Density value is the peak value of the averages
taken for the hour or day, depending on the sampling
chosen (Daily, Hourly or Sample Average).
• Daily Average has thus far proven the most reliable
indicator of future re-tiering results
• Hourly Average useful for brief but intense high-demand
workloads
*
Note:
I/O Density can be
represented per TB
or per GB
700 IOPS/TB = 0.7 IOPS/GB

I/O Density for Different Disk Technologies
1.000
0.700
0.500
0.100
0.010
0.001
146GB
15K
300GB
15K
600GB
10K
900GB
10K
3 TB
7200
4 TB
7200
73GB
15K
I/O Density
(IOPS / GB)
Spinning disks get larger
in capacity, but the overall
IOPS per spindle remains
constant, causing lower
I/O density
* Typical
values, drives
may vary
RPM IOPS/drive
15K 175-210
10K 125-150
7200 75-100
19

Here is one way to get the limits
Tier 1: 552 x 1.0 ≈ 550
Tier 2: 557 x 0.5 ≈ 280
Tier IO/GB
Tier 1 0.5 1
Tier 2 0.1 - 0.5
Tier 3 0.01 - 0.1
I/O Density rules of thumb
20

Define how many days
worth of data to be
analyzed.
Select days to be
included in the
analysis
Select times of the day
to be included in the
analysis
Co-locate volumes
Volume IO Rate / IO
Density
Maximum Pool I/O
rate.
Click “Analyze”
21

Green Checkmark
indicates analysis
successful
Recommendations
Show results of analysis
22

Execute Now or Schedule for Later
Schedule or Execute the recommendations.
Schedule for a later time,
perhaps weekend
Execute recommendations now
23

Analyze All Volumes in a Storage Pool
Process can
apply to all
volumes in a
storage pool
Spectrum Control can help you balance your workload
across pools.
24

Pool Optimization: Analyze Tiering
Define how many
days worth of data
to be analyzed.
Define which days to
be included in the
analysis
Define which times
of the day to be
included in the
analysis
Co-locate volumes
assigned to the
same server or
hypervisor.
Volume I/O Rate or
Volume I/O Density
Maximum pool I/O
rate
25

Pool Optimization: Analyze Tiering
Identifies only the
volumes that should be
moved to different tier
26

Use Cases
need?
you move the data to?
27

Storage Optimization:
Balancing workload across the same tier
Even with one tier of
storage, there can be hot
spots where the
workload is not balanced
across the pools.
“I only have one tier of
storage, so I cannot have
a hot spot“
Spectrum
Control can help
balance the
workload across
pools!
28

Pool Optimization: Balance Pools
Identify the
pool(s) you
want to
balance
Right click the
pool(s) and
select Balance
Pools
Spectrum Control can help you balance your workload
across pools within a tier.
29

Define how many
days worth of
data to be
analyzed.
Define days of the
week to be
included in the
analysis
Define times of
the day to be
included in the
analysis
Co-locate
volumes assigned
to the same
server or
hypervisor
30

The analysis shows
a number of volumes
that can be migrated
across different
pools of the same
tier to balance the
workload.
31

Use Cases
need?
you move the data to?
32

Transform Storage: Host Level Migration
Spectrum Control can help transform volumes of
Storage behind IBM Virtualized disks
33

Transform Storage: Host Level Migration
Select the target pools for migration
34

Transform Storage: Volumes Within A Pool
Transform storage can also be used to all
volumes in a storage pool
35

Transform Storage: Volumes Within A Pool
Using the volumes tab under the pool select
the target volume(s)
Recommendations can be scheduled
Can be used when migrating data to a new hardware platform
36

Summary
Optimization and Transformation
available in Virtual Storage Center
and Spectrum Control Advanced
Edition
Analytics determines which volumes
to be moved and where to move them
Spectrum Virtualize used to move
data from one storage system, pool or
tier to another
– SAN Volume Controller
– FlashSystem V9000
– Storwize V7000 and V5030
37

Please
complete
the session
survey!
38

About the Speaker
Tony Pearson is a Master Inventor and Senior IT Architect for the IBM Storage product line. Tony joined IBM Corporation in
1986 in Tucson, Arizona, USA, and has lived there ever since. In his current role, Tony presents briefings on storage topics
covering the entire IBM Storage product line, IBM Spectrum Storage software products, and topics related to Cloud Computing,
Analytics and Cognitive Solutions. He interacts with clients, speaks at conferences and events, and leads client workshops to
help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and virtualization
solutions.
Tony writes the “Inside System Storage” blog, which is read by thousands of clients, IBM sales reps and IBM Business Partners
every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1
most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume
I through V.
Over the past years, Tony has worked in development, marketing and consulting for various storage hardware and software
products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in Electrical
Engineering, both from the University of Arizona. Tony is an inventor or co-inventor of 19 patents in the field of electronic data
storage.
9000 S. Rita Road
Bldg 9032 Floor 1
Tucson, AZ 85744
+1 520-799-4309 (Office)
tpearson@us.ibm.com
Tony Pearson
Master Inventor
Senior IT Architect
IBM Storage
40

IBM Tucson Client Experience Center
Tucson, Arizona is headquarters
for IBM storage hardware and
software design and development
IBM Tucson Client Experience
Center offers:
– Technology briefings
– Product demonstrations
– Solution workshops
– Lab tours
Take a video tour!
– http://youtu.be/CXrpoCZAazg
https://www.ibm.com/it-infrastructure/services/client-centers

Email:
tpearson@us.ibm.com
Twitter:
twitter.com/az990tony
Blog:
ibm.co/Pearson
Books:
www.lulu.com/spotlight/990_tony
IBM Expert Network on Slideshare:
www.slideshare.net/az990tony
Facebook:
www.facebook.com/tony.pearson.16121
LinkedIn:
https://www.linkedin.com/in/az990tony
Additional Resources from Tony Pearson

Notices and disclaimers
43
© 2018 International Business Machines Corporation. No part of this
document may be reproduced or transmitted in any form without
written permission from IBM.
U.S. Government Users Restricted Rights — use, duplication or
disclosure restricted by GSA ADP Schedule Contract with IBM.
Information in these presentations (including information relating to
products that have not yet been announced by IBM) has been reviewed
for accuracy as of the date of initial publication and could include
unintentional technical or typographical errors. IBM shall have no
responsibility to update this information. This document is distributed
“as is” without any warranty, either express or implied. In no event,
shall IBM be liable for any damage arising from the use of this
information, including but not limited to, loss of data, business
interruption, loss of profit or loss of opportunity. IBM products and
services are warranted per the terms and conditions of the agreements
under which they are provided.
IBM products are manufactured from new parts or new and used parts.
In some cases, a product may not be new and may have been previously
installed. Regardless, our warranty terms apply.”
Any statements regarding IBM's future direction, intent or product
plans are subject to change or withdrawal without notice.
Performance data contained herein was generally obtained in a
controlled, isolated environments. Customer examples are presented as
illustrations of how those
customers have used IBM products and the results they may have
achieved. Actual performance, cost, savings or other results in other
operating environments may vary.
References in this document to IBM products, programs, or services
does not imply that IBM intends to make such products, programs or
services available in all countries in which IBM operates or does
business.
Workshops, sessions and associated materials may have been
prepared by independent session speakers, and do not necessarily
reflect the views of IBM. All materials and discussions are provided
for informational purposes only, and are neither intended to, nor shall
constitute legal or other guidance or advice to any individual
participant or their specific situation.
It is the customer’s responsibility to insure its own compliance
with legal requirements and to obtain advice of competent legal
counsel as to the identification and interpretation of any
relevant laws and regulatory requirements that may affect the
customer’s business and any actions the customer may need to take
to comply with such laws. IBM does not provide legal advice
or represent or warrant that its services or products will ensure that
the customer follows any law.
Information concerning non-IBM products was obtained from the
suppliers of those products, their published announcements or other
publicly available sources. IBM has not tested those products about
this publication and cannot confirm the accuracy of performance,
compatibility or any other claims related to non-IBM
products. Questions on the capabilities of non-IBM products should
be addressed to the suppliers of those products. IBM does not
warrant the quality of any third-party products, or the ability of
any such third-party products to interoperate with IBM’s products.
IBM expressly disclaims all warranties, expressed or implied,
including but not limited to, the implied warranties of
merchantability and fitness for a purpose.
The provision of the information contained herein is not intended to,
and does not, grant any right or license under any IBM patents,
copyrights, trademarks or other intellectual property right.
IBM, the IBM logo, ibm.com and [names of other referenced IBM
products and services used in the presentation] are trademarks of
International Business Machines Corporation, registered in many
jurisdictions worldwide. Other product and service names might
be trademarks of IBM or other companies. A current list of IBM
trademarks is available on the Web at "Copyright and trademark
information" at: www.ibm.com/legal/copytrade.shtml.

S100295 reporting-monitoring-orlando-v1804a

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to S100295 reporting-monitoring-orlando-v1804a

Similar to S100295 reporting-monitoring-orlando-v1804a (20)

More from Tony Pearson

More from Tony Pearson (20)

Recently uploaded

Recently uploaded (20)

S100295 reporting-monitoring-orlando-v1804a