The Race for Space
David Shepherd | Senior Solutions Consultant | 24th February 2016
Stephen Mogg | Senior Sales Engineer
Agenda
•Storage Then and Now
•Storage Requirements in the Enterprise
•The need for Data Retention
•Provisioning, Presentation and Consumption
Storage Then and Now
1986
A typical business class PC
had a 10MB hard disk
2016
A typical mobile phone has 16GB of
storage. (1600x)
A typical business class PC has 512 GB of
storage. (51200x)
Enterprise Disk drives 6TB in size
(614400x)
As a comparison…
If cars had improved at the rate of
storage.
• Assume a car in 1986 had an
average top speed of 100mph
• Average top speed in 2016 would
be 5,120,000 mph or 1422 mps
• Or 0.09 c where c is the speed of
light in a vacuum. It would probably
be important to get your brakes
checked…
Enterprise Storage in the 21st
Century
Industry Need for Storage is Expanding
Today’s Data Centre Challenges
The Value of Data
50-60%
of Enterprise Data
20-25%
15-20%
1-3%
Tier 0
Ultra High
Performance
Tier 1
High-value, OLTP,
Revenue
Generating
Tier 2
Backup/Recovery,
Reference Data,
Bulk Data
Tier 3
Object, Archive,
Compliance
Archive,
Long-term Retention
Source: Horison Information Strategies - Fred Moore
Enterprise Storage Tomorrow
Differentiated “Tiered” Information
 Timely Identification, Classification, and Efficient
Placement
Software-Based Storage (OPEX)
 Separated Control Plane and Data Plane
 Open, Extensible, Unified and Simplified
Industry Standard Hardware Building Blocks (CAPEX)
 Commodity Off-the-Shelf Servers for Control Plane
 Commodity Off-the-Shelf Drives for Data Plane
Enterprise Storage Market
Source : IT Brand Pulse
The Epic Migration to Software Defined Storage
20% Open Source in next 2 years.
(up from 1%)
How Do You Manage Growth ?
• Existing SAN Infrastructure
• Can existing SAN meet the capacity ?
• Is it cost effective to expand existing storage ?
• Software Defined Storage
• Clustered solution based on multiple servers to provide
a fault tolerant storage solution based on Enterprise
Servers and Storage.
SUSE Enterprise Storage
• Extensively Scalable
• Storage Appliance to Cost Effective Cloud Solution
• Industry Leading Storage Functionality (Hammer Release)
• Unified Block and Object with File Coming
• Thin Provisioning
• Erasure Coding
• Cache Tiering
• Built upon Clustered Servers
• Self Healing
• Self Managing
SUSE Enterprise Storage with Ceph
Optimise performance with minimal
monitoring and storage administration
Block
Storage
File
System
Object
Storage
Monitor
Nodes
Management
Node
Build enterprise class storage with commodity
servers and disk drives
$
Add capacity as
needed
Reduce capital
expense
Broaden choice
of vendors
Public Network
OSD1 OSD2 OSD3 OSD4
Heterogeneous operating system
support with iSCSI storage protocol
Cluster Network
iSCSI Gateway
RBD
Module
iSCSI Gateway
RBD
Module
iSCSI Initiator
RBD image
Provisioning, Presentation
and Consumption
So What ?
• We have a software defined storage infrastructure
• We need to make the storage available.
• We need to be able to be able to utilise the storage
from existing Enterprise Platforms.
• How do we then provision the storage, present it to the
required systems, and consume the space provided..
The Need for Data Retention
Data Retention
• Major reason for storage growth
• Different Industries have different statutory
requirements
• Banking
• Telecoms
• Health
UK Data Retention Regulations (2014)
UK Data Retention Regulations (2014)
Data Retention Challenges
• Storage is not the whole solution
• How do you provide access ?
• Is historic data still available to applications ?
• How do you manage security ?
• Backup and restore of retained data. Disaster recovery of
storage.
• How do you implement retention policies ?
• Are files retained in accordance with age, file type etc.
Tools that can help
• File Reporter - Know what you have
• Who has rights, how did they get rights
• What type of files have been added in the
last month
• Who is taking up the most amount of
storage
• Storage Manager - Manage File structure
• Automate storage assignment / cleanup
• Policy based user / group storage
• No custom IDM scripts but clear policies
Enterprise Data Retention Solution
OES2015 as a Storage
Gateway
Leveraging the use of SUSE
Storage to multiple client types
OES2015 as a storage gateway
• Can present the block devices from SUSE Storage as native Kerberos
CIFS volumes to Active Directory
• NFS also supported
• Can make use of Storage Tiering technology (Dynamic Storage).
• Dynamic Storage allows data to stay as one volume from a user
perspective but to split the data based on policy to a primary and a
shadow storage location.
• Allows SUSE Storage to act as shadow storage.
Dynamic Storage
Figure 1-1 User View of the File System Directory
Dynamic Storage (DST)
• The primary storage is your existing volume
• The secondary volume is your shadow storage
• Data is moved by policy between the primary and the
secondary.
• Access to the data is seamless from the existing
volume.
• Users do not notice that data moves.
• The moves are transparent.
Benefits of Dynamic Storage
• Old data can be moved from the SAN primary storage
to SUSE Storage seamlessly. (data is read-only during
the move).
• Frees space on the SAN
• Can reduce backup and restore windows.
• Unlike SAN based functionality DST is file based not
block based.
Data move is policy controlled.
Controlled from a server based
web app or the command line.
Multiple Policies can be applied
Data can be moved from primary
to secondary or secondary to
primary
Data move can take place based
on multiple conditions.
Management of large Volumes
• Simple management of large data sets
• NSS dynamic rights assignment with minimal server
utilisation over very large volumes.
• Rights inheritance
• Rights do not need assigning at each level.
• Volume size can be 8 Exabytes, file size 16TB
• NSS is the only file system designed to share files from
the outset.
Integration with Active Directory
• Native Integration with AD
• SMB 2 with pipelining support
• Kerberos
• OES Servers join AD as member servers
• AD Tools used for management
• AD Security principals used to assign rights
Future Developments
• OES2015 SP1 will add the following
• AD Client access to Salvage and Purge
• Integration with multiple AD Forests
• Improved CIFS performance
• Dynamic Storage
• Implementation of a third tier to cloud.
Data Access to Mobile Clients
• Using Filr 2.0 (Available as part of OES)
• Gives access to all data from tablet and smart phone
form factors from their original locations.
• Data does not need to be moved to another data store
Filr 2.0 IOS Client
Touch ID Supported for
Authentication
IOS Pin code also supported
Filr 2 IOS Client
Documents can be loaded from
any network drive exposed by
Filr, edited and saved back
Any app written to IOS 8 or later
can use the same functionality
Summary
• SUSE Storage can provide large amounts of storage
that can replace more expensive SAN based options.
• OES 2015 can utilise the storage whilst providing class
leading capabilities for data retention and full support
for Active Directory
• Filr 2.0 can securely make that data available to mobile
connected devices.
Questions ?

#MFSummit2016 Operate: The race for space

  • 1.
    The Race forSpace David Shepherd | Senior Solutions Consultant | 24th February 2016 Stephen Mogg | Senior Sales Engineer
  • 2.
    Agenda •Storage Then andNow •Storage Requirements in the Enterprise •The need for Data Retention •Provisioning, Presentation and Consumption
  • 3.
  • 4.
    1986 A typical businessclass PC had a 10MB hard disk
  • 5.
    2016 A typical mobilephone has 16GB of storage. (1600x) A typical business class PC has 512 GB of storage. (51200x) Enterprise Disk drives 6TB in size (614400x)
  • 6.
    As a comparison… Ifcars had improved at the rate of storage. • Assume a car in 1986 had an average top speed of 100mph • Average top speed in 2016 would be 5,120,000 mph or 1422 mps • Or 0.09 c where c is the speed of light in a vacuum. It would probably be important to get your brakes checked…
  • 7.
    Enterprise Storage inthe 21st Century
  • 8.
    Industry Need forStorage is Expanding
  • 9.
  • 10.
    The Value ofData 50-60% of Enterprise Data 20-25% 15-20% 1-3% Tier 0 Ultra High Performance Tier 1 High-value, OLTP, Revenue Generating Tier 2 Backup/Recovery, Reference Data, Bulk Data Tier 3 Object, Archive, Compliance Archive, Long-term Retention Source: Horison Information Strategies - Fred Moore
  • 11.
    Enterprise Storage Tomorrow Differentiated“Tiered” Information  Timely Identification, Classification, and Efficient Placement Software-Based Storage (OPEX)  Separated Control Plane and Data Plane  Open, Extensible, Unified and Simplified Industry Standard Hardware Building Blocks (CAPEX)  Commodity Off-the-Shelf Servers for Control Plane  Commodity Off-the-Shelf Drives for Data Plane
  • 12.
    Enterprise Storage Market Source: IT Brand Pulse The Epic Migration to Software Defined Storage 20% Open Source in next 2 years. (up from 1%)
  • 13.
    How Do YouManage Growth ? • Existing SAN Infrastructure • Can existing SAN meet the capacity ? • Is it cost effective to expand existing storage ? • Software Defined Storage • Clustered solution based on multiple servers to provide a fault tolerant storage solution based on Enterprise Servers and Storage.
  • 14.
  • 15.
    • Extensively Scalable •Storage Appliance to Cost Effective Cloud Solution • Industry Leading Storage Functionality (Hammer Release) • Unified Block and Object with File Coming • Thin Provisioning • Erasure Coding • Cache Tiering • Built upon Clustered Servers • Self Healing • Self Managing SUSE Enterprise Storage with Ceph
  • 16.
    Optimise performance withminimal monitoring and storage administration Block Storage File System Object Storage Monitor Nodes Management Node
  • 17.
    Build enterprise classstorage with commodity servers and disk drives $ Add capacity as needed Reduce capital expense Broaden choice of vendors
  • 18.
    Public Network OSD1 OSD2OSD3 OSD4 Heterogeneous operating system support with iSCSI storage protocol Cluster Network iSCSI Gateway RBD Module iSCSI Gateway RBD Module iSCSI Initiator RBD image
  • 19.
  • 20.
    So What ? •We have a software defined storage infrastructure • We need to make the storage available. • We need to be able to be able to utilise the storage from existing Enterprise Platforms. • How do we then provision the storage, present it to the required systems, and consume the space provided..
  • 21.
    The Need forData Retention
  • 22.
    Data Retention • Majorreason for storage growth • Different Industries have different statutory requirements • Banking • Telecoms • Health
  • 23.
    UK Data RetentionRegulations (2014)
  • 24.
    UK Data RetentionRegulations (2014)
  • 25.
    Data Retention Challenges •Storage is not the whole solution • How do you provide access ? • Is historic data still available to applications ? • How do you manage security ? • Backup and restore of retained data. Disaster recovery of storage. • How do you implement retention policies ? • Are files retained in accordance with age, file type etc.
  • 26.
    Tools that canhelp • File Reporter - Know what you have • Who has rights, how did they get rights • What type of files have been added in the last month • Who is taking up the most amount of storage • Storage Manager - Manage File structure • Automate storage assignment / cleanup • Policy based user / group storage • No custom IDM scripts but clear policies
  • 27.
  • 28.
    OES2015 as aStorage Gateway Leveraging the use of SUSE Storage to multiple client types
  • 29.
    OES2015 as astorage gateway • Can present the block devices from SUSE Storage as native Kerberos CIFS volumes to Active Directory • NFS also supported • Can make use of Storage Tiering technology (Dynamic Storage). • Dynamic Storage allows data to stay as one volume from a user perspective but to split the data based on policy to a primary and a shadow storage location. • Allows SUSE Storage to act as shadow storage.
  • 30.
    Dynamic Storage Figure 1-1User View of the File System Directory
  • 31.
    Dynamic Storage (DST) •The primary storage is your existing volume • The secondary volume is your shadow storage • Data is moved by policy between the primary and the secondary. • Access to the data is seamless from the existing volume. • Users do not notice that data moves. • The moves are transparent.
  • 32.
    Benefits of DynamicStorage • Old data can be moved from the SAN primary storage to SUSE Storage seamlessly. (data is read-only during the move). • Frees space on the SAN • Can reduce backup and restore windows. • Unlike SAN based functionality DST is file based not block based.
  • 33.
    Data move ispolicy controlled. Controlled from a server based web app or the command line. Multiple Policies can be applied Data can be moved from primary to secondary or secondary to primary Data move can take place based on multiple conditions.
  • 34.
    Management of largeVolumes • Simple management of large data sets • NSS dynamic rights assignment with minimal server utilisation over very large volumes. • Rights inheritance • Rights do not need assigning at each level. • Volume size can be 8 Exabytes, file size 16TB • NSS is the only file system designed to share files from the outset.
  • 35.
    Integration with ActiveDirectory • Native Integration with AD • SMB 2 with pipelining support • Kerberos • OES Servers join AD as member servers • AD Tools used for management • AD Security principals used to assign rights
  • 36.
    Future Developments • OES2015SP1 will add the following • AD Client access to Salvage and Purge • Integration with multiple AD Forests • Improved CIFS performance • Dynamic Storage • Implementation of a third tier to cloud.
  • 37.
    Data Access toMobile Clients • Using Filr 2.0 (Available as part of OES) • Gives access to all data from tablet and smart phone form factors from their original locations. • Data does not need to be moved to another data store
  • 38.
    Filr 2.0 IOSClient Touch ID Supported for Authentication IOS Pin code also supported
  • 39.
    Filr 2 IOSClient Documents can be loaded from any network drive exposed by Filr, edited and saved back Any app written to IOS 8 or later can use the same functionality
  • 40.
    Summary • SUSE Storagecan provide large amounts of storage that can replace more expensive SAN based options. • OES 2015 can utilise the storage whilst providing class leading capabilities for data retention and full support for Active Directory • Filr 2.0 can securely make that data available to mobile connected devices.
  • 41.