Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Inter connect2016 yss1841-cloud-storage-options-v4


Published on

This session will cover private and public cloud storage options, including flash, disk and tape, to address the different types of cloud storage requirements. It will also explain the use of Active File Management for local space management and global access to files, and support for file-and-sync.

Published in: Technology
  • Be the first to comment

Inter connect2016 yss1841-cloud-storage-options-v4

  1. 1. YSS-1841 IBM Cloud Storage Options Tony Pearson IBM Master Inventor and Senior Software Engineer
  2. 2. Please Note: 1 • IBM’s statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM’s sole discretion. • Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. • The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code or functionality. Information about potential future products may not be incorporated into any contract. • The development, release, and timing of any future features or functionality described for our products remains at our sole discretion. • Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon many factors, including considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve results similar to those stated here.
  3. 3. Cloud Storage Taxonomy Reference Storage • Archives • Images/Video • WORM/NENR Ephemeral Storage • Typically boot volumes, page files and temporary data • Goes away when VM is shutdown Persistent Storage • Persists across VM reboots • Can be shared between VMs • Transactional • High Performance Storage as the Storage CloudStorage for Compute Cloud Hosted Storage • File and Object access • File Sync & Share • Backup/Disaster Recovery 2
  4. 4. Cloud Storage Overview Block File Object Archival Online Ephemeral Persistent • Block storage offerings are differentiated by speed/throughput (as measured in IOPS) and segmented by lifecycle of the disk. Device location does not matter. • Ephemeral storage is tied to the lifecycle of a single VM (i.e. it is provisioned when the VM is provisioned and destroyed when the VM is destroyed) • Persistent storage has a lifecycle independent of any single VM and can be provisioned/destroyed at any time and attached/detached to many VMs during it’s life • File-based offerings are uncommon among providers, especially among those targeting cloud native applications • Primarily targeted at cloud enabled workloads • Usage is being replaced in new application development with online object storage • Object storage offerings are differentiated by the durability of the data (i.e. odds of irrecoverable loss) and segmented by the availability of the data (i.e. time required to retrieve) • An object in online storage is immediately accessible • An object in archival storage may require minutes to hours to be accessible 3
  5. 5. 3-15 Modules What’s Different about Spectrum Accelerate? 12 SED 1, 2, 3, 4, 6 TB Optional SSD 500, 800 GB 6-12 cores 24-96 GB RAM FCP Ethernet IB FCP Ethernet IB 6/9-15 Modules Host FCP + Hyper-Scale Mobility Host iSCSI + Mgmt Inter- node 6-12 HDD, JBOD 1, 2, 3, 4 TB Optional SSD 500-800 GB 4-20 cores 32-128 GB RAM VMware ESXi 5.5 Ethernet Ethernet Host iSCSI + Inter-node + Management Pre-built System Software-only 6
  6. 6. VM 2 IBM Spectrum Accelerate for Block-Level Hyperconvergence Enables the IT administrator to single-handedly manage the entire data center stack Allows hardware standardization of network, compute, storage, power and environmentals Leverages existing Data Center services and maintenance contracts Simplifies the architecture when lacking specialized, domain- specific skill sets Ethernet Interconnect Hypervisor Spectrum Accelerate Spectrum Accelerate Spectrum Accelerate Hypervisor iSCSI Hypervisor VM 1 VM 4 VM 6 iSCS I iSC SI VM 3 VM 5 iSCSI 8
  7. 7. IBM Spectrum Accelerate --- as a Service! • Single order for Accelerate on IBM SoftLayer • Operating Expense (OPEX) - no capital required • Ordered: – Base of 50TiB – Increments of 20 TiB • Two configurations are offered: – Capacity oriented (for archive type of applications) – Performance oriented (for real time processing applications) – Each package includes all features and unlimited traffic Capacity oriented servers Dual CPU 6 cores 32 GB RAM 11 x 4TB SATA drives 10GbE dual private links Performance oriented servers Dual CPU 8 cores 64 GB RAM 11 x 4TB SATA drives 800GB SSD 10GbE dual private links … 9
  8. 8. Virtualize Your Storage with IBM Spectrum Virtualize Virtual Server Infrastructure Storwize V7000 V7000 Unified, V5000 FlashSystem V9000 San Volume Controller 10 Virtual Storage Infrastructure
  9. 9. Real-time Compression implementation on Spectrum Virtualize IBM Random Access Compression Engine™ Benefits • Hardware-assisted real-time compression • Compressed data in cache to increase hit ratios • More capacity savings than data deduplication for active data • Compress existing data without downtime • Compress before Encryption to optimize benefits of both Upper cache Lower cache • Stretch Cluster forwarding • Metro Mirror, HyperSwap • Compression offloaded to Intel® QuickAssist FPGA • FlashCopy • Global Mirroring • Thin Provisioning 5x effective capacity! • Encryption 33
  10. 10. IBM Spectrum Scale – Flexible File and Object Storage FS1 FS256. . . Exabyte-Scale, Global Namespace One big file system or divide into as many as 256 smaller file/object systems Each file system can be further divided into fileset containers Metadata can be separated to its own Pool or intermixed with data Files and objects can be migrated to tape to reduce costsROBO Other Datacenters 36
  11. 11. IBM Spectrum Archive™ Overview IBM Spectrum Archive enables IBM tape libraries to read and write LTFS-format tapes as part of a Spectrum Scale™ global namespace – Based on the integration of Spectrum Scale™ and LTFS technology – Supports Spectrum-enabled devices •TS1140 (or higher) Enterprise Drive •LTO5 (or higher) Ultrium drive •IBM Libraries TS4500, TS3500, TS3310, etc. – Integrated functionality with Spectrum Scale •Supports Policy based migrations •Seamless DMAPI usage •Data replication to multiple pools – Supports scale-out for capacity and I/O •Seamless cache controls between Spectrum Archive Nodes •Tape drive performance balancing •Multiple node performance balancing Tokyo Las Vegas London Clients Wide Area Network (WAN) Global Namespace LTFS LTFS LTFS LTFS 46
  12. 12. IBM Spectrum Scale™ for File Sync-and-Share SAN Internal, Direct-Attach No IT Control: • Servers and storage • Security • Access control • User provisioning • Sensitive data TCP/IP or RDMA network Twin-tailed 57
  13. 13. Storage Efficiency with Cleversafe How to build a highly reliable storage system for 1 Petabyte of usable data? RAID 6 + Replication 1 PB 3.6 PB 900 3.6x 3.6x 3 FTE Replication/backup Usable Data Raw Storage 4TB Disks Racks Required Floor Space Ops Staffing Extra Software $$ 70% + TCO Savings Cleversafe® Original 1.20 PB Raw Onsite mirror 1.20 PB Raw Remote copy 1.20 PB Raw 1 PB 1.7 PB 432 1.7x 1.7x .5 FTE None 567 TB Raw 567 TB Raw567 TB Raw Information Dispersal Algorithm (IDA) Erasure coding is used to transform encrypted pieces of data into a customizable number of slices (7 pieces into 12 slices, in this example) Highly Scalable and Reliable Only a subset of disks needed to retrieve data (any 7 disks out of 12, in this example) 58
  14. 14. Original Data Encrypted, Erasure Coded Slices 12 11 10 9 8 7 6 5 4 3 1 2 SITE 1 SITE 2 SITE 3 Slicestor® Appliances Accesser® Appliance, Application, VM, Docker Container or Embedded Accesser® $ 7 6 5 4 3 1 2 Original object is encrypted then cut into pieces Each slice is written to a separate storage node. In this example, the storage nodes are geographically dispersed across 3 sites. Information Dispersal Algorithm (IDA) Erasure coding is used to transform the data into a customizable number of slices (7/12 in this example) Writing Data to Cleversafe 61
  15. 15. SITE 1 SITE 2 SITE 3 StorageNodes 7 6 5 4 3 1 2 1 3 7 2 5 6 4 $ With erasure coding “k” pieces are turned into “n” slices: Reads can be performed using any k of the n slices • This example is a “7 of 12” Information Dispersal Algorithm (IDA) means only 7 slices are needed to reconstruct the original object With this IDA, a read can still be executed with any five storage nodes being unavailable out of 12. With 3 sites, even an entire site outage (plus one additional storage node outage) can be tolerated. Reading Data from Cleversafe 62
  16. 16. Cloud Storage Positioning 66 Unified file and object storage. Optimized for high performance, across flash, disk and object store Flash Tape Object StoreDisk Object storage on disk File, backup and archive interfaces available through variety of options IBM SoftLayer OpenStack Swift Amazon Web Services S3 Swift S3 emulation Unified file and object storage on tape Transparent Cloud Storage Tiering (beta) Information Lifecycle Management across tiers HighPerformance Lower cost
  17. 17. Object storage pools for IBM Spectrum Protect On-premises server and object storage pool Object storage On-premises server, off-premises object storage pool Server Object storage Object storage On-premises server replicating to server in cloud Server Object storage Replication Server TCP/IPClients Off-premises server and object storage pool Clients Clients Server Clients Server “Cloud” storage pools will exploit object-storage APIs provided by cloud, without need for gateway Native cloud storage support based on container pools (not enabled for use as copy pool or database backup media) Initial support – OpenStack Swift, including IBM SoftLayer, IBM Cleversafe and IBM Spectrum Scale – Client backup/restore, archive/retrieve directly to/from object-storage pool Storage hierarchy Clients 80
  18. 18. Cloud Storage Taxonomy Storage as the Storage CloudStorage for the Compute Cloud Persistent Storage • Persists across VM reboots • Can be shared between VMs • Transactional • High Performance Reference Storage • Archives • Images Video • NENR and WORM Ephemeral Storage • Typically boot volumes, page files and temporary • Goes away when VM is shutdown Hosted Storage • File Storage • Object Storage • Backup • Disaster Recovery IBM XIV / SVC / DS8000 / FlashSystem Cleversafe, Spectrum Archive Spectrum Scale, Elastic Storage ServerTransactional Performance Universal Access Lowest TCO 81
  19. 19. Notices and Disclaimers 82 Copyright © 2016 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM. U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM. Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided. Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice. Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary. References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business. Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation. It is the customer’s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer’s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law
  20. 20. Notices and Disclaimers Con’t. 83 Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. The provision of the information contained h erein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right. IBM, the IBM logo,, Aspera®, Bluemix, Blueworks Live, CICS, Clearcase, Cognos®, DOORS®, Emptoris®, Enterprise Document Management System™, FASP®, FileNet®, Global Business Services ®, Global Technology Services ®, IBM ExperienceOne™, IBM SmartCloud®, IBM Social Business®, Information on Demand, ILOG, Maximo®, MQIntegrator®, MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™, PureApplication®, pureCluster™, PureCoverage®, PureData®, PureExperience®, PureFlex®, pureQuery®, pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, Smarter Commerce®, SoDA, SPSS, Sterling Commerce®, StoredIQ, Tealeaf®, Tivoli®, Trusteer®, Unica®, urban{code}®, Watson, WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at:
  21. 21. Thank You Your Feedback is Important! Access the InterConnect 2016 Conference Attendee Portal to complete your session surveys from your smartphone, laptop or conference kiosk.
  22. 22. IBM Tucson Executive Briefing Center • Tucson, Arizona is home for storage hardware and software design and development • IBM Tucson Executive Briefing Center offers: – Technology briefings – Product demonstrations – Solution workshops • Take a video tour! – 85
  23. 23. 86 About the Speaker Tony Pearson is a Master Inventor and Senior Software Engineer for the IBM Storage product line. Tony joined IBM Corporation in 1986 in Tucson, Arizona, USA. In his current role, Tony presents briefings on storage topics covering the entire IBM Storage product line, Software Defined Storage, Analytics, Watson, and Cloud Computing. He interacts with clients, speaks at conferences and events, and leads client workshops to help clients with strategic planning for IBM’s integrated set of storage management software, hardware, and virtualization products. Tony writes the “Inside System Storage” blog, which is read by thousands of clients, IBM sales reps and IBM Business Partners every week. This blog was rated one of the top 10 blogs for the IT storage industry by “Networking World” magazine, and #1 most read IBM blog on IBM’s developerWorks. The blog has been published in series of books, Inside System Storage: Volume I through V. Over the past years, Tony has worked in development, marketing and customer care positions for various storage hardware and software products. Tony has a Bachelor of Science degree in Software Engineering, and a Master of Science degree in Electrical Engineering, both from the University of Arizona. Tony has 19 patents for inventions on storage hardware and software products. 9000 S. Rita Road Bldg 9032 Floor 1 Tucson, AZ 85744 +1 520-799-4309 (Office) Tony Pearson Master Inventor Senior Software Engineer IBM Storage
  24. 24. Email: Twitter:Øtony Blog: Books:Ø_tony IBM Expert Network on Slideshare:Øtony Facebook: Linkedin: Additional Resources from Tony Pearson 87