Storage Virtualization Challenges

  • 2,461 views
Uploaded on

Challenges and best practices for storage in a virtual infrastructure

Challenges and best practices for storage in a virtual infrastructure

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
2,461
On Slideshare
0
From Embeds
0
Number of Embeds
1

Actions

Shares
Downloads
0
Comments
0
Likes
2

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • Data management is a critical business strategy that tackles data growth, storage costs, data protection and long-term data. Datacenter virtualization presents new challenges to manage business data, in the consolidated and increasingly complex infrastructure resulting from server and storage virtualization. How should an organization design and implement the right data protection strategy for the increasingly consolidated and virtualized datacenter, recognizing that virtualization has completely changed the rules for backup and high availability? What is the impact of virtualized computing on storage design?This presentation will review how the fundamental design principles for shared storage (Reliability, Availability, and Scalability) are applied to virtualized computing infrastructure, and then dive into the ramifications of server virtualiztion on data protection and high availability solutions.
  • Our say to do ratio is high. We execute technically. We allocate time out for training. You don’t have to pay us to learn. We’ve already done this and can apply to real life situations.No one else has the cross-trained expertise across all technology silos.
  • VMDirectPath I/O for Storage: http://www.youtube.com/watch?v=jmQ5Ej8r-aAParavirtualized SCSIPluggable Storage Architecture (PSA)In vSphere, leveraging third party storage vendor multi-path software capabilities has been introduced through a modularstorage architecture that allows storage partners to write a plug-in for their specific capabilities. These modules cancommunicate with the intelligence running in the storage array to determine the best path selection, as well as leveragingparallel paths to increase performance and reliability of the I/O from the ESX to the storage array. By default, the nativemultipath driver (NMP) supplied by VMware will be used. It can be configured to support round-robin multipath as well.However, if storVMware has used SCSI Reservation Locks with its Virtual Machine File System (VMFS) to allow multiple ESX hosts access to the same datastore. These locks allow for multiple access of many ESX hosts to the same datastore and are critical for preventing corruption, such as if two VMware admins both tried to create the same VM at the same time on the same volume. When a VM is powered-on its files become locked, much the same way as a document opened in Word becomes locked. This prevents silly administrative accidents by making it impossible to delete a VM (or document) while it is powered on (or in use).
  • a set of APIs focused on local backup/recovery use casesBackup vSphere virtual machines from a central backup server or virtual machine without requiring backup agents or requiring backup processing to be done inside each guest virtual machine on the ESX host

Transcript

  • 1. Data Management Strategies In A Virtualized Environment
    Randy Weis, Sr. Solutions Architect, Data Management
    January 20, 2011
  • 2. Agenda
    • What is Data Management?
    • 3. Storage Design Impacts
    • 4. Reliability
    • 5. Availability
    • 6. Scalability
    • 7. vStorage, VADP and VAAI
    • 8. VMware Backup Challenges
    • 9. Storage Virtualization
    • 10. Snapshots
    • 11. Replication
    • 12. Thin provisioning
    • 13. File System Virtualization
    • 14. Capacity Management
    • 15. Deduplication
  • What is Data Management?
    • What is Data management?
    • 16. A critical business strategy for data growth, storage costs, data protection and long-term data.
    • 17. Datacenter virtualization challenges
    • 18. Increasingly consolidated and complex infrastructure
    • 19. Impact of virtualized computing on storage design
    • 20. The right data protection strategy
    • 21. Backup
    • 22. High availability
    • 23. Fundamental design principles for shared storage
    • 24. Reliability, Availability, and Scalability
  • Storage Design Impacts
  • Phases of Cloud Adoption
    Phase III
    Phase II
    Phase IV
    Phase I
    Private
    Cloud
    Public
    Cloud
    Hybrid
  • 27. What’s New in vSphere: vStorage API
    vStorage API for Data Protection
    vStorage APIs for Site Recovery Manager
    vStorage APIs for Array Integration (VAAI).
    vStorage APIs for Multipathing (Pluggable Storage Architecture)
  • 28. VADP
    • vStorage API for Data Protection: a set of APIs focused on local backup/recovery use cases.
    • 29. No Proxy Host
    • 30. Veaam
    • 31. vRanger
    • 32. NBU 7
    • 33. BUE 2010
    • 34. CommVault 9*
  • VAAI
    • vStorage API for Array Integration:
    • 35. a set of APIs allow array vendors to “offload” various tasks from the ESX host
    • 36. Copy offload (think VDI cloning)
    • 37. “I/O Dedupe”, or Block Zeroing
    • 38. Scalable Lock Management = "Hardware Assisted Locking“
    • 39. http://www.youtube.com/watch?v=1sUS-LcEtBY
    • 40. The missing fourth primitive: Thin Provisioning Stun
  • ESX server
    Hardware
    VMware Backup Challenges
    Virtualization changes server, application, and information paradigm…
    Backup must evolve to deliver even greater consolidation and value
    Old Paradigm
    Physical environment: Low overall server utilization and plenty of bandwidth for backup
    New Paradigm
    Virtual environment: High overall server utilization and littlebandwidth for backup
    100%
    100%
    80%
    80%
    60%
    60%
    CPU Utilization
    CPU Utilization
    40%
    40%
    Shared physical resources
    20%
    20%
    0%
    0%
    Virtual
    Server A
    Virtual Server B
    Virtual Server C
    Server A
    Server B
    Server C
    20% resource utilization
    80% resource utilization
  • 41. vStorage APIs for Data Protection
    Backup Partner Solutions
    VMware enables scalable, non-disruptive backup and simple, reliable restore to any hardware
    APP
    APP
    BACKUP APP
    APP
    Traditional backup
    • Disruptive to applications and users
    • 42. Slow, complex process for full restore
    • 43. Hardware dependencies complicate restore
    Backup with VMware vSphere
    • Non-disruptive to applications & users
    • 44. Enables off-host, off-LAN backup with standard backup software via vStorage APIs for Data Protection
    • 45. Enables image and file-level backup of virtual machines
    • 46. VSS quiescing for app consistency (OS level consistency in Windows 2008)
    ArcServe
    OS
    OS
    OS
    OS
    NetBackup & Backup Exec
    ESX
    Backup Job
    vRanger
    Tivoli Storage Manager
    Simpana
    Avamar
    Tape or disk
    VM Snapshot
  • 47. VMware Backup Methods
    • Two backup methods for VMware
    VCB (VMware Consolidated Backup –VI3) - proxy
    VADP (vStorage API for Data Protection-vSphere) – no agents or proxy
  • 48. Second Friday Full Backup
    B
    C
    D
    E
    F
    L
    G
    H
    Data Deduplication: Technology Overview
    Thurs Incremental
    A
    C
    K
    Friday Full Backup
    Mon Incremental
    A
    B
    H
    A
    B
    C
    D
    A
    E
    F
    G
    Tues Incremental
    Weds Incremental
    C
    B
    I
    E
    G
    J
    A
    B
    C
    D
    E
    F
    G
    Backup Estimated
    Data Logical Reduction Physical
    FRIDAY FULL 1 TB 2–4x 250 GB
    Monday Incremental 100 GB 7–10x 10 GB
    Tuesday Incremental 100 GB 7–10x 10 GB
    Wednesday Incremental 100 GB 7–10x 10 GB
    Thursday Incremental 100 GB 7–10x 10 GB
    Second FRIDAY FULL 1 TB 50–60x 18 GB
    TOTAL 2.4 TB 7.8x 308 GB
    H
    I
    J
    K
    L
  • 49. Retain: Store More for Longer with Less
    Over one year of retention in 3U of Data Domain deduplication storage
    Backup Cumulative Estimated Physical
    Data Logical Reduction
    First Full 1 TB 4x 250 GB
    Week 1
    April 7 2.4 TB 8x 308 GB
    Week 2
    April 14 3.8 TB 10x 366 GB
    Week 3
    April 21 5.2 TB 12x 424 GB
    Month 1
    April 28 6.6 TB 14x 482 GB
    Month 2
    May 31 12.2 TB 17x 714 GB
    Month 3
    June 30 17.8 TB 19x 946 GB
    Month 4
    July 31 23.4 TB 20x 1,178 GB
    TOTAL 23.4 TB 20x 1,178 GB
  • 50. Shift to Virtual
    The Data Protection Challenge
    RTO/RPO
    Data Protection Results
    Event
    Time Loss
    RPO
    Data Loss
    RTO
    30% DR testing success rate within SLAs
    76% back up success rate with no formal tools to monitor jobs
    40% cite difficulty in validating back up / recovery process
    Multi-Protection Silos
  • 51. Resources and Links
    Brocade
    • Brocade_VMwareESX4_Overview_GA-TB-208-00
    • 52. Deploying_VMware_VI3_and_vSphere4
    • 53. Zoning Implementation Strategies for Brocade SAN Fabrics
    VMware
    • Fibre Channel SAN Configuration Guide (v3.5 and v4.0)
    • 54. Configuration Maximums, VI 3
    • 55. SAN System Design and Deployment Guide
    • 56. ESX Server 3 Configuration Guide
    • 57. VMFS Best Practices
    • 58. http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1021976
    • 59. What Is New in VMware vSphere™ 4: Storage
    Great Demo
    http://www.commvault.com/virtually-perfect-protection/demo.asp