vRanger<br />Technical Deck Library<br />5/24/2010<br />
Image-level backups and the virtual environment<br />Why is it important?<br />5/24/2010<br />2<br />
What is an Image?<br />A VMware Snapshot is a recording of all the changes that occurred since the VM was created<br />Sna...
What is a VM Image?<br />A VM image contains:<br />Hypervisor Configuration<br />OS, App<br />Data<br />A VM image can be ...
What is Image-Based BR?<br />Image-Based Backup & Recovery (BR):<br />Creates images using HV snapshot technology<br />Bac...
What is Image-Based BR: Backup<br />Creating a snapshot is fast, but:<br />Images can be large<br />Diffs, compression and...
Are Image-Based Backups Safe?<br />YES!!!Applications and Data are secure through entire process.  <br />The snapshot proc...
What is Image-Based BR: Recovery<br />Three things are recoverable from an image:<br />Image (reconstituted server)<br />F...
What is Image-Based BR: Recovery<br />Image portability enables multiple “where” recovery options:<br />Restore on-premise...
Image-Based BR Scenarios<br />Lab Automation: Maintaining test images<br />Replication: Maintaining synchronized failover ...
How it works<br />vRanger Pro 4<br />5/24/2010<br />11<br />
How vRanger Works<br />Source<br />Target<br />vRanger<br />1<br />Installs and discovers the environment in minutes.<br /...
How vRanger Works<br />Source<br />Target<br />Direct To Target<br />Backup<br />Jobs<br />vRanger<br />1<br />2<br />Inst...
How vRanger Works<br />Source<br />Target<br />Direct To Target<br />Backup<br />Restore<br />Jobs<br />Restore<br />vRang...
How vRanger Works<br />Source<br />Target<br />Direct To Target<br />Backup<br />Restore<br />Jobs<br />Restore<br />vRang...
 Shorter Windows: 	Parallel backups within and across sources
 Fewer Resources: 	Data is dedup’d before going on the wire
 Flexible: 		Intelligent mgmt of jobs on sources</li></ul>5/24/2010<br />15<br />
How vRanger Works: Backup (1..3)<br />vRanger uses a patented binary injection process to implement Direct-To-Target.<br /...
How vRanger Works: Backup (2..3)<br />3<br />Source<br />Target<br />The vRanger source binary grabs the snapshot from sto...
Shorten Backup Window: Parallel Backups<br />vRanger provides:<br />Simultaneous backups on each host<br />Simultaneous ba...
How vRanger Works: Backup (3..3)<br />vRanger supports two types of modes:<br />5/24/2010<br />19<br />
CBT and ABM<br />vRanger Pro 4<br />5/24/2010<br />20<br />
How CBT and ABM work together<br />A typical disk layout<br />Active Block<br />White Space<br />Changed Block<br />Delete...
Without ABM or CBT<br /><ul><li> without ABM or CBT enabled
 engine removes only the whitespace
applies to both 3.5 and 4.0 hosts</li></ul>1<br />Active Block<br />White Space<br />Changed Block<br />Deleted Data<br />
With ABM<br /><ul><li> Initial pass – with ABM enabled
 Active Block Mapping (ABM) selects only active blocks.
 Blocks occupied by deleted data not backed-up.</li></ul>2<br />Active Block<br />White Space<br />Changed Block<br />Dele...
At the next backup…<br />3<br />Typical disk layout for subsequent backup pass<br />Active Block<br />White Space<br />Cha...
CBT and Incremental/Differentials<br /><ul><li>Only changed blocks are backed up
Without ABM both active and deleted changed blocks are backed up</li></ul>4<br />Active Block<br />White Space<br />Change...
ABM on Incremental/Differentials<br />5<br /><ul><li>Backup pass with ABM enabled, no CBT
 With ABM, only Active changed blocks are backed-up</li></ul>Active Block<br />White Space<br />Changed Block<br />Deleted...
Both on Incremental/Differentials<br /><ul><li>Backup pass with ABM and CBT enabled
(Only supported on ESX 4 hosts)
Blocks backed-up does not change, but
scan times are muchlower,
resulting in much faster backups</li></ul>6<br />Active Block<br />White Space<br />Changed Block<br />Deleted Data<br />
Change Block Tracking (CBT)<br />a vStorage API feature<br />Eliminates change-scanning during inc/diff’s<br />Reduces dat...
Why CBT?<br />Large disks<br />Removes scan time needed to ID changes<br />Network based VMFS<br />Scanning for change slo...
CBT Support in vSphere<br />Most VMs supported on ESX4<br />vSphere API has flag indicating VM support<br />VMs must:<br /...
Activating CBT<br />CBT must be turned on, in vSphere<br />Disabled by default<br />Is enabled per VM, on an individual ba...
Active Block Mapping (ABM)<br />What is it?<br />A tool that reads the Windows NTFS file system in a VMDK and identifies <...
ABM:  Details<br />Activated in a backup job as an option.<br />New jobs:  on by default<br />(remains off on jobs migrate...
ABM, CBT and Backup Mode<br />If ABM and CBT are both enabled<br />ABM is always used on fulls<br />incremental or differe...
ABM – Restore Behavior<br />Note that undeleted programs will not work on a restored VM that was backed up with ABM.<br />...
ABM:  Support<br />Windows XP - Windows 2008 R2<br />Windows NTFS only<br />Basic disks only<br />Supported only on ESX an...
LAN-Free and ESXi backups<br />vRanger Pro 4<br />5/24/2010<br />37<br />
How It Works:  Network Backups<br />5/24/2010<br />38<br />
ESX Network backups<br />Direct to target<br />To Backup Repository<br />vCenter<br />vRanger  Pro <br />Mmgt Connection<b...
How It Works:LAN-Free & ESXi Network Backups<br />5/24/2010<br />40<br />
vStorage API for data protection ESXi Network backups<br />To Backup Repository<br />vCenter<br />vRanger  Pro <br />Compr...
Requirements for LAN free backups<br />vRanger Pro installed on a physical proxy server<br />One proxy per set of VMFS lun...
vRanger Pro  LAN free jobs<br />5/24/2010<br />43<br />Compatible with 3.0.2 – 4.x ESX hosts<br />Compatible with 3.5 – 4....
How vRanger Pro proxy should see disks<br />5/24/2010<br />44<br />
Job Option for LAN free backups<br />5/24/2010<br />45<br />
vRanger Pro Architecture for LAN free backups<br />ESX<br />Host<br />ESX<br />Host<br />Fibre Channel Switch<br />Lun 0<b...
vRanger Pro Architecture for LAN free backups<br />vRanger<br />Server <br />ESX<br />Host<br />ESX<br />Host<br />Fibre C...
vRanger  Pro Architecture for LAN free backups<br />iSCSI Switch(s)<br />vRanger<br />Server <br />ESX<br />Host<br />ESX<...
vRanger  Pro Architecture for LAN free backups<br />Read Only Access<br />FC / iSCSI Switch(s)<br />ESX<br />Host<br />ESX...
vRanger Pro Architecture for LAN free backups using a FC SAN<br />Prod Network – to vCenter<br />To Backup Repository<br /...
vRanger Pro Architecture for LAN free backups using an iSCSI SAN<br />Shared Storage (VMs)<br />Prod Network – to vCenter<...
vRanger Pro Architecture for LAN free backups using an iSCSI SAN (2)<br />Shared Storage (VMs)<br />Prod Network – to vCen...
Data Flows with LAN freebackups<br />Prod Network – to vCenter<br />Nic 0<br />Shared Storage (VMs)<br />Reads<br />Reads<...
Upcoming SlideShare
Loading in …5
×

Vizioncore vRanger 4.5 Technical Overview

7,647 views

Published on

Technical deck covering Vizioncore vRanger backup

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
7,647
On SlideShare
0
From Embeds
0
Number of Embeds
18
Actions
Shares
0
Downloads
179
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • This section is intended to give a background in image-level backups, and how they’re especially relevant in the virtual environment. Some prospects will be unfamiliar with image-level, especially if they are using traditional, file-level backup applications.
  • The process runs as such:A Virtual Machine snap shot freezes its “VMDK” on the VMFS storage to a point in time.All change are then written to an alternative VMDK called a delta for the life span of the VMware snap shot When vRanger creates a backup job it executes 1, backups up the VMDK, and sends the API commands to merge 2 back into the original VMDK again. 
  • An image of a VM is very versatile – it contains ALL of the information necessary to reconstitute that VM anytime, anywhere. Very important is the hypervisor configuration – info on how the VM is configured to run within the virtual env.
  • When we discuss “image-based BR” it is the concept of harnessing the snapshots available w/in a HV, saving them to remote repositories, and then being able to restore them back to fully-operational VMs. (at the original, or alternate locations w/in the virtual environment)“HV” = hypervisor
  • Lot of data is required for image-level: differential/incremental backups, compression and block-level data dedup are required to make this work in a practical manner. Therefore compression and space-saving functions are necessary (as vR has or will have through the 4.x releases)File-based has inherent limitations – it works, but requires extra complexities in either the SW or the workflow to overcome.
  • Addresses any fears over image-based transactions. Image-based BR is based on the HV’s snapshotting technology, which is specifically designed by the HV platform vendor for consistency and integrity
  • Image-based backups offer very flexible and efficient recovery scenarios: a wide spectrum of recovery options are avail (image-file-object) and can be accomplished w/o full image reconstitution (vR feature)
  • In addition to the flexibilities mentioned earlier, image-based BR in a virt. Environment also gives you additional benefits of:Restoring any-WHERE: the original VM/file location is no longer a pre-requisite to the restore process. Image-based BR allows organizations to skirt the restrictions of re-creating their environment exactly as it was, before the event. Dissimilar environments and hardware can be utilized now.In addition, physical systems can be restored quickly and easily into virt. Environments, with P2V tools (avail now in vR 3.x, coming to the 4.x platform in 2010)
  • At the image-level:Whatever time it takes to copy and uncompress the informationis the restore timeDirect-to-Targetfaster than streamed media and multiple VM’s can be restored simultaneously from multiple targets with vRanger Pro in the event of a multi-VM failureThe ENTIRE VM, including those settings “outside of the VM” are restored
  • This section details in graphic form how vRanger works
  • vRanger is a Windows .NET application that can be installed either in a VM or physical machine, running a windows OS. During the wizard-based install, it automatically discovers the virtual environment – making it ready to backup the entire virtual environment
  • During a backup job, vRanger executes on backup jobs created by the user. When a job launches, it copies data directly from the source VMs to the target repository. There are no proxies involved in the backup process: data travels directly from source to target, making for an extremely efficient transfer.
  • During the recovery process, the opposite occurs: data from backed-up images in the target repository is transmitted directly to a recovery point. If anything less than an entire VM is required, the recovery tools grab images, files, or objects WITHOUT image reconstitution, and present them to vRanger for saving to alternate locations.
  • The benefits of Direct to Target architecture are numerous and a direct value-add to the BR process. The process is faster, more efficient, and less complex to operate and maintain.
  • This slide is a more detailed version of the backup process: When a backup job is initiated, vRanger libraries are injected as a binary runtime onto the source machines. The runtime then manages its connections to the target repositories.vR requests a that the virtual platform (ESX) create a snapshot of the contents of the VM. (either through vCenter or directly to the host, depending on the ESX version)
  • 3) Once the snapshot has been saved into the source storage environment, the vRanger binary can read from the snapshot files4) finally, vRanger performs several space-saving and value-add functions (i.e.. Compression, encryption, deduplication) and saves a image of the snapshot (or a delta of changes, if an incremental or differential backup is performed)
  • The entire backup process described in the previous slides can be repeated, simultaneously, across multiple backup streams. vRanger Pro 4 has a Smart Backup Manager that can harness the full processing power of your ESX environment to send multiple backup streams at once. This allows the backups to be completed faster, and preserves or improves upon backup windows.
  • FC = FibreChannelTo elaborate on how vR works, there are 2 fundamental types of operating modes for vR:‘hypervisor console’ is the traditional method, that has been described in previous slides. The ESX console hosts vR, to drive backups across the environment. This method, has been proven over years of vR releases.LAN-free: for those customers wishing to offload backup traffic to an alternate, FC network. Leverages the newer, more efficient vStorage API, as opposed to the older VCB technology. vR must be installed on a windows physical host for this
  • Since the 4.0 release ofvR, we have been able to skip whitespace on backups – across all ESX hosts
  • Enabling ABM allows backup of only active blocks Blocks occupied by deleted data are not replicated
  • At the next backup pass, vR will encounter multiple types of blocks on a virtual disk: active, but not changedActive and changedDeleted dataWhite space
  • At this point, with only CBT enabled on a diff/incremental backup:Differential backup will only selected those blocks that have changedboth active and deleted changed blocks will be selected for backup.
  • If on the other hand ABM is enabled, only changed active blocks are backed up. Obviously, less data is backed up, but performance can be improved dramatically by taking it to the next level…
  • Thebackedup blocks are the same as previous slide – only changed blocks, However, scan times are much lower resulting in significant faster performance and shorter windows.
  • This feature is part of the vStorage APIs for Data Protection (VADP) which allows 3rd party vendors to no longer scan for changes when performing incremental’s or differentials backups. This is a key feature for a shorting the backup window, which is a key story for 4.x.Reduces the amount of data that must be sent to repositoryShortens backup windows
  • Large disksRemoves the Scan time needed to find changed in-between backups.(however, it Does not change the amount of time it takes to compress and send data to the target.)Network based VMFSSince CBT removes the need to scan VMDK’s this helps a large amount on network based VMFS. Scanning for change is slower on network based VMFS.As an example, for this vizioncore backup:Start Time: 2/11/2010 10:09:27 PMEnd Time: 2/11/2010 11:43:33 PMDuration: 94 minute(s)Archive Size: 2.82 GBThe New Duration could be down to 3 minutes
  • VM’s hosted on ESX4, depending on the VM configuration, may support change tracking. The vSphere API has a flag that indicates whether or not a particular VM is change tracking capable.VM’s hosted on ESX3 do not support change tracking.
  • Vsphere : CBT must be turned on first. Not on by default. Is enabled per VM. Bulk-enable script:http://vcommunity.vizioncore.com/administration/vecoshell/b/weblog/archive/2010/04/19/bulk-enabling-cbt-for-vms.aspx This site discusses: http://itknowledgeexchange.techtarget.com/virtualization-pro/what-is-changed-block-tracking-in-vsphere/Otherwise, a backup job just works w/ CBT, as long as it’s been enabled on the individ. VMIF CBT or ABM fail for any reason, job still completes: this will show up though only in the logs. (this is future feature request)Screenshot credit: http://www.punchingclouds.com/wp-content/uploads/2009/12/Screen-shot-2009-12-09-at-6.38.44-PM.png
  • FDAF: https://sharepoint.vizioncore.com/sites/Architecture/Sportster/RNGR-00008-ActiveBlocks.docx
  • On backup execution, if ABM is enabled, If CBT is enabled on the VM (status persisted in vRanger database) to be backed upIf no space saving technology is chosen for the job, ABM shall always be used on all full backups. If incremental or differential is selected, ABM shall only be used on the initial full backup; any incremental or differential thereafter shall use both the AB and CB filter.If CBT is not enabled on the VM to be backed up, ABM shall always be used regardless of the space saving technology choiceABM shall be applied only to Windows guest OSes when it is enabled
  • Restore, VMDK is filled with Zero’s before restore started, only Active Data Blocks are restored to VMDK, not deleted blocks and we don’t spend time writing zero’s.Undeleted programs will not work on a restore VM that was backed up with ABM.
  • With the release of vRanger Pro 4.2, two new features have been added to the product.The first is support for licensed ESXi hosts. vRanger Pro is now able to backup VM’s running on ESXi hosts. The requirements to use an ESXi host are it must be licensed (not the free version). Typically this will mean that the ESXi server is managed by vCenter, but as long as it is licensed, it does not need to be managed by vCenter. You will have to discover and add the ESXi hosts individually within vRanger if they are not managed by vCenter.The second feature is support for LAN free backup options. vRanger Pro can now utilize Fibre Channel or iSCSI networks allowing administrators to separate backup traffic and not put any additional load on your ESX hosts. For this release, the LAN free option does not include a direct to target option. From a vRanger Pro user or admin point of view, support for ESXi involves no changes to how you use vRanger. You license your ESXi hosts in vRanger Pro the same as you would an ESX host and you configure your jobs the same way.For the remainder of this course update, we will focus on the LAN free feature that is now available in vRanger Pro.
  • This is a review: simply another way to diagramvR Direct To Target: backups across the network
  • This slide illustrates how vRanger Pro performs backups on an ESX host for comparison purposes. During backup, the vRanger Pro backup agent is injected into the service console OS, reads the VM’s disk, discards the empty blocks, compresses the data and then sends the compressed data directly to the backup respository, bypassing the vRanger Pro server. The agent does not remain resident in memory after the backup completes.
  • The current (intro. At 4.2) implementation of LAN-free, vR does act as a proxy for the backup traffic that comes from the repository, across the vR physical machine, and then finally to the target repository. That being said, the traffic goes across the FibreChannel network, off of the LAN, and has tested internally at fast rates of ~ 174 MB/sESXi backups work the same wayNetwork mode Backup - ESXi – All traffic from the ESXi host to the vRanger server will be uncompressed, compressed on the vRanger server then streamed to the repository – one step process.Network mode Restore – ESXi – The backup archive will be streamed from the repository in its compressed form to the vRanger server, while being streamed uncompression will occur from the vRanger server to the ESXi host.
  • This diagram illustrates how vRanger Pro performs backups on ESXi hosts. vRanger Pro utilizes the vStorage API to perform these backups.The backup traffic travels over the management connection of the ESXi host using the network transport method (NBD) of the vStorage API.The traffic between the ESXi host and the vRanger Pro server will be uncompressed, and then the vRanger Pro server will compress the traffic and send it to the backup respository. To improve performance vRanger Pro server discards empty blocks (“0’s”), compresses it and sends it to the backup repository “on the fly”, the only time the data is written to disk is on the backup respository.
  • You should read and understand all of the documentation published by Vizioncore for vRanger before implementing LAN FREE backups so as to avoid configuration errors. This slide highlights some important considerations for those organizations considering implementing LAN FREE backups with vRanger Pro 4.As in vRanger Pro 3 with VCB, you will need to install vRanger Pro on the physical proxy that is zoned and given access to the VMFS luns shared by your ESX hosts.Only one proxy should be used with a given set of VMFS luns.There is no need for the VCB application on the proxy server, the vStorage libraries are distributed with the vRanger Pro application. This means there is one less application to manage and maintain.The vStorage storage APIs are compatible with ESX 3.0.2 and later releases. In order to use the vStorage API for backups or replication, the ESX hosts require a minimum license level of “Essentials”. This is a VMware requirement.
  • vRanger Pro 4.2 jobs that have the “Use fiber or iSCSI” option selected will use the vStorage API to access a VM’s disks to read the VM’s data to perform the backup. Using the vStorage API, the data will be uncompressed as it travels from the storage device to the vRanger Pro server.At the vRanger server it the empty blocks will be ignored, and the data will be compressed and then sent to the storage repository.
  • This shows the physical proxy server where vRanger is installed and how it sees the storage when everything is connected and working.Disk 0 is the local disk where the OS and vRanger Pro application are installed.Disks 1-4 are the VMFS luns that are shared by the ESX hosts and the physical proxy server where vRanger Pro is installed.Disk 5 in this case, is the storage repository, in this case an iSCSI lun formatted with NTFS.Notice that for the VMFS luns that the partition is unknown. This is because it is formatted with VMFS and not NTFS. You should read and understand the documentation for proper configuration of the proxy server. (For example, disable auto mount so the Windows OS on the proxy server does not try to write a disk signature to the shared storage (VMFS) luns and corrupt the disks).
  • To use the LAN free option, edit or create a new job and select the “Use Fiber or iSCSI” option in your backup job.Also notice the setting below it which is to perform a Network backup if the Fiber or iSCSI attempt fails. This is selected by default and should be de-selected if you do not want this option enabled.
  • This diagram shows a typical environment where the ESX hosts are connected to a FC switch which connects to the FC storage device.For illustration purposes we only show one switch, when many environments use redundant switches to provide multipathing failover protection.To be able to implement LAN free backups with the same functionality as VCB, you will need to implement a physical proxy that uses the FC infrastructure and is zoned and given access to the shared storage where the VMs are stored. This part of the setup is the same as VCB and all the best practices from VCB days still apply.
  • So here we see the physical proxy server added to the environment. This is where vRanger Pro will be installed. There is no need to install anything besides vRanger Pro, it contains all of the dll’s necessary to use the vStorage APIs. So this is a simpler implementation to install and configure as well as maintain.
  • Similar to a Fibre Channel network, the iSCSI network architecture has the same basic requirements of allowing connectivity to the iSCSI SAN storage device and granting access to the LUNS where the VMs are stored. With an iSCSI network, implementations will require that the vRanger proxy server connections to be in the same vlan (where vlans are used) as the ESX connections to the shared storage.
  • If your storage device provides the ability to provide very granular access, the vRanger Pro server only needs read only access to the shared storage where the VMs are stored. This is not a requirement, but a best practice when possible.
  • This diagram illustrates an environment where the VMs are stored on a FC SAN and the storage repository for backups are also on a FC SAN.To improve performance, use one HBA to read the source VMs’ disks and a second HBA to write to the repository. This will allow you to scale the number of concurrent backups and reduce your overall backup window.
  • This diagram illustrates an environment where the VMs are stored on a iSCSI SAN and the storage repository for backups is an iSCSI SAN. So we see an NIC connection where the physical vRanger proxy server reads the VMs’ data, and a second NIC where the compressed data is sent to the repository to store the archives. In a small environment, this could be a typical design.
  • In a large production environment, organizations can utilize multiple connections to the shared storage. If you have additional NICs in your vRanger Pro proxy server to use for the connection(s) to the backup repository(s), this can also improve your backup performance and shorten your backup window. Having your different storage repository devices available on different subnets for your vRanger Pro server will simplify analyzing performance and identifying bottlenecks. Limiting the number of hops between your vRanger server to the storage repository, and ideally using a separate storage network infrastructure are also best practices for performance and security reasons.
  • Now lets take a look on how the data flows when you use the LAN free option in vRanger Pro. First, the data will be read from the shared storage using vRanger Pro’s connection to the shared storage. As the data is read, the vRanger Pro compression engine will gather and compress the data stream to conserve space on the storage repository and also lower the amount of traffic on that connection. Consequently, there will always be more traffic occurring on the read connections as compared to the write connections.
  • Here we see data that has been collected on the vRanger Pro server. &gt; Now we will see the illustration as is shows the data being compressed, this all happens continuously throughout the backup process. &lt;Next slide&gt;
  • &gt;Here you should notice that the data blocks have changed color &gt; to indicate that there are now in a compressed state and will travel over the write connection where they will be stored on your backup repository.So as you can see, if you add more read and write connections, you should be able to increase the speed of your individual backups, be able to run more jobs in parallel, and reduce your backup windows. At some point you may saturate some resource. It may be a nic or hba, or a group of disks, a port buffer or physical link, or the physical resources on your vRanger Proxy server.So measuring performance to get some baseline performance data as you begin to implement and then continuing to gather some performance data as you change configurations and increase the backup loads will help you determine if there are factors in your environment that are creating performance bottlenecks.
  • This is a new window that appears in the vRanger “My Inventory” view. It allows a user to group disparate VMs, hosts, and folders together, for the purpose of creating backup jobs on those particular assets. This gives you more flexibility for setting up your backup jobs.Can include any VC object, DC, Clusters, VM’s, foldersObject can be static or dynamic.
  • Restore, VMDK is filled with Zero’s before restore started, only Blocks with data are restored to VMDK, this way we won’t spend time writing zero’s and inflating a thin disk.In the event you (or support) performs a manual restore and end up with a flat disk you can clone a VM or migrate a VM from flat too thin to change its type.
  • When creating a backup, The user provided encryption password shall meet the following complexity requirements:Contains at least six charactersContains characters from three of the following categoriesUppercase alphabet characters (A-Z)Uppercase alphabet characters (a-z)Arabic numerals(0-9)Non-alphanumeric characters (for example, !$#%)RestoreOn restore you will be asked for this passwordImporting a repositorySave point Manifest restoreManual restore
  • Wizard-driven, GUI interface for creating backup jobs
  • Intuitive, graphic interface for at-a-glance feedback on current jobs
  • Summary screen of a restore job: -description,The savepoints used to restore any scheduling infoOptions used
  • A simple, straight-forward interface for FLR: select the files from the savepoint on the leftChoose your destination on the rightStatus/progress is shown at bottom
  • configuration options, gives users complete control over the process:Max num of tasks running at one timeMax num of tasks off a LUNMax num of tasks on a hostMax num of tasks per repositoryTimeout value (in hours) for a taskMin space needed on hostsThese settings that tweak the Smart Backup Manager, allow for a user to either increase or decrease vR’s activity, based on their specific environmental requirements
  • Vizioncore vRanger 4.5 Technical Overview

    1. 1. vRanger<br />Technical Deck Library<br />5/24/2010<br />
    2. 2. Image-level backups and the virtual environment<br />Why is it important?<br />5/24/2010<br />2<br />
    3. 3. What is an Image?<br />A VMware Snapshot is a recording of all the changes that occurred since the VM was created<br />Snapshots can be created on running VMs<br />Changes/deltas tracked separately & merged later<br />vRanger creates an Image based on snapshot technology<br />combination of the snapshot & tracked changes<br />Exact representation of the VM at time of backup<br />5/24/2010<br />3<br />
    4. 4. What is a VM Image?<br />A VM image contains:<br />Hypervisor Configuration<br />OS, App<br />Data<br />A VM image can be reconstituted on any system running the correct hypervisor base.<br />Reconstitution enables point-in-time DR.<br />5/24/2010<br />4<br />
    5. 5. What is Image-Based BR?<br />Image-Based Backup & Recovery (BR):<br />Creates images using HV snapshot technology<br />Backs up and recovers images <br />Enables reconstitution of images into servers<br />5/24/2010<br />5<br />
    6. 6. What is Image-Based BR: Backup<br />Creating a snapshot is fast, but:<br />Images can be large<br />Diffs, compression and dedup are must haves<br />File-based backups of VMs work, but:<br />Backups may be slower (copy instead of snapshot)<br />Reconstitution is not automatic<br />Limited scalability (may require proxies)<br />Limited compression of large VM files<br />5/24/2010<br />6<br />
    7. 7. Are Image-Based Backups Safe?<br />YES!!!Applications and Data are secure through entire process. <br />The snapshot process:<br />Does not disrupt a running VM<br />Keeps apps in the image consistent<br />Can be integrated with VSS for added integrity<br />5/24/2010<br />7<br />
    8. 8. What is Image-Based BR: Recovery<br />Three things are recoverable from an image:<br />Image (reconstituted server)<br />File<br />Object (e.g.: email)<br />Files and objects can be recovered without image reconstitution.<br />Recovered Object<br />Stored Image<br />Recovered File<br />5/24/2010<br />8<br />
    9. 9. What is Image-Based BR: Recovery<br />Image portability enables multiple “where” recovery options:<br />Restore on-premise<br />Restore to cloud<br />Restore to dissimilar hardware<br />Non-virtualized systems can be converted to images using P2V tools:<br />Backup physical systems using image BR<br />Recover a physical box into a VM<br />5/24/2010<br />9<br />
    10. 10. Image-Based BR Scenarios<br />Lab Automation: Maintaining test images<br />Replication: Maintaining synchronized failover environments<br />Data Security: Protect data and meet compliance requirements<br />Disaster Recovery: Recreate production environments<br />5/24/2010<br />10<br />
    11. 11. How it works<br />vRanger Pro 4<br />5/24/2010<br />11<br />
    12. 12. How vRanger Works<br />Source<br />Target<br />vRanger<br />1<br />Installs and discovers the environment in minutes.<br />5/24/2010<br />12<br />
    13. 13. How vRanger Works<br />Source<br />Target<br />Direct To Target<br />Backup<br />Jobs<br />vRanger<br />1<br />2<br />Installs and discovers the environment in minutes.<br />SOURCES transmit images to TARGETS without proxying.<br />We call this Direct To Target.<br />5/24/2010<br />13<br />
    14. 14. How vRanger Works<br />Source<br />Target<br />Direct To Target<br />Backup<br />Restore<br />Jobs<br />Restore<br />vRanger<br />1<br />2<br />3<br />Installs and discovers the environment in minutes.<br />SOURCES transmit images to TARGETS without proxying.<br />We call this Direct To Target.<br />SOURCES and vRanger restore directly from TARGETS.<br />5/24/2010<br />14<br />
    15. 15. How vRanger Works<br />Source<br />Target<br />Direct To Target<br />Backup<br />Restore<br />Jobs<br />Restore<br />vRanger<br />Direct to Target Benefits:<br /><ul><li> Shorter Windows: no proxy; no bottleneck
    16. 16. Shorter Windows: Parallel backups within and across sources
    17. 17. Fewer Resources: Data is dedup’d before going on the wire
    18. 18. Flexible: Intelligent mgmt of jobs on sources</li></ul>5/24/2010<br />15<br />
    19. 19. How vRanger Works: Backup (1..3)<br />vRanger uses a patented binary injection process to implement Direct-To-Target.<br />1<br />vRanger<br />Source<br />Target<br />The latest vRanger libraries are injected into source’s runtime.<br />The runtime manages connections to targets.<br />Other Processes<br />Repository<br />Binary Runtime<br />Inject<br />Comm<br />2<br />vRanger<br />VCenter<br />Source SAN / NAS<br />Req<br />vRanger issues snapshot requests to vCenter or ESX host.<br />Snap<br />or<br />ESX Host<br />Req<br />5/24/2010<br />16<br />
    20. 20. How vRanger Works: Backup (2..3)<br />3<br />Source<br />Target<br />The vRanger source binary grabs the snapshot from storage. <br />Other Processes<br />Binary Runtime<br />Repository<br />Grab SnapshotsDedup, CompressEncryptReconstitute Image<br />Send<br />4<br />We perform intelligent middleman logic including dedup, compression, encryption, and target connection mgmt.<br />Grab<br />SAN / NAS Storage<br />Snapshot Files.VMDK.VHD<br />5/24/2010<br />17<br />
    21. 21. Shorten Backup Window: Parallel Backups<br />vRanger provides:<br />Simultaneous backups on each host<br />Simultaneous backups across hosts<br />Source 1<br />Target<br />Binary Runtime<br />Send<br />Repository<br />Connection MgmtThreaded Access<br />Send<br />Source 2<br />Binary Runtime<br />Send<br />Connection MgmtThreaded Access<br />Send<br />5/24/2010<br />18<br />
    22. 22. How vRanger Works: Backup (3..3)<br />vRanger supports two types of modes:<br />5/24/2010<br />19<br />
    23. 23. CBT and ABM<br />vRanger Pro 4<br />5/24/2010<br />20<br />
    24. 24. How CBT and ABM work together<br />A typical disk layout<br />Active Block<br />White Space<br />Changed Block<br />Deleted Data<br />
    25. 25. Without ABM or CBT<br /><ul><li> without ABM or CBT enabled
    26. 26. engine removes only the whitespace
    27. 27. applies to both 3.5 and 4.0 hosts</li></ul>1<br />Active Block<br />White Space<br />Changed Block<br />Deleted Data<br />
    28. 28. With ABM<br /><ul><li> Initial pass – with ABM enabled
    29. 29. Active Block Mapping (ABM) selects only active blocks.
    30. 30. Blocks occupied by deleted data not backed-up.</li></ul>2<br />Active Block<br />White Space<br />Changed Block<br />Deleted Data<br />
    31. 31. At the next backup…<br />3<br />Typical disk layout for subsequent backup pass<br />Active Block<br />White Space<br />Changed Block<br />Deleted Data<br />
    32. 32. CBT and Incremental/Differentials<br /><ul><li>Only changed blocks are backed up
    33. 33. Without ABM both active and deleted changed blocks are backed up</li></ul>4<br />Active Block<br />White Space<br />Changed Block<br />Deleted Data<br />
    34. 34. ABM on Incremental/Differentials<br />5<br /><ul><li>Backup pass with ABM enabled, no CBT
    35. 35. With ABM, only Active changed blocks are backed-up</li></ul>Active Block<br />White Space<br />Changed Block<br />Deleted Data<br />
    36. 36. Both on Incremental/Differentials<br /><ul><li>Backup pass with ABM and CBT enabled
    37. 37. (Only supported on ESX 4 hosts)
    38. 38. Blocks backed-up does not change, but
    39. 39. scan times are muchlower,
    40. 40. resulting in much faster backups</li></ul>6<br />Active Block<br />White Space<br />Changed Block<br />Deleted Data<br />
    41. 41. Change Block Tracking (CBT)<br />a vStorage API feature<br />Eliminates change-scanning during inc/diff’s<br />Reduces data to be backed-up<br />Shortens backup window<br />
    42. 42. Why CBT?<br />Large disks<br />Removes scan time needed to ID changes<br />Network based VMFS<br />Scanning for change slower on network based VMFS: CBT helps dramatically<br />Example: A 94 minute backup of 2.8 GB could be dramatically reduced to only 3 minutes<br />
    43. 43. CBT Support in vSphere<br />Most VMs supported on ESX4<br />vSphere API has flag indicating VM support<br />VMs must:<br />Be Hardware Version 7<br />Be able to add Snapshots to the VMDK’s<br />No independent disks or RDM LUNs<br />Have a stun or unstun cycle to enable or disable<br />No support on ESX3<br />
    44. 44. Activating CBT<br />CBT must be turned on, in vSphere<br />Disabled by default<br />Is enabled per VM, on an individual basis<br /><ul><li>When activated, icon is shown on “My Inventory”</li></ul>PowerShell script exists to Bulk-enable CBT<br />
    45. 45. Active Block Mapping (ABM)<br />What is it?<br />A tool that reads the Windows NTFS file system in a VMDK and identifies <br />blocks that are actually used by the OS vs. <br />blocks have been deleted to recycle bin<br />Benefit<br />Faster incremental/differential backups:<br />Only blocks that are actually used are read.<br />
    46. 46. ABM: Details<br />Activated in a backup job as an option.<br />New jobs: on by default<br />(remains off on jobs migrated from earlier versions)<br />While CBT is VM-specific, ABM is Job-specific<br />Can be used in conjunction with CBT<br />
    47. 47. ABM, CBT and Backup Mode<br />If ABM and CBT are both enabled<br />ABM is always used on fulls<br />incremental or differential use both the AB and CB filter.<br />If only ABM is enabled<br />ABM works regardless of backup type<br />
    48. 48. ABM – Restore Behavior<br />Note that undeleted programs will not work on a restored VM that was backed up with ABM.<br />Deleted files from recycle bin are not available after a VM is restored from a save-point.<br />
    49. 49. ABM: Support<br />Windows XP - Windows 2008 R2<br />Windows NTFS only<br />Basic disks only<br />Supported only on ESX and LAN backups<br />ABM not currently supported for vStorage API(vRanger: LAN-free and ESXi backups)<br />Note: master file table needs to be ‘clean’<br />‘file table not supported’ error: run chckdsk<br />
    50. 50. LAN-Free and ESXi backups<br />vRanger Pro 4<br />5/24/2010<br />37<br />
    51. 51. How It Works: Network Backups<br />5/24/2010<br />38<br />
    52. 52. ESX Network backups<br />Direct to target<br />To Backup Repository<br />vCenter<br />vRanger Pro <br />Mmgt Connection<br />vStorage API uses this connection for Network transport backups <br />ESX Host<br />Nic 0<br />Compressed<br />Service Console<br />Storage Connections<br /> (Ethernet or FC)<br />5/24/2010<br />39<br />
    53. 53. How It Works:LAN-Free & ESXi Network Backups<br />5/24/2010<br />40<br />
    54. 54. vStorage API for data protection ESXi Network backups<br />To Backup Repository<br />vCenter<br />vRanger Pro <br />Compressed<br />Uncompressed<br />Mmgt Connection<br />vStorage API uses this connection for Network transport backups <br /> ESXi Host<br />Nic 0<br />Storage Connections<br /> (Ethernet or FC)<br />5/24/2010<br />41<br />
    55. 55. Requirements for LAN free backups<br />vRanger Pro installed on a physical proxy server<br />One proxy per set of VMFS luns<br />VMFS luns zoned so vRanger Pro can see and read them<br />VCB application is no longer used<br />Works with ESX 3.0.2 - ESX 4 (vSphere)<br />ESX 4 hosts require minimum “Essentials” license to use the vStorage API.<br />5/24/2010<br />42<br />
    56. 56. vRanger Pro LAN free jobs<br />5/24/2010<br />43<br />Compatible with 3.0.2 – 4.x ESX hosts<br />Compatible with 3.5 – 4.x ESXi hosts<br />
    57. 57. How vRanger Pro proxy should see disks<br />5/24/2010<br />44<br />
    58. 58. Job Option for LAN free backups<br />5/24/2010<br />45<br />
    59. 59. vRanger Pro Architecture for LAN free backups<br />ESX<br />Host<br />ESX<br />Host<br />Fibre Channel Switch<br />Lun 0<br />Lun 1<br />Lun 2<br />SAN Storage<br />5/24/2010<br />46<br />
    60. 60. vRanger Pro Architecture for LAN free backups<br />vRanger<br />Server <br />ESX<br />Host<br />ESX<br />Host<br />Fibre Channel Switch<br />Lun 0<br />Lun 1<br />Lun 2<br />SAN Storage<br />5/24/2010<br />47<br />
    61. 61. vRanger Pro Architecture for LAN free backups<br />iSCSI Switch(s)<br />vRanger<br />Server <br />ESX<br />Host<br />ESX<br />Host<br />The storage is presented to both the ESX hosts and the vRanger Pro server.<br />Lun 1<br />Lun 2<br />Lun 0<br />SAN Storage<br />5/24/2010<br />48<br />
    62. 62. vRanger Pro Architecture for LAN free backups<br />Read Only Access<br />FC / iSCSI Switch(s)<br />ESX<br />Host<br />ESX<br />Host<br />vRanger <br />Server <br />The storage is presented to both the ESX hosts and the vRanger server.<br />Lun 1<br />Lun 2<br />Lun 0<br />SAN Storage<br />5/24/2010<br />49<br />
    63. 63. vRanger Pro Architecture for LAN free backups using a FC SAN<br />Prod Network – to vCenter<br />To Backup Repository<br />Shared Storage (VMs)<br />vRanger Pro (Proxy)<br />Nic0<br />HBA2<br />HBA1<br />Lun 10<br />Lun 12<br />Lun 11<br />SAN Storage<br />Lun 0<br />Lun 1<br />Lun 2<br />SAN Storage<br />5/24/2010<br />50<br />
    64. 64. vRanger Pro Architecture for LAN free backups using an iSCSI SAN<br />Shared Storage (VMs)<br />Prod Network – to vCenter<br />To Backup Repository<br />vRanger Pro <br />(Proxy)<br />Nic0<br />Nic1<br />Nic2<br />Lun 0<br />Lun 1<br />Lun 10<br />Lun 12<br />Lun 11<br />Lun 2<br />SAN Storage<br />SAN Storage<br />5/24/2010<br />51<br />
    65. 65. vRanger Pro Architecture for LAN free backups using an iSCSI SAN (2)<br />Shared Storage (VMs)<br />Prod Network – to vCenter<br />To Backup Repository Device A<br /> Nic0<br /> Nic1<br />Nic2<br />Nic3<br />Nic5<br />Nic4<br />vRanger Pro (Proxy)<br />To Backup Repository Device B<br />5/24/2010<br />52<br />
    66. 66. Data Flows with LAN freebackups<br />Prod Network – to vCenter<br />Nic 0<br />Shared Storage (VMs)<br />Reads<br />Reads<br />Reads<br />vRanger Pro (Proxy)<br />To Backup Repository<br />Lun 0<br />Lun 10<br />Lun 12<br />Lun 11<br />Lun 1<br />Lun 2<br />SAN Storage<br />SAN Storage<br />5/24/2010<br />53<br />
    67. 67. Data Flows with LAN free Backups<br />Prod Network – to vCenter<br />Nic 0<br />Shared Storage (VMs)<br />Reads<br />Reads<br />Reads<br />vRanger Pro<br /> (Proxy)<br />To Backup Repository<br />Lun 0<br />Lun 10<br />Lun 12<br />Lun 11<br />Lun 1<br />Lun 2<br />SAN Storage<br />SAN Storage<br />5/24/2010<br />54<br />
    68. 68. Data Flows with LAN FREE Backups<br />Prod Network – to vCenter<br />Nic0<br />Shared Storage (VMs)<br />Reads<br />Reads<br />Reads<br />Writes<br />Writes<br />Writes<br />vRanger Pro<br /> (Proxy)<br />Read Connection<br />Lun 0<br />Lun 10<br />Backup Repository<br />Lun 12<br />Lun 11<br />Lun 1<br />Lun 2<br />Write Connection<br />SAN Storage<br />SAN Storage<br />5/24/2010<br />55<br />
    69. 69. Other topics<br />Additional Information<br />5/24/2010<br />56<br />
    70. 70. Custom Backup Groups<br />Goal: more flexibility for backup jobs<br />Groups disparate VMs, hosts, folders<br />Separate structure from Virtual Center<br />Accessible in “My Inventory” view<br />
    71. 71. Thin Disk Support: Details<br />vSphere-only feature<br />ESX4 to ESX3 restoration isn’t supported<br />GUI indicates if a disk is ‘Flat’ or ‘Thin’.<br />Support for backup and restore<br />Only blocks w/ data are restored<br />
    72. 72. Encrypted Repositories<br />What it is<br />All save point in the repository is encrypted.<br />Password is specified as part of the repository configuration. All save point in the repository will have the same password.<br />Benefit<br />Save point cannot be restored by unauthorized entities (i.e. those without the password)<br />AES 256 Encryption<br />No “backdoors”<br />
    73. 73. Are Their Disks That Can’t Be Backed-Up?<br />Independent, persistent disks<br />Physical RDM<br />Cannot create snapshots for these disks.<br />They are automatically skipped and do not cause a job failure<br />w/ the caveat that the VM has at least one, snap-shotable disk available to vR<br />5/24/2010<br />60<br />
    74. 74. Supported environments<br />The Fine Print<br />5/24/2010<br />61<br />
    75. 75. vRanger Supported Environments<br />5/24/2010<br />62<br />
    76. 76. screenshots<br />vRanger Pro 4<br />5/24/2010<br />63<br />
    77. 77. Backup Process<br />5/24/2010<br />64<br />
    78. 78. Job Status Monitor<br />5/24/2010<br />65<br />
    79. 79. Restore Process<br />5/24/2010<br />66<br />
    80. 80. Instant File Level Restore<br />5/24/2010<br />67<br />
    81. 81. Configuration Options<br />5/24/2010<br />68<br />

    ×