Transforming Backup and Recovery in VMware environments with EMC Avamar and Data Protection Advisor

1© Copyright 2012 EMC Corporation. All rights reserved.
TRANSFORMING
BACKUP AND
RECOVERY
EMC BRS Division

0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
2010 2011 2012 2013 2014 2015
Data Protection and
Recovery Software
Purpose Built
Backup Applicances
Tape Automation
Backup Appliances Disrupt Market
 Tape Marginalized
 Storage, Software
– Functionality Peers
– Software Within
Storage
 End-to-end Designs
Will Dominate
Source: IDC, Worldwide Tape Automation 2011–2015 Forecast Update
and 2010 Vendor Shares, Doc # 228692, June 2011
IDC, Worldwide Purpose-Built Backup Appliance 2011–2015 Forecast
Update: Explosive Growth in 2011, Doc # 232070, December 2011
IDC, Worldwide Data Protection and Recovery Software 2011–2015
Forecast, Doc # 229395, July 2011
CAGR:
- 1.0%
CAGR:
25.6%
CAGR:
6.2%
$7.2B $12.2B

Market Leadership
Source: IDC, Worldwide Purpose-Built Backup Appliance 2012–2016 Forecast and 2011 Vendor Shares , Doc
#234489 , Apr 2012,
IDC, Worldwide Storage Software Qview, March 2012
$Millions
0
500
1000
1500
2000
2500
Data Protection &
Recovery Software
Purpose-built Backup
Appliances

Tape Challenges
Unreliability of Tape Device/Tape
Library
Physical movement of tape from
Production site to DR site
Tape media format compatibility issue
when upgrading tape drive
Long backup window and Maintenance
of a backup SAN

Next
Generation
Backup
Traditional
Backup Tape.
Disk.
(Deduplication)

Deduplication is Accelerating the Transition
More Efficient
Reduced Storage
Less Bandwidth

Second Friday Full Backup
B C D E F L G H
Data Deduplication: Technology
Overview
Store more backups in a smaller footprint
A B C D E F G H I J
Friday Full Backup
A B C D A E F G
Mon Incremental A B H
Tues Incremental C B I
Thurs Incremental A C K
Weds Incremental E G J
Backup Estimated
Data Logical Reduction Physical
Monday Incremental 50 GB 7–10x 5 GB
Tuesday Incremental 50 GB 7–10x 5 GB
K L
Wednesday Incremental 50 GB 7–10x 5 GB
Thursday Incremental 50 GB 7–10x 5 GB
Second FRIDAY FULL 1 TB 50–60x 18 GB
TOTAL 2.2 TB 7.6x 288 GB
FRIDAY FULL 1 TB 2–4x 250 GB

Retain: Store More for Longer with Less
Over one year of retention in 3U of Data Domain deduplication
storage
Week 1
Backup Cumulative Estimated Physical
Data Logical Reduction
April 14 3.4 TB 10x 326 GB
April 21 4.6 TB 13x 364 GB
April 28 5.8 TB 14x 402 GB
May 31 10.6 TB 19x 554 GB
June 30 15.4 TB 21x 706 GB
TOTAL 15.4 TB 21x 706 GB
April 7 2.2 TB 8x 288 GB
Week 2
Week 3
Month 1
Month 2
Month 3
First Full 1 TB 4x 250 GB

Deduplication Dramatically Reduces
Storage Capacity Requirements
Deduplication
10–30 times less data stored versus fulls + incrementals with typical retention policies
0
10
20
30
1 5 10 15 20
Weeks in Use
DataStored
Deduplication storage
Traditional storage

Deduplication Changed Everything
Reduce:
• Backup Windows By Up To 90%
• Data Stored By Up To 30x
• Data Moved By Up To 95%
• CPU Usage By Up To 80%
• Replication Bandwidth By Up To
99%

EMC DATA
DOMAIN
OVERVIEW

Disaster Recovery
WAN
1–5%
Direct Backup
EMC
Symantec
CommVault
CA
HP
Vizioncore
Backup Applications
IBM
Atempo
BakBone
FC
Data Domain Overview
Unified Infrastructure for Backup, Archive & Disaster Recovery
IBM-i
FC
Archive/Share Drive
EMC
F5 Networks
Symantec
CommVault
Archive Applications
Primary
storage
Mainframe
VMware
Microsoft
Microsoft SharePoint
Oracle
SAP
NAS, SAN, DAS
IP (NFS/CIFS)/Boost

DD Boost Software
 Distributes parts of deduplication process to
backup server or application clients
 Speeds backups by up to 50 percent
 Enables more efficient resource utilization
 Provides application control of Data Domain
replication process
 Supports majority of backup software market
and native utilities in industry leading
databases
DD
Boost

Application
Client
Backup
Server
Data Domain Boost Ecosystem
Backup
Exec
NetBackupNetWorkerAvamar
Oracle
RMAN
vRanger
Pro
NetVault
Backup
DD Boost DD Boost
DD BoostDD Boost DD Boost
DD Boost
DD Boost
DD Boost
DD Boost
DD Boost
DD Boost Supported over Ethernet
or Fibre Channel
DD Boost Supported over Ethernet
Greenplum
DD Boost

Network-Efficient Replication
for True Disaster Recovery
Lowers WAN costs; improves service level agreements
95–99% cross-site bandwidth reduction
Source:
Remote sites
Destination:
Data Center Hub
Supports hundreds
of remote sites
1–5%
1–5%
1–5%
Archive data
Backup data
Data Domain
DD890
Data Domain system
Flexible replication
 One-to-many
 Many-to-one
 Bi-directional
 System-to-
system
 Cascaded
Home
DB
WAN
Home
Data Domain system
Data Domain system

Enterprise Recoverability Readiness
at Disaster Recovery Site
Tape/truck
Backup to Tape
Truck to storage Truck from storage
Recall tapes Start
Restoration
VTL/tape/truck
Backup to VTL
Copy to tape
Truck to storage Truck from storage
Recall tapes
Start
Restoration
Data Domain
inline
deduplicated
replication
Disaster recovery
(DR)-ready
Replicate during backup
Better Business Recovery SLA
Two copies of backup data
Start
Restoration at
DR

Methodology:
Inline vs. Post-Process Deduplication
POST-PROCESS
Deduplication After Storing
 The more processes, the more resource
contention
− Copy to tape: Too slow to stream tape
− Recovery: Service level agreement
predictability
− Replication: Poor time-to-disaster-recovery
− Deduplication: If interleaved with backup or
restore
 More administration to fight these issues
DeduplicationStore
3x disk accesses
to shared store
 Other activities unimpeded
− Predictable
− Simpler
INLINE
Deduplication Before Storing
Deduplication

Performance:
CPU-Centric vs. Spindle-Bound
ThroughputMB/s
50
6,000
Number of Disk Spindles
50 100 150 200
Data Domain
Fibre Channel
SATA
Most
deduplication
vendors
Improvement since 2004:
Throughput: ~200x
Capacity: ~450x

Data Integrity:
Data Invulnerability Architecture
Other
RAID 6
NVRAM
Snapshots
End-to-end data verification
Checksum
Deduplication, write to disk
Verify
Self-healing file system
Cleaning
Expired data
Defrag
Verify
Deduplication
Local Compression
RAID
File System
Generate
Checksum
Verify
Data
Verify the file
system metadata
integrity
Verify user data
integrity
Verify stripe
integrity
End-to-end data verification

Industry’s Most Scalable Inline
Deduplication Systems
DD160 DD620 DD640 DD670 DD860 DD890 DD990
Speed (DD Boost) 1.1 TB/hr 2.4 TB/hr 3.4 TB/hr 5.4 TB/hr 9.8 TB/hr 14.7 TB/hr 31.0 TB/hr
Speed (other) 667 GB/hr 1.1 TB/hr 2.3 TB/hr 3.6 TB/hr 5.1 TB/hr 8.1 TB/hr 15.0 TB/hr
Logical capacity 40–195 TB 83–415 TB 0.32–1.6 PB 0.6–2.7 PB
1.4–7.1 PB
5.7–28.5 PB1 2.9–14.2 PB
5.7–28.5 PB
13– 65 PB1
Usable capacity Up to 3.98 TB Up to 8.3 TB Up to 32.2 TB Up to 55.9 TB
Up to 142 TB
Up to 570 TB1 Up to 285 TB
Up to 570 TB
Up to 1.3 PB1
• DD Boost
• DD Encryption
• DD Extended Retention
Small
Enter./
ROBO
Midsize Enterprise
Large Enterprise• DD Replicator
• DD Retention Lock
• DD Virtual Tape Library
1 With DD Extended Retention software option
Data Domain Software Options

Data Domain Replicator
• Network-efficient and
encrypted
• Consolidate up to 270 remote
sites into a single system
Additional Data Domain Software
Options
Data Domain Virtual Tape
Library
• Easily integrates with Fibre
Channel
• Supports open systems and
IBM i operating environments
Data Domain Encryption
• Inline encryption of data at
rest
• Protects against theft or loss
of a physical system
Data Domain Retention Lock
• Secure data retention for file
and email archive data
• Satisfies internal governance
and compliance regulations
Data Domain Extended
Retention
• Long-term retention of
backup data
• Up to 65 PB logical capacity

With Data Domain Deduplication Storage
Systems, You Can…
Retain longer
Keep backups onsite longer with less
disk for fast, reliable restores, and
eliminate the use of tape for
operational recovery
Replicate smarter
Move only deduplicated data over
existing networks with up to 99%
bandwidth efficiency for cost-effective
disaster recovery
Recover reliably
Continuous fault detection and self-
healing ensure data recoverability to
meet service level agreements
WAN

Why Data Domain?
Less disk to resource, less to
manage
• CPU-centric deduplication
• Inline deduplication
Simple, mature, and flexible
• Simple, mature appliance
• Any fabric, any software, backup or
archive applications
Resilience and disaster recovery
• Storage of last resort
• Fast time-to-disaster recovery (DR)
readiness
• Cross-site global compression
– Data center or remote office

EMC NETWORKER
Unified backup and recovery software

EMC Continues to Evolve Backup
Software and storage designed to work together
Improves…
– Performance: Up to 50%
faster than traditional
solutions
– Simplicity: One user
interface—common policy
management
– Predictability: Proven best
practices—over 20,000
installations
INTEGRATED
ARCHITECTURE
Protection
storage
Backup software

NetWorker with Data Domain
 Use with existing, disk-based
or virtual tape library (VTL)
capabilities
 Use with Data Domain Boost
– Improved performance
– Clone-controlled replication
– Automated configuration
– Monitoring and reporting
 Optimized for tape reduction
and replication, application
backup challenges
Primary
data center
Remote site
Data Domain
File systems and applications
NetWorker
WAN
REPLICATION

Benefits of Data Domain Boost
 Deduplication distributed to:
– Backup servers
– Application clients
– NetWorker clients
 Increases backup speed
 Reduces network traffic
 Clone-controlled replication
– Schedules replication
– Catalog awareness of replicated
copies
 Ease of use
– Automated configuration
– Monitoring and reporting
NetWorker Data Domain
DD Boost DD Boost

Capacity Licensing Option
 License source capacity
protected in terabytes
 Benefits
– Dramatically simplifies license
management and maintenance
renewals
– Cost-effective when deploying
advanced backup options
– Reduce license keys/enablers
and a single metric to track
– Easy, unlimited deployment of
most features, modules, and
options

EMC AVAMAR
Deduplication backup software
and system

What is Virtualization?
Consolidation, simplicity, agility, lower costs
ESX Server
. . .
VM1 VM2 VM3 VM n
Virtualization Layer
Hardware Layer
Physical Server Physical Server Physical Server
Traditional Data Center
• Setup Physical Server: 1 to 2
weeks
– Procurement
– Setup per machine
• Install OS
• Install Security
• Install Applications
• Networking configuration
• Etc …
Virtualized Data Center
• Setup a Virtual Machine in only 10
minutes
– 1 ESX Server can simulate up
to 20 Physical Servers or
more
• Consolidation 10:1 up to 20:1

VMware Terminology
 vSphere: VMware Operating System = Virtualization Layer
 vCenter: VMware management tool
 vStorage API for Data Protection (vADP): Application
programming interface enabling software vendors to connect to
VMware infrastructure and utilities
 Virtual Machine (VM): Your compute resource hosting your
application(s)
 ESX server: Physical server that hosts virtual machines

The VMware Backup “Must Have” List
 Must address today’s issues
– Relieve resource contention
– Contain backup storage growth
– Enable more-effective disaster recovery
 Business-critical applications
– Application consistency
– Granular recovery
 Must integrate with VMware infrastructure
– VMware vStorage API for Data Protection
– VMware vCenter Server

EMC Avamar
 Reduces backup time and network load
– Client-side deduplication
 Daily full backups and one-step recovery
 Optimized for physical and virtual
environments
 High availability and reliability
 Lowers costs and risks
 Integrated with EMC Data Domain
Deduplication backup software and system
Avamar
VM

Network
B
A
C C
D
D
B
A
B
A
C
B
A C
B
C
D
DA
B
A
B
A
C
D
Deduplication Is the Enabler
Move and store less data
1. Divides data into variable-length sub-file
segments
2. Determines if segments are unique or duplicate
3. Backs up only unique data
4. Sends data compressed and encrypted

Verified
checkpoint
Utility node
Spare node
Parity across
storage nodes
Recover Reliably
High availability and data integrity
• Redundant Array of Independent
Nodes (RAIN) architecture
• Grid architecture for online
scalability and performance
• Daily Avamar server integrity and
data recoverability checks
• RAID protection from disk failures
• Up to 124 TB of deduplication
backup capacity
• Includes replication for disaster
recovery
Virtualization

Real-World Results
Avamar daily full backups vs. traditional daily fulls
Data Type
Amount of Primary
Data Backed Up
Amount of Data
Moved Daily
Windows file systems 3,573 GB 6.1 GB
Mix of Windows, Linux, and UNIX file systems 5,097 GB 11.7 GB
Engineering files on NAS (NDMP backups) 3,265 GB 24.2 GB
Mix of 20% databases, 80% file systems (Windows and UNIX) 9,583 GB 80.0 GB
Mix of Linux file systems and databases 7,831 GB 104.2 GB
Source: EMC
While results will vary by data type and mix, Avamar can
dramatically improve backup performance and efficiency

Recover in One Step
 Every backup is a “full” backup
 Restore single files or full directories directly to the client
1

Avamar for VMware
Optimized for VMware Backup and Recovery
 Application consistency
– Guest-level backup
 Faster Image-Level backup
– Changed Block Tracking for faster backups
– Universal proxy with load balancing
 Bare-Metal (VMDK) image-level restore
– Integrated with VMware vStorage API for Data Protection
 One-step recovery
– Changed Block Tracking for faster restores
– Agentless file-level recovery for Windows and Linux
 Streamlined management with vCenter

Avamar for VMware Image-Level Backup
• Leverage Changed Block Tracking to
reduce backup & restore processing
• Provides single-step image-level
backups & restores
• Restore to the original VM or new VM
• Load balancing for superior
throughput
• How it works
• Proxy server hosted on a VM
• Avamar agent resides on the proxy VM
• Leveraging SCSI Hot Add
• VMDK files are mounted to the
proxy – no data movement required
• De-duplicates within and across VMDKs
vStorage API
virtual proxy
server with
Avamar agent
Avamar client software runs
on the proxy server
Resource
Pool
VMware Virtualization Layer
x86 Architecture
Physical server
Virtual Machines
Avamar
server
Mount
= Avamar Software Agent
VMware Image Backup

ESX SERVER NESX SERVER 1
Proxy Server Load Balancing
Proxy VM
A B C E FD
= Data
VMware ESX Server Cluster
Proxy VM
VMware
vCenter
Server
Avamar
Data Store
. . .
• How it works
– Avamar automatically
assigns VM backup
jobs to available proxy
servers using a round
robin protocol
– Backups are distributed
evenly across available
proxy servers
• Automatic and transparent
• Simplifies the management of
virtual proxy servers
• Decreases management cost of
vStorage API infrastructure
• Faster backups

CBT Blocks
Faster Restores for VMDK
VM
Image
Proxy
LAN-free
LAN-free
LAN/WAN
LAN/WAN
LAN/WANLAN-free
CBT Blocks
CHANGED BLOCK TRACKING (CBT) BACKUP
STANDARD RESTORE
CBT RESTORE
VM
Image
Proxy
VM
Image
Proxy
Unique Blocks
Whole VMWhole VM
CBT Blocks
• Changed block
backup
– Minimizes backup
times
• Changed block
restore
– Transfer delta blocks
between backup set
and virtual machine
– Accelerates image
restores

Avamar Backup for VMware Guest
• How it works
– Avamar agent resides in each VM
– De-duplicates data within the VM
– Moves only changed blocks
• Reduces resource contention
• Shortens backup windows
– Provides file-level restore
• Windows, Linux, and Solaris
Resource
Pool
VMware Virtualization Layer
x86 Architecture
= Avamar Software Agent • Best for Application Data
• Tier 1 Application Consistency
• SQL, Exchange, Oracle
• Highest level of deduplication
• No Cost Agents

Integration with VMware vCenter Server
• Manage data protection and
contain virtual machine sprawl
• Browse to VMware vCenter
Server through the Avamar GUI
• Auto-discover virtual machines
and their associated groups
• Monitor backup/restore
operations in the Activity Monitor
• View VM protection status
(guest/image/none)
Single point of management for VMware backup options

Flexible Deployment Options
Avamar Data Store options meet your needs
Avamar Data Store
Single Node
Avamar Data Store
Scalable RAIN Grids
Enterprise Environments
Avamar Virtual Edition
Virtual Appliance
VMware Environments
Avamar “Business Edition”
Mid-Market Environments
AVE
• Scalable nodes
• RAIN and high availability
• Up to 124 TB
• Sized for distributed office workloads
• Centralize via replication (required)
• Fast backup, one-step, local recovery
• Single node, sized for small data centers
• Optional replication for DR/centralization
• Lowest $/TB Avamar solution
• Avamar server, in a virtual machine
• Guest and (VADP) image backups
• Fast, changed-block recovery
Remote Offices

EMC – VMware Partnership
 VMware as a customer of EMC
– Backup 50TB of data across all its 100+ physical and
virtual servers.
– Reduce their backup window from 1 week to 11 hours.
– Reducing their backup network traffic by 99%.
 VMware as a partner of EMC
– vSphere Data Protection (VDP) is vSphere’s next-
generation data protection product that replaces VMware
Data Recovery (VDR).
– VDP is a VMware product, powered by EMC technology.

vSphere Data Protection (VDP)
 Definition
– Deduplication Backup and Recovery Software
and Virtual Appliance powered by EMC
Avamar
– New GUI built on vSphere Web Client
– Full image backup/recovery
– Self service file-level restore
 Introductory product for small business
market segment
 Availability
– Bundled with vSphere 5.1 (Aug 2012)
– Distributed by VMware and their partners

VDP Advanced
 Capabilities
– Deduplication Backup and Recovery Software and
Virtual Appliance powered by EMC Avamar
– GUI built on vSphere Web Client
– Full image backup/recovery
– Self service file-level restore
– Dynamically expand capacity up to 8TB
– Microsoft SQL Server Agent
▪ Entire DB or individual databases
▪ Full, Differential, Incremental
▪ Multi-streaming
– Microsoft Exchange Agent
▪ Exchange Server or individual DBs
▪ Full, Incremental
▪ Multi-streaming
SOLD BY VMWARE
& VMWARE PARTNERS

Comparison VDP VDP Advanced
Price (license only)
Per CPU socket
Included with
vSphere ESS+ and above
$1,095
Scalability
Max deduplicated storage per appliance 2TB (~ 50 VMs) 8TB (~ 200 VMs)
Max appliances per vCenter instance 10 10
Features
Agent-less backup
Variable-length deduplication
CBT for backup and restore
vSphere Web Client management
Self-service backup and recovery
Full VM and File-level recovery
Integrity check and rollback mechanism
Dynamic provisioning 2TB8TB
MSFT Exchange Server agents
MSFT SQL Server agents
Migration from VDP

VDP vs Avamar
 VDP
– Markets: SMB
– Max # VMs: 100
– Storage Pool: up to 2TB
– Replication: None
– Image-Level backup only
– Dynamically expand
capacity up to 8TB
– Microsoft SQL Server Agent
– Microsoft Exchange Agent
 Avamar
– Markets: Mid thru Enterprise
– Max # VMs: Unlimited
– Storage Pool: up to 124TB
– Replication: Included
– Image-Level backup
– Guest-Level backup
– Extensive application support
– Physical & Virtual backup
– NAS/NDMP support
– Desktop/Laptop backup
– Data Domain integration
– Extended retention to VTL/tape
– Enterprise management

Microsoft Hyper-V Protection
 Guest-level backup and recovery
– Provides application consistency
 Image backup and recovery
– Complete protection of virtual machines (VMs)
– Federated Hyper-V Cluster Shared Volumes backup and
recovery
– Recover VMs to alternate Hyper-V servers
– Granular Level Recovery (GLR) for faster restores

Avamar for NAS
 Avamar NDMP Accelerator requests only modified data daily
(level 1 dumps)
 Fast daily full backups and data are deduplicated at the
NDMP Accelerator
 Avamar NDMP backups are ready for immediate recovery
NAS device
(EMC VNX family,
EMC Celerra, or NetApp)
LAN LAN/WAN
Avamar NDMP
Accelerator
Avamar
Data Store

avtar
Avamar Accelerator
Chunk Files
Compute Hash
Compress
Data Deduplication
1 TB
10% change/day
NDMP Data Stream
100 GB
3–10 GB
How Avamar NDMP Data Reduction
Works
Avamar
Data Store
NAS system
60 GB

Avamar for Remote Offices
Leverage existing WAN bandwidth
• Large remote offices with strict
SLAs for recovery may choose to
deploy the Avamar Single Node
or AVE
• Small remote offices simply need
to deploy the Avamar agents on
the servers (clients)
Direct to Avamar Data Store
in the Data Center
SMALL REMOTE OFFICE
Direct to Local Single Node or AVE
Replicate to Main Data Store
LARGE REMOTE OFFICE

• Convenient, nondisruptive
backups
• End-user self-service recovery
• Document-level search engine
• Multi-language support
• Cross-platform restore
• No “per-client” fees
Avamar for Desktop/Laptop Backup
End-user-initiated
restore
Windows or Mac OS X
Avamar
Data Store
.
.
.

Purpose Built Backup Appliances
Open Systems + Mainframe Revenue
EMC
IBM
Symantec
Others
HP
Quantum
EMC
64.9%
2012 Total Market
$2.75B
Source: IDC Worldwide Quarterly Purpose Built Backup Appliance Tracker – Q42012

Purpose Built Backup Appliances
Open Systems + Mainframe Capacity
EMC
Others
Symantec
IBM
HP
Quantum
EMC
64.9%
2012 Total Market
1,340PB
Source: IDC Worldwide Quarterly Purpose Built Backup Appliance Tracker – Q42012

WORLDWIDE
INDUSTRY
BACKUP LEADERSHIP
9 Of The Top 10 Telecoms
9 Of The Top 10 Airlines
8 Of The Top 10 Hospitals
10 Of The Top 10 Banks

OVER
1000
CUSTOMERS
HAVE GONE
TAPELESS
FOR BACKUP

Where To Start
MainframeIBM i
Remote OfficeVMware Desktop Laptop NAS
Database
Medical ImageFile & E-mail Next Gen AppsBaaS, StaaS
ArchiveLong Term
Backup Retention
Archive
Cloud
Backup

Transforming Backup and Recovery in VMware environments with EMC Avamar and Data Protection Advisor

Transforming Backup and Recovery in VMware environments with EMC Avamar and Data Protection Advisor

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Transforming Backup and Recovery in VMware environments with EMC Avamar and Data Protection Advisor

Similar to Transforming Backup and Recovery in VMware environments with EMC Avamar and Data Protection Advisor (20)

More from CTI Group

More from CTI Group (12)

Recently uploaded

Recently uploaded (20)

Transforming Backup and Recovery in VMware environments with EMC Avamar and Data Protection Advisor