SlideShare a Scribd company logo
1 of 29
Backing up Zarafa Collaboration Platform
with Veeam SureBackup

Joep Piscaer, VMware vExpert, VCDX #101
   j.piscaer@virtuallifestyle.nl
   @jpiscaer
Agenda
 Introduction
 What is backup application consistency
  and why is it so important?
 Evaluating Zarafa ZCP components
  and relevance to application consistency
 What options to backup Zarafa ZCP are available
  within Veeam Backup & Replication?
 Integrating application consistency into SureBackup
 Demo
Agenda
 Introduction
 What is backup application consistency
  and why is it so important?
 Evaluating Zarafa ZCP components
  and relevance to application consistency
 What options to backup Zarafa ZCP are available
  within Veeam Backup & Replication?
 Integrating application consistency into SureBackup
 Demo
Introduction
 Joep Piscaer
   ● Consulting Architect at OGD ict-diensten
   ● VMware VCDX5 #101, vExpert 2009, 2011, 2012
   ● Know Veeam since 2007 and in love with them ever since
     (best. VMworld. parties. ever.)
Past Projects
 Past implementations of Veeam B&R
   ● Commonly see a VMware virtualization layer with Windows VMs on top
   ● But my own company uses Linux-based applications internally



 Notable projects include
   ● Bi-directional DR for 200-250 VMs with 2 infrastructures
   ● 150+ VM backup and replication within a single large datacenter
   ● Application consistent backups of Zarafa Collaboration Platform without
     bringing database down (or any other downtime)
   ● Numerous smaller projects for DR or backup at customer sites
Agenda
 Introduction
 What is backup application consistency
  and why is it so important?
 Evaluating Zarafa ZCP components
  and relevance to application consistency
 What options to backup Zarafa ZCP are available
  within Veeam Backup & Replication?
 Integrating application consistency into SureBackup
 Demo
Consistency states
 Crash consistency
   “A crash consistent state does not have any quiescing and is
   equivalent to a VM being powered off without being properly
   shutdown.”

 Filesystem consistency
   “A file system consistent state is better because the operating system
   is in a proper state to be backed up.”

 Application consistency
  “Finally, the best state is application consistent where applications
   have also been properly prepared for backup.”
Why is application consistency important?
 A consistent application (or transactional) state is
  important, because:


 It will prevent data loss or data corruption
 It will improve RTO significantly for large data sets
How to force consistency?
 Quiescing the VM, filesystem and/or application:
  Pause VM and write all the transactional data
  in memory to disk
 Forces the state of the disk image to be
  consistent, preventing data corruption or lengthy crash
  recovery checks on filesystems and databases
Agenda
 Introduction
 What is backup application consistency
  and why is it so important?
 Evaluating Zarafa ZCP components
  and relevance to application consistency
 What options to backup Zarafa ZCP are available
  within Veeam Backup & Replication?
 Integrating application consistency into SureBackup
 Demo
Zarafa components
 Zarafa application components
   ● Core applications, WebAccess / WebApp, Z-Admin, postfix, Z-
     Push, spamassassin, clamav, amavis, etc

 MySQL database for metadata
  and a file based content system
 Authentication directory
 DNS
Backing up Zarafa – What’s the big deal?
 The application components or dependencies
  are not the actual issue
  We can rely on file system journal to recover data from
  these application components
 But the MySQL database is
  It needs to be application-consistent instead of crash or
  filesystem consistent
Agenda
 Introduction
 What is backup application consistency
  and why is it so important?
 Evaluating Zarafa ZCP components
  and relevance to application consistency
 What options to backup Zarafa ZCP are available
  within Veeam Backup & Replication?
 Integrating application consistency into SureBackup
 Demo
Hot Backup of MySQL on a Linux VM
 Two options to produce a transaction consistent backup of
  MySQL databases:
   ● Option 1 stops the database and
     application; all caches are lost
     and need to be rebuilt; too big
     a performance hit and impacts
     service availability

   ● Options 2 produces a full copy
     of the database, which is not
     storage-friendly, and takes a
     considerable amount of time.
     Restore requires additional steps.
Hot Backup of MySQL on a Linux VM
 Both options are not viable in our environment.
 We can‟t stop the database or application for each backup:
   ● For service availability reasons

   ● Because the built-up caches for database and applications would be
     lost, severely impacting application performance.

 We cannot create a dump of the database:
   ● It would take too long with a big impact on storage (IOps and capacity)

   ● Restoring data from the dump requires additional steps
Hot Backup of MySQL on a Linux VM
 We came up with a 3rd option:
 Option 3. Lock database tables and flush to disk.
  No downtime or service availability impact
  No need to rebuild cache or create an entire copy of the
  database.
 Flushes all open tables in the database to disk while
  preventing any changes to databases
Hot Backup of MySQL on a Linux VM
 One problem though:
  “Script can‟t quit the mysql shell else you will lose the lock”
 This does not play nice with pre-freeze and
  post-thaw scripts; since the pre-freeze script
  quits and loses the lock…
 Jelmer Jaarsma to the rescue!
  My colleague found
  a work-around
pre-freeze-script.sh
 Create two temporary lock files and launch background
  script. Pre-freeze script will run until database is locked.
 Background script will flush tables to disk and write-lock
  database. Finally, it removes a temporary lock file.
  This signals the pre-freeze script that the database is
  ready for snapshotting; the script terminates without error
 With the pre-freeze script terminated, Veeam will now
  create the snapshot (with the database locked)
post-thaw-script.sh
 During the snapshot creation, the background script is still
  running, keeping the database locked.
post-thaw-script.sh
 After the snapshot has been successfully created, the
  post-thaw script removes the 2nd temporary lock file. This
  will shut down the background script, unlocking the
  database and continuing normal database operation
 No downtime; just a couple of seconds database
  query queue
Veeam backup job settings
 There‟s no specific settings
  inside the job


 Enable VMware Tools quiescence
 No „post job activity‟ in the
  backup jobs settings
 No application-aware
  image processing (VSS)
Agenda
 Introduction
 What is backup application consistency
  and why is it so important?
 Evaluating Zarafa ZCP components
  and relevance to application consistency
 What options to backup Zarafa ZCP are available
  within Veeam Backup & Replication?
 Integrating application consistency into SureBackup
 Demo
Backup and recovery verification
 Transactionally consistent backups need to be verified
  periodically to meet RPO and other SLA goals
 Testing a restore manually is a painfully long and hard
  process; it should include tests on all layers
  (VM, filesystem, application)
 The only real verification is to bring the VM back online in a
  safe and isolated environment
 Can be used to restore granular application items, too
Integrate Zarafa into SureBackup
 Add a new role to SureBackup using ZarafaServer.xml
  http://forums.veeam.com/viewtopic.php?f=24&t=15103&p=69768

 Create a Virtual Lab
 Create appropriate application groups
  (including any dependencies like LDAP, DNS)
  and select both „mail server‟ and „zarafa server‟ boxes
Restoring Zarafa
 It‟s Linux; please prepare your VM‟s NIC settings
  accordingly
  static MAC address or retain IP after MAC changes
 Full VM recovery does not need any manual steps
   ● the database is in a consistent state (no crash recovery)
     and ready to go (no need to restore from a dump file)
Restoring Zarafa
 Single Object Restore / Single Mail Restore
  http://forums.veeam.com/viewtopic.php?f=24&t=15103&p=69768

   ● Add server to Managed Servers for File Copy
     Advanced - Preferred TCP Connection Role - "Run Server on this side“

   ● Use U-AIR to boot up VM

   ● Extract an User:
     /usr/bin/zarafa-backup -a -v -u max -o /var/backup/

   ● Use Veeam File Copy to restore files to production

   ● Restore User
     /usr/share/zarafa-backup/full-restore.sh max
Agenda
 Introduction
 What is backup application consistency
  and why is it so important?
 Evaluating Zarafa ZCP components
  and relevance to application consistency
 What options to backup Zarafa ZCP are available
  within Veeam Backup & Replication?
 Integrating application consistency into SureBackup
 Demo
Live Demo
Q&A




      Joep Piscaer
      VMware vExpert, VCDX #101

      j.piscaer@virtuallifestyle.nl
      @jpiscaer



      Add Jelmer Jaarsma to LinkedIn:
      http://nl.linkedin.com/pub/jelmer-jaarsma/8/456/717

More Related Content

What's hot

VMworld 2014: Site Recovery Manager and Stretched Storage
VMworld 2014: Site Recovery Manager and Stretched StorageVMworld 2014: Site Recovery Manager and Stretched Storage
VMworld 2014: Site Recovery Manager and Stretched StorageVMworld
 
EVault Endpoint Protection
EVault Endpoint Protection EVault Endpoint Protection
EVault Endpoint Protection EVault
 
Veeam Webinar - Case study: building bi-directional DR
Veeam Webinar - Case study: building bi-directional DRVeeam Webinar - Case study: building bi-directional DR
Veeam Webinar - Case study: building bi-directional DRJoep Piscaer
 
VMware Site Recovery Manager
VMware Site Recovery ManagerVMware Site Recovery Manager
VMware Site Recovery ManagerJürgen Ambrosi
 
VMworld 2014: Site Recovery Manager and vSphere Replication
VMworld 2014: Site Recovery Manager and vSphere ReplicationVMworld 2014: Site Recovery Manager and vSphere Replication
VMworld 2014: Site Recovery Manager and vSphere ReplicationVMworld
 
SRM versus Stretched Clusters: Choosing the Right Solution
SRM versus Stretched Clusters: Choosing the Right SolutionSRM versus Stretched Clusters: Choosing the Right Solution
SRM versus Stretched Clusters: Choosing the Right SolutionScott Lowe
 
VMworld 2013: VMware Disaster Recovery Solution with Oracle Data Guard and Si...
VMworld 2013: VMware Disaster Recovery Solution with Oracle Data Guard and Si...VMworld 2013: VMware Disaster Recovery Solution with Oracle Data Guard and Si...
VMworld 2013: VMware Disaster Recovery Solution with Oracle Data Guard and Si...VMworld
 
vCenter Site Recovery Manager: Architecting a DR Solution
vCenter Site Recovery Manager: Architecting a DR SolutionvCenter Site Recovery Manager: Architecting a DR Solution
vCenter Site Recovery Manager: Architecting a DR SolutionRackspace
 
Availability Considerations for SQL Server
Availability Considerations for SQL ServerAvailability Considerations for SQL Server
Availability Considerations for SQL ServerBob Roudebush
 
Veeam back up and replication presentation
Veeam back up and replication presentation Veeam back up and replication presentation
Veeam back up and replication presentation BlueChipICT
 
Exploring Stretched Clusters
Exploring Stretched ClustersExploring Stretched Clusters
Exploring Stretched ClustersScott Lowe
 
Symantec ApplicationHA June 2011
Symantec ApplicationHA June 2011Symantec ApplicationHA June 2011
Symantec ApplicationHA June 2011Symantec
 
VMware Site Recovery Manager - Architecting a DR Solution - Best Practices
VMware Site Recovery Manager - Architecting a DR Solution - Best PracticesVMware Site Recovery Manager - Architecting a DR Solution - Best Practices
VMware Site Recovery Manager - Architecting a DR Solution - Best Practicesthephuck
 
Veeam Backup & Replication v8 for VMware — General Overview
Veeam Backup & Replication v8 for VMware — General OverviewVeeam Backup & Replication v8 for VMware — General Overview
Veeam Backup & Replication v8 for VMware — General OverviewVeeam Software
 
Veean Backup & Replication
Veean Backup & ReplicationVeean Backup & Replication
Veean Backup & ReplicationArnaud PAIN
 
VMworld 2013: Three Quirky Ways to Simplify DR with VMware Site Recovery Manager
VMworld 2013: Three Quirky Ways to Simplify DR with VMware Site Recovery ManagerVMworld 2013: Three Quirky Ways to Simplify DR with VMware Site Recovery Manager
VMworld 2013: Three Quirky Ways to Simplify DR with VMware Site Recovery ManagerVMworld
 
Oracle R12 EBS Performance Tuning
Oracle R12 EBS Performance TuningOracle R12 EBS Performance Tuning
Oracle R12 EBS Performance TuningScott Jenner
 
Improving Application Availability on Virtual Machines
Improving Application Availability on Virtual MachinesImproving Application Availability on Virtual Machines
Improving Application Availability on Virtual MachinesNeverfail Group
 
Implementing a Disaster Recovery Solution using VMware Site Recovery Manager ...
Implementing a Disaster Recovery Solution using VMware Site Recovery Manager ...Implementing a Disaster Recovery Solution using VMware Site Recovery Manager ...
Implementing a Disaster Recovery Solution using VMware Site Recovery Manager ...Paula Koziol
 
Veeam Presentation
Veeam PresentationVeeam Presentation
Veeam Presentationcvaleze
 

What's hot (20)

VMworld 2014: Site Recovery Manager and Stretched Storage
VMworld 2014: Site Recovery Manager and Stretched StorageVMworld 2014: Site Recovery Manager and Stretched Storage
VMworld 2014: Site Recovery Manager and Stretched Storage
 
EVault Endpoint Protection
EVault Endpoint Protection EVault Endpoint Protection
EVault Endpoint Protection
 
Veeam Webinar - Case study: building bi-directional DR
Veeam Webinar - Case study: building bi-directional DRVeeam Webinar - Case study: building bi-directional DR
Veeam Webinar - Case study: building bi-directional DR
 
VMware Site Recovery Manager
VMware Site Recovery ManagerVMware Site Recovery Manager
VMware Site Recovery Manager
 
VMworld 2014: Site Recovery Manager and vSphere Replication
VMworld 2014: Site Recovery Manager and vSphere ReplicationVMworld 2014: Site Recovery Manager and vSphere Replication
VMworld 2014: Site Recovery Manager and vSphere Replication
 
SRM versus Stretched Clusters: Choosing the Right Solution
SRM versus Stretched Clusters: Choosing the Right SolutionSRM versus Stretched Clusters: Choosing the Right Solution
SRM versus Stretched Clusters: Choosing the Right Solution
 
VMworld 2013: VMware Disaster Recovery Solution with Oracle Data Guard and Si...
VMworld 2013: VMware Disaster Recovery Solution with Oracle Data Guard and Si...VMworld 2013: VMware Disaster Recovery Solution with Oracle Data Guard and Si...
VMworld 2013: VMware Disaster Recovery Solution with Oracle Data Guard and Si...
 
vCenter Site Recovery Manager: Architecting a DR Solution
vCenter Site Recovery Manager: Architecting a DR SolutionvCenter Site Recovery Manager: Architecting a DR Solution
vCenter Site Recovery Manager: Architecting a DR Solution
 
Availability Considerations for SQL Server
Availability Considerations for SQL ServerAvailability Considerations for SQL Server
Availability Considerations for SQL Server
 
Veeam back up and replication presentation
Veeam back up and replication presentation Veeam back up and replication presentation
Veeam back up and replication presentation
 
Exploring Stretched Clusters
Exploring Stretched ClustersExploring Stretched Clusters
Exploring Stretched Clusters
 
Symantec ApplicationHA June 2011
Symantec ApplicationHA June 2011Symantec ApplicationHA June 2011
Symantec ApplicationHA June 2011
 
VMware Site Recovery Manager - Architecting a DR Solution - Best Practices
VMware Site Recovery Manager - Architecting a DR Solution - Best PracticesVMware Site Recovery Manager - Architecting a DR Solution - Best Practices
VMware Site Recovery Manager - Architecting a DR Solution - Best Practices
 
Veeam Backup & Replication v8 for VMware — General Overview
Veeam Backup & Replication v8 for VMware — General OverviewVeeam Backup & Replication v8 for VMware — General Overview
Veeam Backup & Replication v8 for VMware — General Overview
 
Veean Backup & Replication
Veean Backup & ReplicationVeean Backup & Replication
Veean Backup & Replication
 
VMworld 2013: Three Quirky Ways to Simplify DR with VMware Site Recovery Manager
VMworld 2013: Three Quirky Ways to Simplify DR with VMware Site Recovery ManagerVMworld 2013: Three Quirky Ways to Simplify DR with VMware Site Recovery Manager
VMworld 2013: Three Quirky Ways to Simplify DR with VMware Site Recovery Manager
 
Oracle R12 EBS Performance Tuning
Oracle R12 EBS Performance TuningOracle R12 EBS Performance Tuning
Oracle R12 EBS Performance Tuning
 
Improving Application Availability on Virtual Machines
Improving Application Availability on Virtual MachinesImproving Application Availability on Virtual Machines
Improving Application Availability on Virtual Machines
 
Implementing a Disaster Recovery Solution using VMware Site Recovery Manager ...
Implementing a Disaster Recovery Solution using VMware Site Recovery Manager ...Implementing a Disaster Recovery Solution using VMware Site Recovery Manager ...
Implementing a Disaster Recovery Solution using VMware Site Recovery Manager ...
 
Veeam Presentation
Veeam PresentationVeeam Presentation
Veeam Presentation
 

Similar to Veeam Webinar - Backing up Zarafa with SureBackup

HPE + Veeam Technical Hands ON Workshop #1
HPE + Veeam Technical Hands ON Workshop #1HPE + Veeam Technical Hands ON Workshop #1
HPE + Veeam Technical Hands ON Workshop #1Tanawit Chansuchai
 
The Pensions Trust - VM Backup Experiences
The Pensions Trust - VM Backup ExperiencesThe Pensions Trust - VM Backup Experiences
The Pensions Trust - VM Backup Experiencesglbsolutions
 
PHDVirtual Backups for VMware
PHDVirtual Backups for VMwarePHDVirtual Backups for VMware
PHDVirtual Backups for VMwareDevansh Chowdhary
 
Vizioncore Economical Disaster Recovery through Virtualization
Vizioncore Economical Disaster Recovery through VirtualizationVizioncore Economical Disaster Recovery through Virtualization
Vizioncore Economical Disaster Recovery through Virtualization1CloudRoad.com
 
Veeam - Fast Secure Cloud base Disaster Recovery with Veeam Cloud Connect
Veeam - Fast Secure Cloud base Disaster Recovery with Veeam Cloud ConnectVeeam - Fast Secure Cloud base Disaster Recovery with Veeam Cloud Connect
Veeam - Fast Secure Cloud base Disaster Recovery with Veeam Cloud ConnectTanawit Chansuchai
 
Continuent Tungsten - Scalable Saa S Data Management
Continuent Tungsten - Scalable Saa S Data ManagementContinuent Tungsten - Scalable Saa S Data Management
Continuent Tungsten - Scalable Saa S Data Managementguest2e11e8
 
snapshot vs backup
snapshot vs backupsnapshot vs backup
snapshot vs backupssuser1eca7d
 
Webinar: What’s Breaking Your VMware Backups? And How You Can Fix Them Quickly
Webinar: What’s Breaking Your VMware Backups? And How You Can Fix Them QuicklyWebinar: What’s Breaking Your VMware Backups? And How You Can Fix Them Quickly
Webinar: What’s Breaking Your VMware Backups? And How You Can Fix Them QuicklyStorage Switzerland
 
Integrating Veeam Backup with NimbleStorage
Integrating Veeam Backup with NimbleStorageIntegrating Veeam Backup with NimbleStorage
Integrating Veeam Backup with NimbleStorageJorge de la Cruz
 
V mware v fabric 5 - what's new technical sales training presentation
V mware v fabric 5 - what's new technical sales training presentationV mware v fabric 5 - what's new technical sales training presentation
V mware v fabric 5 - what's new technical sales training presentationsolarisyourep
 
Veeam Availability top 10 reasons to choose veeam - long
Veeam Availability top 10 reasons to choose veeam - longVeeam Availability top 10 reasons to choose veeam - long
Veeam Availability top 10 reasons to choose veeam - longS. Hanau
 
How to protect an Enterprise Email and Collaboration environment using Veeam ...
How to protect an Enterprise Email and Collaboration environment using Veeam ...How to protect an Enterprise Email and Collaboration environment using Veeam ...
How to protect an Enterprise Email and Collaboration environment using Veeam ...Jorge de la Cruz
 
Nakivo Slides 2014 12-17
Nakivo Slides 2014 12-17Nakivo Slides 2014 12-17
Nakivo Slides 2014 12-17Nick Luchkov
 
Workload Backup Solution Guide(Uk)
Workload Backup Solution Guide(Uk)Workload Backup Solution Guide(Uk)
Workload Backup Solution Guide(Uk)ianmasters
 
Fastback Technical Enablementv1
Fastback Technical Enablementv1Fastback Technical Enablementv1
Fastback Technical Enablementv1petchpaitoon
 

Similar to Veeam Webinar - Backing up Zarafa with SureBackup (20)

HPE + Veeam Technical Hands ON Workshop #1
HPE + Veeam Technical Hands ON Workshop #1HPE + Veeam Technical Hands ON Workshop #1
HPE + Veeam Technical Hands ON Workshop #1
 
The Pensions Trust - VM Backup Experiences
The Pensions Trust - VM Backup ExperiencesThe Pensions Trust - VM Backup Experiences
The Pensions Trust - VM Backup Experiences
 
PHDVirtual Backups for VMware
PHDVirtual Backups for VMwarePHDVirtual Backups for VMware
PHDVirtual Backups for VMware
 
Vizioncore Economical Disaster Recovery through Virtualization
Vizioncore Economical Disaster Recovery through VirtualizationVizioncore Economical Disaster Recovery through Virtualization
Vizioncore Economical Disaster Recovery through Virtualization
 
Veeam - Fast Secure Cloud base Disaster Recovery with Veeam Cloud Connect
Veeam - Fast Secure Cloud base Disaster Recovery with Veeam Cloud ConnectVeeam - Fast Secure Cloud base Disaster Recovery with Veeam Cloud Connect
Veeam - Fast Secure Cloud base Disaster Recovery with Veeam Cloud Connect
 
NetApp SMVI 2.0 - VMworld Mini Theatre
NetApp SMVI 2.0 - VMworld Mini TheatreNetApp SMVI 2.0 - VMworld Mini Theatre
NetApp SMVI 2.0 - VMworld Mini Theatre
 
Commvault Story - CVTSP_1.pptx
Commvault Story - CVTSP_1.pptxCommvault Story - CVTSP_1.pptx
Commvault Story - CVTSP_1.pptx
 
Continuent Tungsten - Scalable Saa S Data Management
Continuent Tungsten - Scalable Saa S Data ManagementContinuent Tungsten - Scalable Saa S Data Management
Continuent Tungsten - Scalable Saa S Data Management
 
snapshot vs backup
snapshot vs backupsnapshot vs backup
snapshot vs backup
 
Webinar: What’s Breaking Your VMware Backups? And How You Can Fix Them Quickly
Webinar: What’s Breaking Your VMware Backups? And How You Can Fix Them QuicklyWebinar: What’s Breaking Your VMware Backups? And How You Can Fix Them Quickly
Webinar: What’s Breaking Your VMware Backups? And How You Can Fix Them Quickly
 
Integrating Veeam Backup with NimbleStorage
Integrating Veeam Backup with NimbleStorageIntegrating Veeam Backup with NimbleStorage
Integrating Veeam Backup with NimbleStorage
 
V mware v fabric 5 - what's new technical sales training presentation
V mware v fabric 5 - what's new technical sales training presentationV mware v fabric 5 - what's new technical sales training presentation
V mware v fabric 5 - what's new technical sales training presentation
 
VBR v8 Overview-handout
VBR v8 Overview-handoutVBR v8 Overview-handout
VBR v8 Overview-handout
 
Veeam Availability top 10 reasons to choose veeam - long
Veeam Availability top 10 reasons to choose veeam - longVeeam Availability top 10 reasons to choose veeam - long
Veeam Availability top 10 reasons to choose veeam - long
 
ds-2972
ds-2972ds-2972
ds-2972
 
Profile narendraredy
Profile narendraredyProfile narendraredy
Profile narendraredy
 
How to protect an Enterprise Email and Collaboration environment using Veeam ...
How to protect an Enterprise Email and Collaboration environment using Veeam ...How to protect an Enterprise Email and Collaboration environment using Veeam ...
How to protect an Enterprise Email and Collaboration environment using Veeam ...
 
Nakivo Slides 2014 12-17
Nakivo Slides 2014 12-17Nakivo Slides 2014 12-17
Nakivo Slides 2014 12-17
 
Workload Backup Solution Guide(Uk)
Workload Backup Solution Guide(Uk)Workload Backup Solution Guide(Uk)
Workload Backup Solution Guide(Uk)
 
Fastback Technical Enablementv1
Fastback Technical Enablementv1Fastback Technical Enablementv1
Fastback Technical Enablementv1
 

Veeam Webinar - Backing up Zarafa with SureBackup

  • 1. Backing up Zarafa Collaboration Platform with Veeam SureBackup Joep Piscaer, VMware vExpert, VCDX #101 j.piscaer@virtuallifestyle.nl @jpiscaer
  • 2. Agenda  Introduction  What is backup application consistency and why is it so important?  Evaluating Zarafa ZCP components and relevance to application consistency  What options to backup Zarafa ZCP are available within Veeam Backup & Replication?  Integrating application consistency into SureBackup  Demo
  • 3. Agenda  Introduction  What is backup application consistency and why is it so important?  Evaluating Zarafa ZCP components and relevance to application consistency  What options to backup Zarafa ZCP are available within Veeam Backup & Replication?  Integrating application consistency into SureBackup  Demo
  • 4. Introduction  Joep Piscaer ● Consulting Architect at OGD ict-diensten ● VMware VCDX5 #101, vExpert 2009, 2011, 2012 ● Know Veeam since 2007 and in love with them ever since (best. VMworld. parties. ever.)
  • 5. Past Projects  Past implementations of Veeam B&R ● Commonly see a VMware virtualization layer with Windows VMs on top ● But my own company uses Linux-based applications internally  Notable projects include ● Bi-directional DR for 200-250 VMs with 2 infrastructures ● 150+ VM backup and replication within a single large datacenter ● Application consistent backups of Zarafa Collaboration Platform without bringing database down (or any other downtime) ● Numerous smaller projects for DR or backup at customer sites
  • 6. Agenda  Introduction  What is backup application consistency and why is it so important?  Evaluating Zarafa ZCP components and relevance to application consistency  What options to backup Zarafa ZCP are available within Veeam Backup & Replication?  Integrating application consistency into SureBackup  Demo
  • 7. Consistency states  Crash consistency “A crash consistent state does not have any quiescing and is equivalent to a VM being powered off without being properly shutdown.”  Filesystem consistency “A file system consistent state is better because the operating system is in a proper state to be backed up.”  Application consistency “Finally, the best state is application consistent where applications have also been properly prepared for backup.”
  • 8. Why is application consistency important?  A consistent application (or transactional) state is important, because:  It will prevent data loss or data corruption  It will improve RTO significantly for large data sets
  • 9. How to force consistency?  Quiescing the VM, filesystem and/or application: Pause VM and write all the transactional data in memory to disk  Forces the state of the disk image to be consistent, preventing data corruption or lengthy crash recovery checks on filesystems and databases
  • 10. Agenda  Introduction  What is backup application consistency and why is it so important?  Evaluating Zarafa ZCP components and relevance to application consistency  What options to backup Zarafa ZCP are available within Veeam Backup & Replication?  Integrating application consistency into SureBackup  Demo
  • 11. Zarafa components  Zarafa application components ● Core applications, WebAccess / WebApp, Z-Admin, postfix, Z- Push, spamassassin, clamav, amavis, etc  MySQL database for metadata and a file based content system  Authentication directory  DNS
  • 12. Backing up Zarafa – What’s the big deal?  The application components or dependencies are not the actual issue We can rely on file system journal to recover data from these application components  But the MySQL database is It needs to be application-consistent instead of crash or filesystem consistent
  • 13. Agenda  Introduction  What is backup application consistency and why is it so important?  Evaluating Zarafa ZCP components and relevance to application consistency  What options to backup Zarafa ZCP are available within Veeam Backup & Replication?  Integrating application consistency into SureBackup  Demo
  • 14. Hot Backup of MySQL on a Linux VM  Two options to produce a transaction consistent backup of MySQL databases: ● Option 1 stops the database and application; all caches are lost and need to be rebuilt; too big a performance hit and impacts service availability ● Options 2 produces a full copy of the database, which is not storage-friendly, and takes a considerable amount of time. Restore requires additional steps.
  • 15. Hot Backup of MySQL on a Linux VM  Both options are not viable in our environment.  We can‟t stop the database or application for each backup: ● For service availability reasons ● Because the built-up caches for database and applications would be lost, severely impacting application performance.  We cannot create a dump of the database: ● It would take too long with a big impact on storage (IOps and capacity) ● Restoring data from the dump requires additional steps
  • 16. Hot Backup of MySQL on a Linux VM  We came up with a 3rd option:  Option 3. Lock database tables and flush to disk. No downtime or service availability impact No need to rebuild cache or create an entire copy of the database.  Flushes all open tables in the database to disk while preventing any changes to databases
  • 17. Hot Backup of MySQL on a Linux VM  One problem though: “Script can‟t quit the mysql shell else you will lose the lock”  This does not play nice with pre-freeze and post-thaw scripts; since the pre-freeze script quits and loses the lock…  Jelmer Jaarsma to the rescue! My colleague found a work-around
  • 18. pre-freeze-script.sh  Create two temporary lock files and launch background script. Pre-freeze script will run until database is locked.  Background script will flush tables to disk and write-lock database. Finally, it removes a temporary lock file. This signals the pre-freeze script that the database is ready for snapshotting; the script terminates without error  With the pre-freeze script terminated, Veeam will now create the snapshot (with the database locked)
  • 19. post-thaw-script.sh  During the snapshot creation, the background script is still running, keeping the database locked.
  • 20. post-thaw-script.sh  After the snapshot has been successfully created, the post-thaw script removes the 2nd temporary lock file. This will shut down the background script, unlocking the database and continuing normal database operation  No downtime; just a couple of seconds database query queue
  • 21. Veeam backup job settings  There‟s no specific settings inside the job  Enable VMware Tools quiescence  No „post job activity‟ in the backup jobs settings  No application-aware image processing (VSS)
  • 22. Agenda  Introduction  What is backup application consistency and why is it so important?  Evaluating Zarafa ZCP components and relevance to application consistency  What options to backup Zarafa ZCP are available within Veeam Backup & Replication?  Integrating application consistency into SureBackup  Demo
  • 23. Backup and recovery verification  Transactionally consistent backups need to be verified periodically to meet RPO and other SLA goals  Testing a restore manually is a painfully long and hard process; it should include tests on all layers (VM, filesystem, application)  The only real verification is to bring the VM back online in a safe and isolated environment  Can be used to restore granular application items, too
  • 24. Integrate Zarafa into SureBackup  Add a new role to SureBackup using ZarafaServer.xml http://forums.veeam.com/viewtopic.php?f=24&t=15103&p=69768  Create a Virtual Lab  Create appropriate application groups (including any dependencies like LDAP, DNS) and select both „mail server‟ and „zarafa server‟ boxes
  • 25. Restoring Zarafa  It‟s Linux; please prepare your VM‟s NIC settings accordingly static MAC address or retain IP after MAC changes  Full VM recovery does not need any manual steps ● the database is in a consistent state (no crash recovery) and ready to go (no need to restore from a dump file)
  • 26. Restoring Zarafa  Single Object Restore / Single Mail Restore http://forums.veeam.com/viewtopic.php?f=24&t=15103&p=69768 ● Add server to Managed Servers for File Copy Advanced - Preferred TCP Connection Role - "Run Server on this side“ ● Use U-AIR to boot up VM ● Extract an User: /usr/bin/zarafa-backup -a -v -u max -o /var/backup/ ● Use Veeam File Copy to restore files to production ● Restore User /usr/share/zarafa-backup/full-restore.sh max
  • 27. Agenda  Introduction  What is backup application consistency and why is it so important?  Evaluating Zarafa ZCP components and relevance to application consistency  What options to backup Zarafa ZCP are available within Veeam Backup & Replication?  Integrating application consistency into SureBackup  Demo
  • 29. Q&A Joep Piscaer VMware vExpert, VCDX #101 j.piscaer@virtuallifestyle.nl @jpiscaer Add Jelmer Jaarsma to LinkedIn: http://nl.linkedin.com/pub/jelmer-jaarsma/8/456/717

Editor's Notes

  1. 30112012
  2. Quotes are from http://go.veeam.com/rs/veeam/images/ebook_top10_eric_siebert.pdf
  3. Option2: manual file management, full file (new / changedblocks, needdedupeappliancetosolve storage capacityproblem)
  4. http://forums.veeam.com/viewtopic.php?f=2&t=5784&p=72995http://forums.veeam.com/viewtopic.php?f=2&t=8573&p=35681
  5. 01 VM Job Settings02 Pre-freeze and post-thaw03 SureBackup Role, App Group04 Virtual Lab05 SureBackup Job