• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content

Loading…

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

Like this document? Why not share!

02 deduplicación avamar

on

  • 873 views

 

Statistics

Views

Total Views
873
Views on SlideShare
873
Embed Views
0

Actions

Likes
0
Downloads
36
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    02 deduplicación avamar 02 deduplicación avamar Document Transcript

    • La Deduplicación en Entornos Virtualizados powered by EMC Iberia TSSO Bilbao, 9 de octubre de 2008 1 Agenda El Problema La Tecnología Las Soluciones Conclusiones 2 2007/08 – En la Encrucijada El mundo va a generar más Información de la que es capaz de almacenar Gigabytes 1,000B Información 900B Digital 800B 700B En 2007, la cantidad de información creada superará por 600B primera vez la capacidad de 500B almacenamiento disponible 400B Almacenamiento Disponible 300B 200B 100B 0 2005 2006 2007 2008 2009 2010 Source: IDC, “The Expanding Digital Universe,” sponsored by EMC, March 2007 3 1
    • ¿Cuántas veces se hace backup del mismo fichero? llamado Ventas_Final_1998.xls guardado por Juan Pérez el 24/01/1999… que se jubiló en el 2001 ¿Cuántas copias de ese fichero existen? ¿Cuántas veces se verifica si ha de ser salvado? ¿Cuántas veces se refresca o recoloca en cinta ? ¿Porqué debería ser restaurado en caso de una contingencia? ¿Cuántos millones de ficheros tienes? 4 La Realidad TI Que Crece Que Disminuye Complejidad Eficiencia 70% 60% # components 50% 40% 30% 20% 10% 1990 1997 2007 0% 1980 1990 2007 Numero de componente a administrar, securizar, provisionar almacenamiento, etc. Server utilization rates* Presiones Resources Menos posibilidad de añadir Cumplir funcionalidad requisitos de Hacer MÁS o mejorar los regulaciones y de con SLA´s seguridad MENOS *Source: VMware, November 2007 5 Arquitecturas Virtuales y Backup La virtualización de servidores no elimina todas las ineficiencias, que son barreras potenciales para una mayor Consolidación y Valor Antiguo Paradigma Nuevo Paradigma Baja utilización y ancho de banda sobrado Alta utilización, pero escasos recursos y para backup ancho de banda para backup 6 2
    • Problemática Entornos Distribuidos o Virtualizados Problemática LAN WAN Recursos físicos insuficientes Backup Server Entornos dimensionados para producción No existe ventana de backup Ineficiente y lento En el Backup el 200% de los datos van por la LAN, WAN o recursos compartidos 7 La avalancha Podemos detenerla aquí o limpiar aquí 8 Agenda El Problema La Tecnología Las Soluciones Conclusiones 9 3
    • ¿ Como podríamos almacenar esto ? 10 Deduplicándolo O + Na Cl H H 11 Los objetivos de la Deduplicación Datos Datos Ratio de Tipo de Dato Respaldados Movidos Deduplicación Windows file systems 3,573 GB 6.1 GB 586:1 Mezcla Windows, Linux, y UNIX file systems 5,097 GB 11.7 GB 436:1 Ficheros eng. en NAS (NDMP backups) 3,265 GB 24.2 GB 135:1 Mezcla 20% databases, 80% file systems 9,583 GB 80.0 GB 120:1 (Windows y UNIX) Mezcla de Linux file systems y databases 7,831 GB 104.2 GB 75:1 12 4
    • Técnicas de Deduplicación 13 Compresión Máxima Deduplicación Global de Datos  Se dividen los datos en  Cada átomo se envía y  Repositorio de átomos (segmentos de almacena una sola vez backup de Avamar datos de longitud variable dentro de los archivos) O O H H H H O O H H O H H H O ... reducción de hasta 500 veces H H de la cantidad de datos por día En el lugar de origen: Deduplicación antes de transportar los datos por la red En el destino: garantiza la Deduplicación coordinada en diferentes sitios, servidores y a través del tiempo Detallada: los pequeños segmentos de longitud variable garantizan la eficacia de la Deduplicación 14 Globalidad Instancias de la Deduplicación Global de Datos Data Sitio Remoto Sitio Center 1 Remoto 2  Primera Instancia  Instancia Duplicada  Instancia Modificada Company_Overview.ppt A B C D A Sólo se realiza B Ya se realizó el backup de los Se identifica un nuevo el backup de datos, por lo tanto, sólo se E segmento de datos y los segmentos C almacenan los Id. exclusivos se le realiza un backup de datos exclusivos D (indicadores de 20 bytes) A B C D E Servidor de Deduplicación (datos de backup almacenados) 15 5
    • ¿Como funciona la deduplicación? DeDuplicación Global de Datos  El agente escanea los  Segmentación  Sólo los datos buscando Variable de los segmentos únicos cambios archivos modificados son protegidos Busca en una cache Comprime y aplica un hash a local de archivos para cada objeto identificar los datos Busca en una cache local de hashes y en el Servidor central de Avamar para determinar si el Avamar objeto es único Data Store o Avamar Server 16 De-duplicación en Origen o Destino Alternativas de Implementación en el Mercado DEDUPLICACIÓN en Destino DEDUPLICACIÓN en Origen B B B B B B Avamar Server Backup Server De-duplication Device Reducción de hasta 50x en espacio Reducción de hasta 50x en espacio Mueve el 200% de los datos Mueve el ~2% de los datos semanalmente semanalmente Los backups se recuperan desde Full + Hasta 500x de reducción en líneas de Incrementales comunicaciones Los datos son vistos como file system o Backup más rápidos - Hasta 10x en librerías virtuales para el entorno de backups full diarios backup Todos los backps son Full – Recuperación en un sólo paso 17 Todas las Alternativas EMC Avamar Disk Library Family – con DL3D Software de backup con deduplicación en origen Solución de VTL, con deduplicación en destino Complementa o sustituye al software de Backup Se integra con el software de backup existente Visión estratégica de la deduplicación a largo plazo Visión resultadista de la deduplicación a corto plazo – Ahorro de espacio y comunicaciones – Se integra fácilmente – Accelerates backups hasta 10X or more – Ahorros de espacio – Replicates de-duplicated data across WAN for DR – Ahorro de comunicaciones en DR Recuperación en ún solo paso (No más Solución Flexible para todo tipo de clientes incrementales!) Soluciones de alto rendimiento y disponibilidad Oportunidad de introducir un elemento software en Oportunidad de Introducir un elemento Software con mínimo clientes competencia de Networker impacto en el cliente desde el punto de vista operacional – Funcionalidad no existente – Los ahorror pueden justificar ambos productos o incluso la sustitución Clients: DL3D 1500 DL3D 3000 DL3D 4000 Avamar Avamar Data Avamar Virtual Software Store Edition DL1500 DL3000 DL4000 LAN B2D LAN B2D SAN VTL Provides NetWorker installed base up-sell opportunity with integrated de-dupe solutions Deployed on Fully integrated Single-node Avamar Affordable Mid-range Industry qualified, industry hardware/software server running as a Affordable, target Mid-range, target SAN VTL target based B2D target leading VTL standard servers solution with single virtual machine 3D based 3D based w/ 3D based with point of support de-duplication de-duplication de-duplication 18 6
    • Agenda El Problema La Tecnología Las Soluciones Conclusiones 19 Alternativas de Protección Guest Level Backup (Aprox. Tradicional) Image Level Backup (Nueva Aproximación) Backup Server 20 Soluciones Avamar Alternativas de Implementación del Software Solución Software – Avamar de-duplication software – Servidor Compatible – Almacenamiento interno o CLARiiON Solución Completa Preconfigurada – Data Store – Avamar de-duplication software + EMC-certified hardware – Simplifica la solución  Adquisición (Un fabricante, Un Hardware certificado)  Implementación (Reduce tareas onsite)  Soporte (Punto único de contacto) Solución Virtualizable – AVE (Avamar Virtual Edition) – Avamar SW + VMWare – Único en el mercado Avamar VM Application – Acelerar el ROI .5 TB Avamar VM .5 TB Operating System Operating System Operating System ESX Server Hardware CPU Memory NIC Disk 21 7
    • Solución EMC Avamar para VMware Agentes Avamar OFICINA REMOTA GRANDE APP Avamar VM APP Avamar VM PEQUENA OFICINA REMOTA OS OS OS OS Avamar Avamar ESX Server ESX Server APP VM APP VM Hardware Hardware OS OS OS OS ESX Server ESX Server CPU Memory NIC Disk CPU Memory NIC Disk Hardware Hardware (ENCRYPTED) Avamar agent only CPU Memory NIC Disk CPU Memory NIC Disk on primary systems (ENCRYPTED) Avamar agent only Avamar Data Store on primary systems DATA CENTER CENTRO DE RESPALDO WAN Avamar Avamar APP Avamar VM APP Avamar VM APP APP VM VM OS OS OS OS OS OS OS OS ESX Server ESX Server ESX Server ESX Server Hardware Hardware Hardware Hardware CPU Memory NIC Disk CPU Memory NIC Disk CPU Memory NIC Disk CPU Memory NIC Disk Primary systems (ENCRYPTED) (ENCRYPTED) Primary systems Avamar Avamar Data Store Data Tape Store Vault 22 Agenda El Problema La Tecnología Las Soluciones Conclusiones 23 Beneficios Deduplicación inteligente Beneficios WAN Avamar Acelera el backup al reducir la cantidad de datos transferida Cumpla con ventanas breves de backup Administración centralizada O H C Elimina el costo, la complejidad y la administración Beneficios Data Center Acelera el backup al reducir la cantidad de datos transferida en entornos LAN LAN WAN Se integra con el SW de Backup Avamar Los datos se pueden clasificar y explorar Beneficios WMWare Optimización de recursos – Posibilidad Tradicional S Reducción de hasta un 95% de datos Reducción de hasta un 90% en tiempos 24 8
    • Beneficios de la De-duplicación Optimización de Espacio Traditional Backup v. EMC AvamarTraditional Backup vs. EMC Avamar Cumulative Media Required Total Cumulative Storage - 10TB MS Office file data (Traditional = weekly fulls + daily incrementals; EMC Avamar = daily fulls) Traditional Backup 200 192 180 176 Traditional Backup 160 4 weeks 8 weeks 144 160 w/Compression (2:1) 140 128 Cumulative TB 120 112 EMC Avamar 100 96 96 88 80 80 80 72 64 64 60 56 48 48 40 40 32 32 24 16 16 20 8 3.6 3.8 4.0 4.2 4.4 4.7 4.9 5.1 5.3 5.5 3.4 0 3.2 1 2 3 4 5 6 7 8 9 10 11 12 Weeks Traditional Backup Traditional Backup with Compression (2:1) EMC Avamar Avamar rentabiliza el backup a disco Traditional Backup vs. EMC Avamar Total Cumulative Storage - 10TB MS Office file data (Traditional = weekly fulls + daily incrementals; EMC Avamar = daily fulls) 200 192 180 25 176 160 160 144 140 128 Cumulative TB 120 112 100 96 96 88 80 80 80 72 64 64 60 56 48 48 40 40 32 32 24 16 16 20 8 3.6 3.8 4.0 4.2 4.4 4.7 4.9 5.1 5.3 5.5 3.4 0 3.2 1 2 3 4 5 6 7 8 9 10 11 12 Weeks Traditional Backup Traditional Backup with Compression (2:1) EMC Avamar Adiós a las cintas?? Eficiente en Coste – Deduplicación Global  Ahorro de espacio y comunicaciones  Escalabilidad lineal, sin perder la Deduplicación Global – Algoritmo flexible de bloque variable  Ahorro de espacio y comunicaciones – Deduplicación en Origen  Ahorro de espacio y comunicaciones – Múltiples topologías para ajustar el coste-rendimiento Plataforma Segura – Arquitectura redundante para DR – Redundancia de nodos (RAIN) – Redundancia en disco (RAID) – Cifrado de datos en línea y en destino Eficiencia de Gestión – Administración centralizada – Todos los backups son “full” – Capacidad de búsqueda dentro cada fichero – Posibilidad de acceso a cada backup mediante protocolos NAS 26 Avamar: Optimized Backup for VMware Infrastructure Avamar De-duplicates at the Optimal Location and Level of Granularity Optimal location: Reduces data at the source – Duplicate data never traverses congested shared resources – Data backed up is reduced from ~200 percent to ~2 percent of primary weekly – Significantly reduces contention for shared resources – De-duplicates within and across virtual machines and/or VMDK (virtual machine disk format) files Optimal granularity: Sub-file, variable-length segments – VMDK is one large file; any changes cause an incremental/full traditional backup – Fixed-length segment de-duplication fails due to frame offset – Sub-file, variable-length segment de-duplication finds changes anywhere in VMDK – Dramatically cuts the amount of data backed up daily – Significantly reduces daily backup time Ideal for the protection of VMware environments – Enables fast, secure backups over existing virtual infrastructure – Permits greater server consolidation and maximum value from VMware 27 9
    • Avamar Client Backup Solutions Guest VMware Service Console Consolidated Backup Application Application Application Application Application Operating System Operating System Operating System Operating System Operating System Avamar server Virtual Machines VMware App App App VCB proxy server Centralized Hardware VMware Virtualization Layer with Avamar agent Data Mover OS OS OS Avamar MOUNT agents x86 Architecture ESX Server CPU Memory NIC Disk SNAPSHOT SNAPSHOT SNAPSHOT Physical SAN CPU Memory NIC Disk Server Storage Avamar agents ESX Server Avamar server Avamar client software Avamar client software Avamar client software runs directly on each runs on the VCB proxy runs directly on the ESX virtual machine server console 28 Avamar Backup for VMware Guests Avamar agent resides inside each Avamar agents virtual machine De-duplicates data within the virtual Application Application machine, as if they were physical Operating System Operating System servers Moves minimal backup data VMware Virtualization Layer – Reduces resource contention and accelerates backups x86 Architecture Provides file-level restore for Windows, Linux, and Solaris CPU Memory NIC Disk 29 Optimized Backup for VMware Infrastructure Avamar Efficiently Protects Virtual Machines Traditional moves ~200% weekly Up to 95 percent reduction in data moved Application Application Operating System Operating System Up to 90 percent reduction in backup times Up to 50 percent reduction in disk impact VMware Virtualization Layer Up to 95 percent reduction in NIC usage x86 Architecture Up to 80 percent reduction in CPU usage CPU Memory NIC Disk Up to 50 percent reduction in memory usage Avamar moves ~2% weekly All backups are stored as “virtual full App OS App OS App OS App OS App OS App OS backups,” ready for immediate restore App OS App OS App OS App OS App OS App OS Maintains effective consolidation ratios VMware Virtualization Layer without overtaxing CPU utilization x86 Architecture CPU Memory NIC Disk 30 10
    • VMware Consolidated Backup (VCB) Moves backup processing off the virtual machine Backup Eliminate virtual machine Disk backup traffic on LAN Virtual Machines Supported by major third- App App App Backup Centralized party backup products Proxy Data Mover OS OS OS Server MOUNT ESX Server SNAPSHOT SNAPSHOT SNAPSHOT Physical SAN Server Storage 31 Avamar and VMware Consolidated Backup Avamar agent resides on the proxy server Avamar De-duplicates within and server across VMDK files Virtual Machines Supports both VCB file App App App VCB Proxy Server Centralized (Windows only) and with Avamar agent OS OS OS Data Mover image-level backup Avamar Avamar replication MOUNT agents ESX Server provides disaster recovery SNAPSHOT for backed up VMDKs SNAPSHOT SNAPSHOT Physical SAN Server Storage 32 Avamar Backup at the Console Level Avamar agent resides on the Application Application Application ESX console operating system Operating System Operating System Operating System De-duplicates within and across VMDK files VMware Provides VMDK image-level (no file-level) backup without VCB Hardware No proxy server or SAN required CPU Memory NIC Disk Avamar agents ESX Server Avamar server 33 11
    • Avamar Server Backup Products Avamar Software Avamar Data Store Avamar Virtual Edition for VMware Avamar VM Operating System Application Avamar VM Operating System Operating System ESX Server Hardware CPU Memory NIC Disk Deployed on qualified, Fully integrated Single-node Avamar server industry-standard servers hardware/software product running as a virtual machine with single point of support 34 EMC Avamar Data Store Fully Integrated Software/Hardware Product New Avamar Data Store Gen 2 Avamar Data Store doubles de-duplicated backup capacity – Multi-node RAIN configuration – 4 TB to 32 TB de-duplicated capacity  Equivalent of up to 1 PB of cumulative traditional disk or tape backup storage*  Backup media requirement reduced 20–40 times – RAID, with daily integrity checks and redundant power Avamar Data Store Single Node – Supports 1 TB and 2 TB de-duplicated backup capacity configurations – Equivalent of up to 70 TB of cumulative traditional disk or tape backup storage* Avamar Data Store – Designed for easy deployment at remote offices From single node to full rack – Offers fast, local recovery without dependence on a WAN connection * Equivalent traditional backup capacity assumptions: 100 percent Microsoft Office file data, weekly full and daily incremental backups, no compression, 10 percent daily change rate, 90-day retention 35 Avamar Virtual Edition for VMware Avamar Server Software Deployed as a Virtual Appliance Industry’s first de-duplication virtual appliance Avamar VM for backup, recovery, and disaster recovery Operating System Leverages existing servers and storage – Can utilize existing iSCSI, SAN or DAS disk storage Replication (of applications and storage) eliminates shipping tapes Application Avamar VM – Replicate between virtual Avamar servers and Operating System Operating System physical Avamar servers Facilitates rapid, cost-effective deployment ESX Server and return on investment Hardware Supports VMotion for deployment flexibility CPU Memory NIC Disk Up to two Avamar Virtual Edition virtual appliances per ESX server for scalability 36 12
    • Avamar Products for VMware Infrastructure Remote Offices with VMware Remote Offices without VMware Application Avamar VM Operating System Operating System WAN (ENCRYPTED) (ENCRYPTED) Avamar agent ESX Server moves data to Avamar Virtual Hardware Edition for Avamar agent moves data to a physical Avamar VMware; data is Single Node server; data is then replicated to the then replicated (ENCRYPTED) corporate data center, OR an Avamar agent can to the corporate back up directly to the data center over the WAN CPU Memory NIC Disk data center App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App App OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS OS VMware Virtualization Layer VMware Virtualization Layer VMware Virtualization Layer VMware Virtualization Layer VMware Virtualization Layer VMware Virtualization Layer x86 Architecture x86 Architecture x86 Architecture x86 Architecture x86 Architecture x86 Architecture CPUMemory NIC Disk CPUMemory NIC Disk CPUMemory NIC Disk CPUMemory NIC Disk CPUMemory NIC Disk CPUMemory NIC Disk LAN/ SAN SAN VCB Proxy VMware Data Center Server with Guest-Level Backup VMware Data Center with VMware Consolidated Backup 37 Avamar Supported Operating Systems and Applications Client Operating Systems Supported Application Modules Microsoft Windows Server 2003 Standard and Enterprise Microsoft Exchange 5.5, 2000, 2003 Microsoft Windows 2000 Server and Advanced Server Microsoft SQL Server 7.0, 2000, 2005 Microsoft Windows NT 4.0 Server Oracle 9i, 10g, 10gR2 Microsoft Windows XP, XP Professional, Vista IBM DB2 8.2.x, 9.5 Red Hat Linux 8.0, 9.0 NDMP (EMC Celerra) DART 5.5 Red Hat Enterprise Linux (RHEL) 2.1, 3.0, 4.0, 5.0 NDMP (NetApp) Data ONTAP 6.3, Solaris 2.6, 7, 8, 9, 10 6.4, 6.5, 7.0.4, 7.0.5, 7.0.6, 7.1x SUSE Linux Enterprise Server 8, 9, 10 VMware Infrastructure IBM AIX 5.1, 5.2, 5.3, 6.1 VMware ESX Server versions HP-UX 11.0, 11iV1, 11iV2, 11iV3 New 2.5.3, 3.0.x, 3.5, 3i Avamar software Mac OS X 10.4x, 10.5x expands client = ESX client OS-certified using operating system, RHEL 4 client (support within NetWare 6.5 application virtual machines depends on support VMware support of client Novell Storage Services (NSS) OES 2 operating system) 38 39 13