JP Morgan Remote to Core Concepts

304 views

Published on

JP Morgan Remote to Core Concepts for North America Presented by John Napier, PMP, CSM

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
304
On SlideShare
0
From Embeds
0
Number of Embeds
6
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

JP Morgan Remote to Core Concepts

  1. 1. January 2007 This deck is for Remote to Core presentation purposes and process understanding. It is not intended to replace detailed installation, deployment guidelines or standards documentation maintained by those groups primarily responsible for the associated tasks described. ST R I C T L Y P R I V A T E A N D C O N F I D E N T I A L Remote to Core – Part 1 - Design Concepts Author: J.Napier
  2. 2. Contents  Purpose  Solution  Component Architecture  Data Flow Diagram  Snapvault Functionality  Volume/Qtree Convention  Snapvault Requirements  High Level Data RPO 1
  3. 3. Purpose  Eliminate Tape Creation in non-CORE Datacenters  Provide Standard Storage Platform for Strategic MS/AD File/Print Services  Drive Risk and Cost out of the Branch Backup environment by eliminating tape handling/media expenses, and reallocatingdecommissioning branch level backup infrastructure  Develop efficiencies and increase speed related to data recovery 2
  4. 4. Solution: Network Appliance Snapvault Management  Network Appliance Snapvault utilizes snapshot and replication functionality to perform backups on NFS- mounted and/or CIFS-mapped file systems residing on NetApp filers. A NetApp Snapshot copy is created on the primary storage system and is then replicated to a NetApp secondary storage system.  Based on the quick creation of a snapshot and a transfer of only changed blocks via NetApp Qtree Snapmirror replication, fast backups and restores can be easily accomplished from local to remote locations.  Backups in the form of Snapshot copies on the primary(Remote) and secondary(Core) NetApp storage systems are managed (creation, retention, deletion) with Snapvault scheduling.  All backup data stored is in file format, including all incremental backups, and each incremental backup can be viewed as a full backup image by any administrator or end-user with associated access control and security rights. Data to be restored can be quickly located with a full view into what the environment looked like at the time the backup was created, and as far back as data retention will permit.  The “file system” view of backups can be accessed by end users as well, and empowers the user to perform self-restores, if the administrator permits.  Standard Solution for Remote to Core provides for 30days local backup protection and 60 days remote backup retention – all backups on disk and online. 3
  5. 5. Remote to Core Component Architecture [reproduced from M.Weitman’s - Component Architecture.ppt] Core Site Robocopy Server Needed for sites that do not use Filer as primary storage - Copies data between F/P Servers and Filer Existing File Servers, Clients Requiring Backup a Core NAS Device g DS 14 MK2 Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F FC P ower Fault WAFS or WAN-Accel Engine [Future] Loop A Loop B S ystem Shelf ID DS 14 MK2 Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance FC P ower e Fault Loop A Loop B S ystem Shelf ID 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance DS 14 MK2 FC P ower Fault Loop A Loop B S ystem Shelf ID 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance DS 14 MK2 FC P ower Fault Loop A Loop B S ystem Shelf ID 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance V6070 NAS Device b c NetApp WAN Ethernet Etherchannel, Multi-homed V6070 FAS 270C P ower Status A Activity A Activity B Status B NetApp Shelf ID 72F 13 72F 12 72F 72F 72F 72F 72F 11 10 09 08 07 72F 06 72F 05 72F 04 72F 03 72F 02 72F 01 72F 00 DS 14 MK2 Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance FC P ower Fault Loop A Loop B S ystem Shelf ID 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance DS 14 MK2 FC P ower Fault Loop A Loop B S ystem Shelf ID 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance DS 14 MK2 FC P ower Fault d Loop A Loop B S ystem Shelf ID 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F DS 14 MK2 Single Instance/ Data Reduction Engine or Data Movement [Future] FC P ower Fault Loop A f Loop B S ystem Shelf ID WAFS or WAN-Accel Engine [Future] Single Instance/ Data Reduction Engine or Data Movement [Future] i Remote Site Other Storage Infrastructure 4
  6. 6. Remote to Core Data Flow Diagram Core Site Initial Data Seeding From Existing Servers to Filer Shares a Snapvault Secondary Volumes created for R2C Standard. c DS 14 MK2 Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance FC P ower Fault Loop A Loop B S ystem Shelf ID 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance DS 14 MK2 Volumes/Qtrees/Shares Created to match Existing infrastructure Standard R2C Snapvault Schedule Standard R2C Snapshot Schedule FC P ower Fault Loop A Loop B S ystem Shelf ID 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance DS 14 MK2 FC P ower Fault Loop A Loop B S ystem Shelf ID 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance DS 14 MK2 FC P ower Fault Loop A Loop B S ystem Shelf ID d 72F b 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F V6070 FAS 270C NetApp P ower F&P File Transports, incl Full Volume Copy and Nightly Incremental (if required) f Status A e Activity A Activity B Status B Shelf ID 72F 13 72F 12 72F 72F 72F 72F 72F 11 10 09 08 07 e Subsequent Snapvault only transfer changed blocks. Standard Snapshot schedule retains 30 Daily Snapshots in rotation 72F 06 72F 05 72F 04 72F 03 72F 02 72F 01 WAN V6070 72F 00 e Snapvault schedule triggers Snapshot and Qtree replication transfers Image to Core Volume NetApp DS 14 MK2 Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance FC P ower e Fault Loop A Loop B S ystem Shelf ID DS 14 MK2 FC P ower Fault Loop A Loop B S ystem Shelf ID 72F e 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance DS 14 MK2 FC P ower Fault Loop A Loop B S ystem Transfer is IP-based Storage Replication (Qtree SnapMirror) Snapvault Standard schedule retention (60days) of daily images in rotation @Core Shelf ID 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance Network Appliance NetworkAppliance NetworkAppliance Network Appliance 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F 72F DS 14 MK2 FC P ower Fault Loop A g Loop B S ystem Shelf ID f f f Daily Incrementals follow same path (f). Curve drawn for diagram simplicity Remote Site Other Storage Infrastructure 5
  7. 7. Snapvault Functionality Process Operations Manager Functions: Centralized Scheduling, Monitoring, Alerting and Reporting mechanism for Filer configuration and Snapvault processing. Snapvault Functions: R2C Standard Schedules, Frequencies and Retentions for Snapshots and Snapvault within OnTap NetApp Snapvault executes on local snapshots and filer-based replication per schedule trigger from Op Mgr. Perform Primary and Secondary volume snapshots per scheduler Subsequently, perform Qtree-based Snapmirror replication between Source data and Target DSU Core Site Monitoring Infrastructure e f NetApp Snapvault Primary (remote) c. Perform Local Snapshot d. Source to Target Relationship [Qtree to Qtree] d. Source for Qtree SnapMirror Replication Bocada, Other Operations Manager Cluster (core) b. Scheduler e. Monitoring/Alerting f. Reporting(+feed) Existing F&P Servers a FAS 270C P ower Status A Activity A Activity B NetApp Snapvault Secondary (core) c. Snapshot (Retention) d. Target for Snapvault Replication Status B Shelf ID 72F User Volumes Replicated to Filer Volumes 13 72F 12 72F 72F 72F 72F 72F 11 10 09 08 07 72F 06 72F 05 72F 04 72F 03 72F 02 72F 01 72F 00 d V6070 c WAN NetApp d c Snapvault Secondary Volumes g Snapvault Secondary Snapshots(Retention) g Remote Site Bocada Netbackup Functions: If the requirement to have LT Retention (ie “Monthly Full backups @2yr retention”) exists, then NBU Master/Media at Core has Policy and schedule for that requirement. Source volume for NBU will be on Core filer (Snapvault Secondary) – a mirror of the remote site volume, and target for Media server can be Tape or Bunker via NDMP – Target is TBD (Other disk, Bunker, C2B, Tape) TBD Tape Bunker 6
  8. 8. Remote to Core Volume and Qtree Definition Core Site V6070 FAS 270 P ower Status A Activity A Activity B NetApp Status B Shelf ID 72F 72F 13 72F 72F 72F 72F 72F 11 12 10 09 08 07 72F 06 72F 05 72F 04 72F 03 72F 02 72F 72F 01 00 Remote Site A volvol1filer1_qtree1 ... ... volvol1filer1_qtree2 vol1 filer1_vault1 volvol9filer1_qtree98 volvol1filer1_qtree1 volvol9filer1_qtree99 volvol1filer1_qtree2 ... vol9 volvol9filer1_qtree98 volvol9filer1_qtree99 N WA FAS 270 P ower Status A Activity A Activity B Status B Shelf ID 72F 13 72F 12 72F 72F 72F 72F 72F 11 10 09 08 07 72F 06 72F 05 72F 04 72F 03 72F 02 72F 01 72F 00 ... volvol1filer2_qtree2 vol1 volvol9filer2_qtree98 vol9 volvol1filer2_qtree1 volvol1filer2_qtree2 ... volvol1filer2_qtree1 ... Remote Site B filer2_vault1 volvol9filer2_qtree98 volvol9filer2_qtree99 volvol9filer2_qtree99 All qtrees sharing Standard Retention (60 day) will be located on a common vault volume per Remote site 7
  9. 9. SnapVault Management Requirements. NetApp Hardware Any platform combination that SnapVault supports Data ONTAP Primary: Data ONTAP 6.5.2 or later (7.1.1 initial deployment) Secondary: Data ONTAP 7.1 or later (7.2 initial deployment) NetApp Software Snapshot, SnapRestore[1] Primary: sv_ontap_pri Secondary: sv_ontap_sec Protocols NFS, CIFS Monitoring Operations Manager (Backup module) Scheduling Operations Manager (Data Protection Manager) – Strategic Filer-based scheduling - Tactical 8
  10. 10. High-Level Process – Data Recovery Options: Data Recovery Point and Retention Remote Site (Local) Daily Backup Images will reside (Local) for 30 days Snapshots (Local) will provide intraday file recovery - space permitting Core Site Daily Backup Images will exist 60 Days - Backup Images expire per schedule - Retention > 60 days – Bunker or Tape Example Recovery Point Options: Failure Mid-day on Wednesday Remote Site Week-8 Week-4 Week-3 Week -2 Sun 8 AM Sun Sun Last Week Mon Tue Wed Thu Current Week Fri Sat Sun Mon Tue Wed Thu x 6 PM EODay Core .... EODay End of 30 Day Remote Site Retention .... = Snapshot = Snapvault(L) = Snapvault(R) Time 9

×