Your SlideShare is downloading. ×
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Extreme Storage Scale and Efficiency: Lessons from a 100,000-person Organization

201

Published on

Oracle IT, supporting nearly 100,000 employees, 10,000 products, and US$36 billion in annual revenue, operates one of the most leading-edge IT shops in the world. To be effective and profitable at …

Oracle IT, supporting nearly 100,000 employees, 10,000 products, and US$36 billion in annual revenue, operates one of the most leading-edge IT shops in the world. To be effective and profitable at this extreme scale, Oracle IT takes advantage of every technology in the Oracle portfolio. This session highlights how Oracle IT uses storage as a competitive asset, and it shares important lessons learned and best practices with respect to storage and the enterprise. Discover how Oracle IT's move to Oracle storage improved performance, increased efficiency, and reduced cost.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
201
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
6
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide
  • Introduction I manage the architecture and implementation of our backup and recovery infrastructure for Cloud Services @ Oracle. Cloud Services protects over 13 PB of data to tape a monthCloud Services protects Over XXXXX hot db backups a monthCloud Services protects XXXX archive logs in a month Cloud Services leverages RMAN, NDMP, and simple FS backups for the majority of our protectionWe provide not just onsite data protection but remote DR including the ability to drop ship data to customers in the event of a disaster.
  • Scorso NOTE NOT TO STAY FOR PRESO - I need to validate the #s one last time. To tired tonight. Oracle IT went from 3 Library platforms to 1, 2 media / drive platforms for Commercial to 1Oracle IT went from an EOL inline encryption solution that had no capacity or ability to grow to a robust out of data path encryption process. Oracle IT has grown drastically during our refresh project. We moved our archive log backup cache to ZFSSA and with that, Oracle LTO tape drives and OSB we reduced most operating environments from 8 - 14 drives to 2 -4 drives. we saw performance go from 20MBs per drive to around 140MBs per drive [.SCORSO NOTE (I need to re verify these #s) ]
  • To summarize, we can contrast the two approaches – the traditional approach of mix & match vs.. Oracle’s optimized solutions. There are significant gains that can be made by leveraging a complete solution that is engineered to work together.1) With a collection of vendors, it can be challenging to determine who to turn to for specialized knowledge and support. Suppliers are typically accountable only for their components and not for the overall configuration and end results of your deployment. With Oracle Optimized Solutions, Oracle, as the developer of everything in the configuration, is in a unique position to support your needs.2) A matrix of products may be optimized independently but not optimized to work together as a single system. Within Oracle, teams collaborate through the development process to recognize and take advantage of synergies across products to deliver the best results.3) In the traditional deployment model, the first assembly of these technologies is in your data center either through IT staff or a paid integrator. How to best configure, tune, and deliver high availability is a patchwork of practices around various products in the configuration. With Oracle Optimized Solutions, you are leveraging configurations and practices that have been developed and shaken out by Oracle. Practices are developed with awareness of the other components that will be in the stack vs.. in isolation.Finally, the complexities noted above place a significant burden on IT staff, which is forced to spend a significant amount of time working to support day-to-day operations, including maintenance and updates. By reducing the complexity, Oracle Optimized Solutions can enable staff to turn more focus to strategic projects and spend less time on day-to-day concerns.
  • Still need to resize the latest version of this which cleans up the business and lines.Could simplify this still and bring in each component 1 piece at a time.
  • Not sure if this image is worth while/better worse then others.
  • Rapid Recovery - Data corruption correction - User errorrecover files, settings - Environments that just can’t be down. (Business Critical)Normal Recovery - Fault protection - User Error - DB RefreshesRetention - Compliance - Securely holding data for long term. - Oracle Cloud Services always encrypts tape data. - Business Requirements - Keeping data through out its life cycle based on business requirements - Some data isn’t there for rapid recovery but losing it would be costly. - Point in Time Recoveries - Disaster Recovery - Natural or Infrastructure Disaster Recovery loss of a environment or site. - User / Fault Protection - Medium size data failures (loss of access to a storage appliance, accidental mass delete. )Flexibility - Remote data copies - Oracle IT uses this for administrative shares, Low change rate data - Big data migration -Oracle IT uses this to migrate from site to site quickly - Remote Disaster Recovery - Oracle IT uses this for Oracle based remote DR and Customer based DR
  • Highly Available: -Deploy Local and Remote clusters, - Backups at each site include keys from all sites (built in offsite backups) - All tape drives can reach all appliancesSimple: - Its an appliance! - This product wraps up very complex key handling and security into something you can manage and setup quickly. - Our administrators can see the entire complex from a single unit. Secure: - FIPS 140-2 Level 3 certified (when operated in FIPS mode) - http://csrc.nist.gov/groups/STM/cmvp/documents/140-1/140val-all.htm : http://csrc.nist.gov/groups/STM/cmvp/documents/140-1/140crt/140crt1050.pdf - AES 256bit Keys - Quorum Based Authentication - Isolated Key management networkAccessible: - Local and Remote clusters can be seen by all tape drives. - Secure Transfer Partners for non cluster key exchanges - Remote Quorum Operations ! - Works with our biggest libraries to our smallest - ClI and GUI interface
  • Redundant: - Tape Libraries: Power, Robotics, - Quantum I2ks had single robotics to manage 50 to 60 drives, Sl3000s have 2 robots to 56 drives in our deployments - Quantum can do drive and power maintenance online.. On Oracle STK I can do Drives, Robotics, power service online! - OKM: Encryption Management, - previous slide covers this well. - OSB: Media Servers, Attach points - Deploying media servers in pairs allows us to share tape drives and provide 2 data paths. - Ease of upgrades, maintenance and performance - OSB Admin Servers: Futures reference Deans work on VM redundancy?? - ACSLS: Logical Libraries - mixing load between 2 libraries allows us to take entire libraries down or weather unforeseen issues. - Double the robotic access. - Storage: Clustered ZFSSA - I can have head fail overs and still access my data for usage and protection. Scalable: - SL3000 + ACSLS can vault over 500 tapes in a few clicks. - OSB and ACSLS allow me to easily vault and manage media across my enterprise - With Quantum I have to manage each library on its own. Down to the IO blade 2 to 4 drives per.. - Can go from a massive Datacenter to a small remote customer site and securely recover my data! - OKM works with SL3000 and SL150, even rack mount T10K drives. - With ACSLS and OSB I can grow my capacity slots or drives on demand live - Efficient: - Oracle IT went from 2 Full Time people vaulting and moving media to 1 part time person at our largest site. - Oracle IT went from spending 2 FT resources on Down drives to 1 part time person dealing with the odd down drive. - With Opus 10gbe network switches we have aggregated more clients into the same backup infrastructure.Flexible - With such powerful building blocks I can get 112 drives with redundant libraries into just over 5 floor tiles. Or I can get 56 drives and 1100+ slots in 7 floor tiles with redundant robotics and and massive import/export - OSB Media servers in our deployments support IB, 10gbe, and FC data paths. - Same platform and configuration varied IO path based on deployment needs. - Supports Solaris and Linux media servers seamlessly
  • Transcript

    • 1. 1 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 2. Extreme Storage Scale andEfficiency: Lessons from a100,000-PersonOrganizationSam CorsoInsert Presenter’s Title HereSteve VailInsert Presenter’s Title Here2 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 3.  Oracle IT and Storage StrategyProgramAgenda  NAS Storage Configurations and Performance  Oracle IT Disk Use Cases  Cloud IT Backup and Recovery  Oracle on Oracle vs. Legacy Solutions  Backup and Recovery Platform Overview  Backup and Recovery Best Practices  Next Steps3 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 4. Oracle ITBenefits of a Massive Migration Improve Service Overall cost reductions – Eliminate/Reduce purchase and license costs – Reduce space and power footprint – Reduce operations costs Run Oracle on Oracle – Showcase technology – Improvements and opportunities in performance, usability, continuity4 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 5. Oracle IT – Customer Driven TRADITIONAL DEVELOPMENT• Global voice & network infrastructure • Operation, administration & management of Production• Global data center operations business systems• Oracle employee support • Operation of Development-managed compute spaces• Computing device management & support • Management & support of specialized development computing devicesSupporting 100K+ internal users & 1.2M+ external users in Supporting 21K developers building over 3K products145 countries globally ORACLE ON DEMAND ORACLE UNIVERSITY• Operation, administration & management of customer • Operation, administration & management of computing facing computing resources resources supporting delivery of curriculum & classroom• Administration & management of computing architecture content & standards• Business continuity operation & planningSupporting over 5.5M users over 4,000 environments Supporting 352K students resulting in 41,000 classes annually in 24 languages 5 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 6. How Big is it Really? 12000 10000Over 19 Petabytes Total 8000Storage 6000 4000Over 9 PetabytesMigrated To Sun ZFS 2000Storage Arrays 0 Traditional Development Cloud Services Oracle University Total Size in TBs Migrated So Far in TBs6 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 7. Storage Refresh Status – To Date Before Refresh Current Status After Refresh Sun Sun NetApp Oracle 69% Oracle 64% 77% Sun Others 0% Others 3% 4% EMC Others EMC EMC 7% NetApp 14% 7% NetApp 17% 13% 25%Source: Horison Information Strategies, 2009 7 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 8. Storage StrategyChallenges• Large variety of customer needs and workloads – From low latency file access to highest speed read/write operations – Mixed mode solutions within the Cloud• Transition tooling – Ensuring compatibility to automation infrastructure• Increased inspection into performance and behavior during transition• Matching transition to dependent efforts – Server Refresh, Virtualization Strategies, Network Upgrade, Backup Solution8 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 9. Data Growth Vastly Outstrips IT BudgetsDatacenter Best Practices Demand Tiered Storage Single Disk Modern Tier of Disk Multi-tiered Multi-tiered Storage Storage Storage Flash Storage $40 - $54/GB Performance Disk 6% $7 - $22/GB 38% Capacity Disk 32% $1 - $6/GB Tape Storage 100% 62% 60% $0.1 - $0.85/GB Average Average Average ~$15,000/TB ~$8,000/TB ~$4,000/TBSource: Horison Information Strategies, 2009 9 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 10.  Oracle IT and Storage StrategyProgramAgenda  NAS Storage Configurations and Performance  Oracle IT Disk Use Cases  Cloud IT Backup and Recovery  Oracle on Oracle vs. Legacy Solutions  Backup and Recovery Platform Overview  Backup and Recovery Best Practices  Next Steps11 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 11. Storage StrategySolutions • Small/Medium/Large solutions matched to • Transition Support Customer need – Scripted workflows support existing – Low Cost non-clustered automation • 71XX for customers with 3-4 TB requirement – Multi-protocol sharing in a single device – Mid Cost clustered • 73XX for customers with 7-15TB requirement • Advanced analytics allow administrators – Large Scale NAS visibility through out transition lifecycle • 74XX for customer up to +28TB requirement – Large Scale SAN • Pillar Axiom12 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 12. ZFS SA Performance Tests Testing ConfigurationsModel CPU Memory Read Cache Write Cache Shelves Drives RAIDZFS 7420 16 cores 128GB 2 x 512GB 8 X 18GB 4 1TB SAS2 72.K 3-way MirrorZFS 7420 16 cores 128GB 2 x 512GB 8 X 18GB 4 300GB SAS2 15K 3-way MirrorNetApp FAS3070 4 cores 8GB n/a n/a 3 500GB SATA RADI-DPNetApp FAS6070 8 cores 32GB n/a n/a 5 300GB FC 10K RAID-Dp The tests were run with a 100MB dataset, consisting of the following steps on each client host: 1. Create a /tmp/<hostname>_mnt directory 2. Mount the dir from Sun 7420 to /tmp/<hostname>_mnt 3. Randomly select 1 of 25 source directories (same dataset) and copy to the local host, into /tmp/<hostname> 4. Move /tmp/<hostname> back to the filer into output/<hostname> 5. Unmount filer and remove temporary mount point 15 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 13. 2500 Hosts 2500 Hosts 2000 Hosts 2000 Hosts 1500 Hosts 1500 Hosts 1250 Hosts 1250 Hosts 1000 Hosts 1000 Hosts 800 Hosts 800 Hosts 600 Hosts 600 Hosts 400 Hosts 400 Hosts 200 Hosts 200 Hosts 100 Hosts 100 Hosts 50 Hosts 50 Hosts 25 Hosts 25 Hosts 10 Hosts 10 Hosts 5 Hosts 5 Hosts 1 Host 1 Host 0 40000 35000 30000 25000 20000 15000 10000 5000 1000 900 800 700 600 500 400 300 200 100 0 Seconds NFS Ops/sec Insert Information Protection Policy Classification from Slide 12ZFS SA Performance Tests 2500 Hosts 2500 Hosts 2000 Hosts 2000 Hosts 1500 Hosts 1500 Hosts 1250 Hosts 1250 Hosts 1000 Hosts 1000 Hosts 800 Hosts Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 800 Hosts 600 Hosts 600 Hosts 400 Hosts 400 Hosts 200 Hosts 200 Hosts 100 Hosts 100 Hosts 50 Hosts 50 Hosts Test Results 25 Hosts 25 Hosts 10 Hosts 10 Hosts 5 Hosts 5 Hosts 1 Host 1 Host 600 500 400 300 200 100 0 120 100 80 60 40 20 0 Seconds Utilization % 16
    • 14. Oracle Enterprise Manager Grid ControlSun ZFS Storage Appliance Monitor performance of ZFS storage directly from EM Grid Control along with DB apps Dynamic real-time visualization of application and storage related workloads Customizable dashboards Used extensively by Oracle IT groups17 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 15.  Oracle IT and Storage StrategyProgramAgenda  NAS Storage Configurations and Performance  Oracle IT Disk Use Cases  Cloud IT Backup and Recovery  Oracle on Oracle vs. Legacy Solutions  Backup and Recovery Platform Overview  Backup and Recovery Best Practices  Next Steps18 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 16. ZFS Storage in Product Development• SPARC Ranch – SPARC Simulation and Testing Environment• Compute FARM – Build/Integration, LRG, Metadata, Transaction Results• Environment Management System (EMS) – Fusion, eBiz, Siebel, Enterprise, BEA, Agile• Virtualization – Dynamic FARM, VM primary OS, VM secondary storage20 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 17. Testing in Production: SPARC SPARC CPU Simulations• 43 ZFS Storage Appliances serve a very large compute grid for CPU and system design• 1.32 Peta Byte of data in production on ZFS• More than 4500 file systems• Better than 2:1 space savings with built-in data compression• More than 125,000 computing jobs hit ZFS storage every day• More than 2000 hosts and more than 46K CPUs use ZFS storage every day 21 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 18. Compute FARM FARM Scheduler Submit Job Mgmt Partitioning Highlights Developer Notification Priority Match Making Resource Mgmt• A development and testing environment Oracle Enterprise Manager• Offloads local development and QA systems Grid Control• Enables parallel processing of builds and tests• Creates test baseline as part of label creation process• A label is a string, set of files, a snapshot of development process at any given time Sun 7410c Sun x4170• Compute Farm (9,800 hosts) includes both Static and Dynamic Farm systems – Capacity of 235K compute hours per day ZFS Storage Sun x4170 – Completing 90K farm jobs per day Build, Metadata, Transaction, FARM systems Farm Results, Transaction Results, Build/Integration, Source Code ADE Label Servers Automated testing 22 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 19. Compute FARM Functions: Build/Integration, LRGs, Metadata, Results Total filers – 8 (480TB raw, 200TB usable) MirrorMetrics Typical FARM filer – Metrics • ZFS storage is 12x faster compared to EMC 7410 ZFS storage Average Maximum storage involving Farm results purge activity CPU 10% 49% – ZFS: <15 minutes to purge 1TB farm results IOPS 14,000 126,000 – EMC: >180 minutes to purge 1TB farm results Throughput 300 MB/s 750 MB/s • ZFS storage is 5x faster compared to EMC Number of volumes per filer 2 4 storage involving DB test suite execution for Volume size 10TB 18TB 4800 Farm jobs Typical FARM – Workload – ZFS: consume 381 hours to copy over 828GB of Daily average writes 18TB 34TB test results from farm hosts to ZFS storage Daily average purge 18TB 34TB – EMC: consume 387 hours to copy over 170GB of # of files written / day 25-35 million 40-50 million test results from farm hosts to EMC storage Files written < 10K 60% 90% Files written < 100K 8% 25% EMC storage – Celerra NSX / Symmetrix DMX 2000/1000 Files written > 100K < 10000K <1% 10% Storage features used NFS v324 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 20. Environment Management System (EMS) B ig IP Highlights EMS W e b S e rv e rs EMS UI• Environment Management System (EMS) simplifies the process of creating, deploying and managing environments EMS EMS• G r id S e r v e r s D a ta b a s e S e rv e rs EMS can be used to manage different types of environments, such as various EM S daem on, S to r a g e m g m t , releases of Oracle E-Business Suite, S lo t m g m t Oracle Database, Oracle Fusion Apps, PeopleSoft, Siebel and stripped down EMS version of application environments S e rv e rs Z F S S to ra g e SSH daem on, P r o je c t,• Leverages storage clone technology H o s tin g z P o o l, E n v ir o n m e n ts S h a re s Su n x4170 Sun Su n 7410c ZFS x4170 S to ra g e 25 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 21. Environment Management System (EMS)Metrics Functions: Fusion, eBiz, Siebel, Enterprise, BEA, Agile Total filers – 28 (2418TB raw, 1528TB usable) RAIDz1, Mirror • ZFS storage handles >500 up to 1200 Typical EMS filer – Metrics volumes and beyond, while NetApp’s hard 7410 ZFS storage Average Maximum limit is 500 only CPU 10% 49% – ZFS: Ability to use 100% of usable capacity IOPS 8,000 88,000 – NetApp: 30-40% capacity unusable in large Throughput 140 MB/s 650 MB/s filers (42TB/filer) No. of volumes/clones per filer 200 500 • ZFS storage is 2x faster w/ 2x Mirror profile Volume size 300GB 1TB Typical EMS – Workload comparing NetApp EMS Fusion Total clones on ZFS 2535 2535 environments: Total full clones on ZFS 2894 2894 – Time taken for refresh slot from template Clones per filer 85 234 • ZFS – 30:46 mins (LRGV1S64) Full clones per filer 100 280 • NetApp – 53:20 mins (LRGV1S64) Storage features used NFS v3, Snapshots, Clones NetApp storage – FAS6070, FAS3070, FAS3170 Total EMS environments on ZFS – 542926 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 22. Virtualization – Dynamic FARMHighlights• Compute resource – Pre release starvation, Post release availability• Ability to switch FARM hosts OS type/version quickly• Reduction of compute resource loss• Use of virtualization and 10G network for performance• Use of automation to achieve consistent configuration• Use of storage cloning features for rapid deployment27 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 23. VM01 VM02 VM03 VM04 VM05 VM06 VM07 VM08 VM09 VM10 VM11 VM12 /scratch & OS swap Label Server / Cache HDD /scratch & OS swap Misc Infrastructure HDD /scratch & OS swap swap /scratch & OS Farm Storage HDD /scratch & OS swap Boot VM’s from clones on NAS storage HDD /scratch & OS swap swap /scratch & OS HDD /scratch & OS swap HDD /scratch & OS swap swap /scratch & OS HDD /scratch & OS swap HDD /scratch & OS swap swap /scratch & OS Sun x4170-M2 HDD Hypervisor /scratch & OS swap Sun x4170-M2 HDD Hypervisor /scratch & OS swap swap HDD x4170-M2 /scratch & OS HDD Hypervisor /scratch & OS swap HDD /scratch & OS swap swap Sun HDD /scratch & OS 10/20G HDD /scratch & OS swap HDD /scratch & OS swap swap /scratch & OS /scratch & OS swap HDD /scratch & OS swap swap /scratch & OS HDDDynamic FARM – Architecture /scratch & OS swap Distribution Switch HDD /scratch & OS swap swap /scratch & OS HDD /scratch & OS swap Cisco 6509 Insert Information Protection Policy Classification from Slide 12 HDD /scratch & OS swap swap /scratch & OS HDD /scratch & OS swap HDD /scratch & OS swap swap /scratch & OS HDD /scratch & OS swap /scratch & OS swap 2x20G 10G Sun Opus TOR Switch 4x10G Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Windows VM..N VM04 VM03 VM02 VM01 ZFS 7410 Storage Master Image Clones Solaris VM..N VM04 VM03 VM02 VM01 Linux VM..N VM04 VM03 VM02 VM01 28
    • 24. Dynamic FARM – Deployment29 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 25. What We Have Learned• High consolidation ratio – “Green Savings” – power, space, cooling• Hardware configuration options – defined pre-rack configuration• Analytics – ability to understand in-depth work load specifics• RAID options – choose profile based on performance vs. capacity vs. data protection• Shadow migration – Easy migrations from any NFS server to ZFS Storage• Very high thresholds – Ability to handle high number of volumes, directories, clones – exceeds other vendors by >5x times31 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 26. IT Uncovered Massive Benefits32 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 27.  Oracle IT and Storage StrategyProgramAgenda  NAS Storage Configurations and Performance  Oracle IT Disk Use Cases  Cloud IT Backup and Recovery  Oracle on Oracle vs. Legacy Solutions  Backup and Recovery Platform Overview  Backup and Recovery Best Practices  Next Steps33 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 28. Introduction: Oracle Cloud ServicesBackup and Recovery  Provide backup and recovery of our hosted customers environments  5500+ Oracle Databases  5 Sites worldwide  Protection of ZFS-SA, Exadata, Exalogic, Exalytics  RMAN, NDMP, FS Backups  Onsite and Offsite protection34 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 29.  Oracle IT and Storage StrategyProgramAgenda  NAS Storage Configurations and Performance  Oracle IT Disk Use Cases  Cloud IT Backup and Recovery  Oracle on Oracle vs. Legacy Solutions  Backup and Recovery Platform Overview  Backup and Recovery Best Practices  Next Steps35 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 30. Cloud Services Backup InfrastructureOracle on Oracle vs. Legacy Solutions 1/4 Complexity 4x Larger Library Desinty 35% VS Less Floor Space 64% more Data Stored 6x Fatser with 4% Fewer Drives 45% Less Media36 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 31. Oracle Cloud Services Backup and RecoveryKey Oracle on Oracle Advantages  Reduced Man Power – Vaulting went from a full time task for 2 people down to a part time task for 1 person  Fault Isolation – Redundancy built in at more layers then legacy  Security – More flexible with drive based encryption – T10000c offers FIPS to be required permanently – Robust Secure Key Storage and Access37 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 32. Solving Backup and Recovery Deployment Complexity Traditional Approach First integration Staff focused Collection of Complex matrix is in our on making vendors of products data center it work Cloud IT’s Approach     One point of Engineered to Tested & proven Staff focused on accountability work together architecture strategic projects38 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 33.  Oracle IT and Storage StrategyProgramAgenda  NAS Storage Configurations and Performance  Oracle IT Disk Use Cases  Cloud IT Backup and Recovery  Oracle on Oracle vs. Legacy Solutions  Backup and Recovery Platform Overview  Backup and Recovery Best Practices  Next Steps39 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 34. Oracle Cloud Services Backup and RecoveryPlatform Components  Enterprise Tape Library – SL3000  Tape Drives – StorageTek T100000c, StorageTek LTO4/5  Encryption – Oracle Key Manager  Library Management – StorageTek Automated Cartridge System Library Software (ACSLS)  Centralized Tape Backup Management – Oracle Secure Backup40 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 35. High Level Standard Solution Diagram 1. ACSLS Server Addition 2. Even / Odd • Drives • ACSLS/Library • Servers 3. 50% Fault Isolation 4. Double the robotic moves at once 5. Reduced Drive Count per Library41 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 36. High Level OSB to ACSLS / Library Layout 1. More then 1 Logical Library per OSB Domain 2. Even / Odd • Drives • ACSLS/Library • Servers 3. More then 1 OSB Domain per physical library 4. 50% Fault Isolation 5. Double the robotic moves at once42 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 37. Mini Redundant Level Solution Diagram Mini redundant high level counts draft 1.2 --scorso DC2-C14 (Day 1) 1. Big impact, small Initial 2 media servers + Admin Mini LIB 1 4 FC SAN to Grid(s) 6 FC IP (10gbe) to Grid(s) Mini LIB 2 foot print 9 Copper (FE+Ilom) to Grid(s) 34 fiber ports to GRID/Patch Encryption 34 fiber ports to Grid(s) 34 copper ports to Grid/Patch 13 Copper (MGMT/FE, SVC, Ilom) to Grid(s) 34 copper ports to Grid(s) Possible future growth to 58 of each type ACSLS Possible future growth to 58 of each type 10 Copper (Mgmt/FE, NFS, Ilom) to Grids(s) 4 FC (SAN to Brocade) 2. Even / Odd DEM Base DEM Base 42 42 41 41 Fiber to zones in DC02 42 42 41 41 42 42 41 41 42 41 42 41 • Drives 40 40 40 40 40 40 4040 39 39 39 39 39 39 3939 • 38 38 38 38 38 38 ACSLS/Library 38 38 37 37 37 37 37 37 3737 36 36 36 36 36 36 3636 35 35 35 35 35 35 3535 34 34 34 34 34 34 3434 33 33 33 33 33 33 3333 32 32 32 • 32 32 32 32 32 31 OSB/Backup PRI OPUS 31 31 Aggregation/ 31 Servers 31 31 31 31 30 30 1U Cable Manager 30 30 30 30 3030 29 29 OSB/Backup SEC OPUS 29 29 29 29 Backup 2929 28 28 1U Cable Manager Catalys t 29 60 G Serie s 28 28 28 28 Storage 2828 27 1 2 3 4 5 6 7 8 9 1 0 1 1 1 2 1 3 14 15 16 1 7 1 8 1 9 20 21 2 2 2 3 24 2 5 26 27 2 8 2 9 3 0 31 32 33 3 4 3 5 3 6 3 7 3 8 39 40 4 1 42 43 4 4 27 OOB Network 27 27 1X 1 1 X 13 X 2 3 X 25 X 35 X 3 7X 43 X 27 SY S T RP S ST AT D UP L X SP E ED M O DE 2 X 12 X 14 X 2 4 X 26 X 3 6 X 38 X 2960 44 X 45 4 6 47 48 27 27 27 26 26 1U Cable Manager 26 26 26 26 2626 25 25 P S1 P S2 FA N S T AT U S 1 2 3 4 5 6 7 8 9 10 11 12 OSB Pri 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 4948E-F 40 41 42 43 44 45 46 47 48 CO N MG T 45 46 47 48 25 25 25 25 2525 24 24 1U Cable Manager 24 24 24 24 2424 23 23 PS1 PS2 F AN S TA T US 1 2 3 4 5 6 7 8 9 10 11 OSB Sec 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 4948E-F 40 41 42 43 44 45 46 47 48 C ON MG T 45 46 47 48 23 23 23 23 2323 22 22 1U Cable Manager 22 22 22 22 2222 21 21 21 21 21 21 2121 20 20 20 20 20 20 ACSLS 2020 1U Cable Manager 19 ACSLS 19 19 19 19 19 19 19 3. 50% Fault Isolation 18 18 18 18 18 18 OK O O K K OK OK OK OK OK OK S u n F ire X 42 70 3 7 REA R PS TOP FA N 5 12 15 1818 2 6 4 11 14 17 BKP-MGMT 17 1 5 9 DVD 17 S AT A DV D 17 OK OK OK 0 4 8 10 13 17 17 17 17 OK OK OK OK OK 16 16 16 16 16 16 KMA02 1616 Local OKM Cluster 15 15 15 KMA01 15 15 15 15 15 Replicates to Remote(s) 14 14 14 14 Growth 14 14 14 14 13 13 13 13 13 13 1313 12 12 12 12 12 12 media server 1212 16- drives per 11 11 11 11 11 11 media server 1111 server pair 10 10 10 media server OSB 10 10 10 10 10 9 9 9 9 9 9 media server 99 8 8 8 media server Servers 8 8 8 8 8 7 7 7 7 7 7 media server 77 6 6 6 6 6 6 media server 66 5 5 5 5 5 5 media server 55 4 4 4 4 4. Balance slots to S u n F i re X 42 70 4 4 4 4 OK OK OK OK REA R PS OSB admin server OK OK OK OK OK TOP FA N 3 7 5 12 15 3 2 6 4 11 14 3 1 5 9 3 DVD 3 S AT A DV D 0 4 8 10 13 OK OK OK 3 3 3 3 OK OK OK OK OK 2 2 2 2 2 2 OK OK OK OK S un Fi re X 427 0 RE AR 2 2 2U Cable Manager PS Osb admin server 2 O K OK OK OK OK TOP FAN 3 7 5 12 15 1 2 6 4 11 14 1 1 1 5 9 DV D 1 S A TA D V D 0 4 8 1 0 13 OK OK OK 1 1 1 1 GRID OK OK OK OK OK GRID drives as required LIB 1 LIB 2 Grid(s) (Future as built) 1 Admin, All media servers, Encryption 5. Interchangeable with 16 FC SAN to Grid(s) 18 FC IP (10gbe) to Grid(s) 40 Copper (FE+Ilom) to Grid(s) our Enterprise deployment43 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 38.  Oracle IT and Storage StrategyProgramAgenda  NAS Storage Configurations and Performance  Oracle IT Disk Use Cases  Cloud IT Backup and Recovery  Oracle on Oracle vs. Legacy Solutions  Backup and Recovery Platform Overview  Backup and Recovery Best Practices  Next Steps44 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 39. Best Practices Data Availability - ProtectionProducts  Data Guard  RMAN  RMAN: Offsite  ZFSSA: Replication  RMAN  ZFSSA: Snapshots  Oracle Tape: Onsite  Oracle Tape  ZFSSA: Snapshots  ZFSSA: Replication  Oracle Tape: Offsite  Oracle Tape: Onsite Minutes-Hours Hours Retention FlexibilityUse Case  Business Critical  User Error  Business Requirements  Geographic Migration  Data Corruption  DB Refresh/Copy  Fault Protection  Remote access to data  User Error protection  Fault Protection  Disaster Recovery  Remote Disaster Recovery 45 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 40. Best Practices Security: Tape Encryption with Oracle Key Manager Highly Available Simple Secure Accessible46 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 41. Best Practices Infrastructure Deployments: OSB, ACSLS, STK Libraries, OKM Redundant Scalable Efficient Flexible47 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 42.  Oracle IT and Storage StrategyProgramAgenda  NAS Storage Configurations and Performance  Oracle IT Disk Use Cases  Cloud IT Backup and Recovery  Oracle on Oracle vs. Legacy Solutions  Backup and Recovery Platform Overview  Backup and Recovery Best Practices  Next Steps48 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 43. Next StepsRelated Sessions At OOW 2012  Bullets are sentence case. Use Arial, 20 pt font. – Sub-bullets are Arial, 18 pt font.49 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 44. Next StepsOnline Resources  Bullets are sentence case. Use Arial, 20 pt font. – Sub-bullets are Arial, 18 pt font.50 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 45. 51 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12
    • 46. 52 Copyright © 2012, Oracle and/or its affiliates. All rights reserved. Insert Information Protection Policy Classification from Slide 12

    ×