0
Here Today, Still Here Tomorrow:
New Technology for Big, “Forever” Archives

Benny K. Chan
Senior Sales Consultant, Oracle...
Safe Harbor Statement
The following is intended to outline our general product direction. It is
intended for information p...
Archive & Backup
Big Data
Grow
>50% of
workloads now
virtualized

Data & Content
Grow

Backup Window
Doesn’t Grow
3

Copyr...
Archive Versus Backup
Storage Requirements And Use Cases Are Different

Archive

Backup
•

Duplicate copy of
active data

...
Oracle Database Backup
Oracle Optimized Solutions for Backup & Recovery
Performance
Throughput
FC – 4Gb/8Gb

DB
Server

Da...
Oracle Database Backup
Oracle Optimized Solutions for Backup & Recovery
Performance
Throughput
IB – 40Gb +
FC – 4Gb/8Gb
Di...
Exceptional Performance for Oracle RMAN
Backup/Restore
Performance

• Infiniband w/ Highest BW 40Gbps
• Direct NFS (Optimi...
One of the Largest Logistic Companies in HK

Oracle Database Backup by
RMAN via IB + Direct NFS + HCC + ZFS Storage

35%
F...
ZFS Storage – Best Support in Test/Dev/UAT
• Oracle Snap Management Utility for Oracle Database
• Specifically engineered ...
One of the World Largest Providers of Electric
Components in HK
ZFS Storage
meets the
Test/Dev
Requirements

Clone 10 copi...
Well Documented
On Oracle Database Backup/Restore
Backup and Recovery with Oracle’s Sun ZFS Storage Appliances and Oracle ...
Tape Backup
Not only for Better TCO but also…

To protect data losses against Software bugs,
viruses, application errors, ...
When NERSC read nearly 24,000 StorageTek
enterprise cartridges (approximately 15 million
meters of tape...)

of cartridges...
Why Tape is more sustainable
Than Disk-only
Disk

Tape

Max shelf life (bit rot)

10 years

30 years

Best practices for d...
New Technology for Big, “Forever” Archives
A variety of factors are driving a mindset of “keep everything forever.”

Cultu...
Archive Data Lifecycle
Amount of Data Versus Usage

Data
Created
Active Use
Data
Retrieval
frequency /
usage
increasing

L...
Tiered Storage
Optimize Retrieval Time Versus Cost

Data
Created
Active Use
Data

Performance Disk

Less Frequent Use Data...
Economics of Tiered Storage
Tape is the foundation: most of the data; lowest cost
Single
Tier of Disk
Storage

Disk
Multi-...
Oracle Storage is Engineered for Archiving
Industry Leading Scalability
Pillar Axiom
Storage
Maximum
Capacity*

ZFS Disk
S...
Storage Archive Manager (SAM-QFS)
SAM-QFS Server

Tier 1 Disk

Tier 2 Disk

Tier 3 Tape

 Open Storage Format
 Policy-dr...
One of the Top HK Universities in Asia

CHALLENGE

SOLUTION

• 1TB growth every 3 days
• Long retention period for

• SAM-...
One of the Major Teleco Providers in HK
 500GB/day CDR Data Growth
 Regulation to keep 7 years of data

Simplified data ...
Data Integrity Validation with SAM-QFS and T10000D
Enables customers to verify the data in their archive is accessible

 ...
Integrity For The Life Of Your Data
StorageTek Tape Analytics
• Monitors over 150

health attributes
• Simplifies tape
man...
What’s Next For Your
Forever Archive?

25

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Confident...
26

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

Confidential – Oracle Internal
Upcoming SlideShare
Loading in...5
×

5 here today still here tomorrow new technology for big_forever_archives

178

Published on

Published in: Technology, News & Politics
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
178
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
4
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Transcript of "5 here today still here tomorrow new technology for big_forever_archives"

  1. 1. Here Today, Still Here Tomorrow: New Technology for Big, “Forever” Archives Benny K. Chan Senior Sales Consultant, Oracle Systems Hong Kong October 18, 2013 1 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  2. 2. Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle. 2 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  3. 3. Archive & Backup Big Data Grow >50% of workloads now virtualized Data & Content Grow Backup Window Doesn’t Grow 3 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Data Center Floor Space Doesn’t Grow Confidential – Oracle Internal Digital Multimedia Data Grow Budget for Storage Expansion NEVER Grow
  4. 4. Archive Versus Backup Storage Requirements And Use Cases Are Different Archive Backup • Duplicate copy of active data • For Recovery 4 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal • Original copy of inactive data • Ready to access anytime
  5. 5. Oracle Database Backup Oracle Optimized Solutions for Backup & Recovery Performance Throughput FC – 4Gb/8Gb DB Server Data Integrity SAN Replication FC Shared SAN Storage 5 SAN Replication Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal Backup SAN Storage Data Size Storage Capacity
  6. 6. Oracle Database Backup Oracle Optimized Solutions for Backup & Recovery Performance Throughput IB – 40Gb + FC – 4Gb/8Gb Direct NFS DB Server Data Integrity Data Integrity ZFS SAN Checksum Replication work w/ RMAN IB Shared SAN Storage 6 SAN Replication Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal Oracle ZFS Storage Data Size Data Size Hybrid Storage Columnar Capacity Compression
  7. 7. Exceptional Performance for Oracle RMAN Backup/Restore Performance • Infiniband w/ Highest BW 40Gbps • Direct NFS (Optimized NFS Client for Oracle DB) Data Integrity • ZFS checksumming working with RMAN Data Compression • Hybrid Columnar Compression (HCC) 3x – 5x less storage capacity Faster backup/restore  Shorter backup window 7 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  8. 8. One of the Largest Logistic Companies in HK Oracle Database Backup by RMAN via IB + Direct NFS + HCC + ZFS Storage 35% Faster Backup & Restore Rate w/ Better Data Protection 8 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  9. 9. ZFS Storage – Best Support in Test/Dev/UAT • Oracle Snap Management Utility for Oracle Database • Specifically engineered to work with the ZFS Storage • ZFS Copy-on-Write (Snap/Clone) • Nearly instantaneous creation • Near zero space consumption before delta change in clone Better Storage Efficiency 9 Lower TCO Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  10. 10. One of the World Largest Providers of Electric Components in HK ZFS Storage meets the Test/Dev Requirements Clone 10 copies of a 7TB Database for Test/Dev in 1 hour DAILY 80% Less in Storage Capacity 10 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  11. 11. Well Documented On Oracle Database Backup/Restore Backup and Recovery with Oracle’s Sun ZFS Storage Appliances and Oracle Recovery Manager http://www.oracle.com/us/products/servers-storage/storage/nas/zfs-storage-appliance-rman-db-507914.pdf Sun ZFS Storage Appliance: Solution for Database Backup and Recovery http://www.oracle.com/us/products/servers-storage/storage/nas/s7000-databasebur-150371.pdf Oracle Secure Backup – High-Performance Tape Backup for Oracle Environments http://www.oracle.com/technetwork/products/secure-backup/learnmore/osb-103-twp-166804 Oracle Optimized Solution for Backup and Recovery http://www.oracle.com/technetwork/server-storage/hardware-solutions/oos-backup-recovery-1973210.pdf 11 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  12. 12. Tape Backup Not only for Better TCO but also… To protect data losses against Software bugs, viruses, application errors, human errors, terrorist attacks. Google GMAIL loss of data in Feb 2011 – Impacted 600,000 users • Software bugs affected several copies of data on DISK backup • Data was restored from TAPE. Offline tape were protected from the bugs Gmail Blog Monday Feb 28, 2011 http://gmailblog.blogspot.com/2011/02/gmail-back-soon-for-everyone.htm 12 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  13. 13. When NERSC read nearly 24,000 StorageTek enterprise cartridges (approximately 15 million meters of tape...) of cartridges were read 100% error free after 12+ years Source: Mark Peters, ESG Technology Brief, http://www.oracle.com/us/corporate/analystreports/corporate/esg-nersc-case-study-202702.pdf 13 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  14. 14. Why Tape is more sustainable Than Disk-only Disk Tape Max shelf life (bit rot) 10 years 30 years Best practices for data migration to new technology 4-5 years 8-10 years 290X X 10-15 ( ~100TB) 10-22 (~100TB) Power and cooling Uncorrected Bit Error Rate Probability (avg 1 error in x TB) Tape is always an essential tier for: Backup and Archive 14 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  15. 15. New Technology for Big, “Forever” Archives A variety of factors are driving a mindset of “keep everything forever.” Cultural Preservation Business Opportunity Data & Content Growth 15 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Compliance & E-Discovery Digitization Confidential – Oracle Internal
  16. 16. Archive Data Lifecycle Amount of Data Versus Usage Data Created Active Use Data Retrieval frequency / usage increasing Less Frequent Use Data Rare Use Data 16 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal Amount of data in archive increasing
  17. 17. Tiered Storage Optimize Retrieval Time Versus Cost Data Created Active Use Data Performance Disk Less Frequent Use Data Capacity Disk Tape Rare Use Data 17 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  18. 18. Economics of Tiered Storage Tape is the foundation: most of the data; lowest cost Single Tier of Disk Storage Disk Multi-tiered Storage Modern Multi-tiered Storage 2% 3% 20% 100% Average ~$13,500,000/PB 18 80% Average ~$11,000,000/PB Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal Flash Storage $50 - $100/GB Performance Disk $7 - $20/GB 15% Capacity Disk $1 - $8/GB 80% Tape Storage $0.1 - $0.2/GB Average ~$700,000/PB Source: Horison Information Strategies, Digital Curator Paper, Average Selling Prices, updated with T10000C
  19. 19. Oracle Storage is Engineered for Archiving Industry Leading Scalability Pillar Axiom Storage Maximum Capacity* ZFS Disk Storage StorageTek Tape 1.66 PB / sys. 3.5 PB / sys. 2.1 EB / sys. * Uncompressed 19 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  20. 20. Storage Archive Manager (SAM-QFS) SAM-QFS Server Tier 1 Disk Tier 2 Disk Tier 3 Tape  Open Storage Format  Policy-driven, No change in user experience  Transparent auto-tiering from disk to tape without IT operator  Oracle one-stop solution with SAM-QFS, Disk, Tape & Support 20 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  21. 21. One of the Top HK Universities in Asia CHALLENGE SOLUTION • 1TB growth every 3 days • Long retention period for • SAM-QFS with Better TCO, research scientists • Operation management 21 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal Auto-tiering, and Single-vendor Support
  22. 22. One of the Major Teleco Providers in HK  500GB/day CDR Data Growth  Regulation to keep 7 years of data Simplified data management + Lower TCO by SAM-QFS Auto-tiering Archive Solution 22 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  23. 23. Data Integrity Validation with SAM-QFS and T10000D Enables customers to verify the data in their archive is accessible  T10KD can verify the integrity of data: – When data is written – When data is read – At any other time (using the tpverify command) Record DIV CRC checked; write and read Records have DIV CRC added at host Records Sent to Tape with DIV CRC 23 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  24. 24. Integrity For The Life Of Your Data StorageTek Tape Analytics • Monitors over 150 health attributes • Simplifies tape management • Leverages intelligent analytics • Grow with peace of mind 24 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  25. 25. What’s Next For Your Forever Archive? 25 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  26. 26. 26 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Confidential – Oracle Internal
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×