More Related Content
Similar to 5 here today still here tomorrow new technology for big_forever_archives
Similar to 5 here today still here tomorrow new technology for big_forever_archives (20)
More from Dr. Wilfred Lin (Ph.D.)
More from Dr. Wilfred Lin (Ph.D.) (20)
5 here today still here tomorrow new technology for big_forever_archives
- 1. Here Today, Still Here Tomorrow:
New Technology for Big, “Forever” Archives
Benny K. Chan
Senior Sales Consultant, Oracle Systems Hong Kong
October 18, 2013
1
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 2. Safe Harbor Statement
The following is intended to outline our general product direction. It is
intended for information purposes only, and may not be incorporated into
any contract. It is not a commitment to deliver any material, code, or
functionality, and should not be relied upon in making purchasing decisions.
The development, release, and timing of any features or functionality
described for Oracle’s products remains at the sole discretion of Oracle.
2
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 3. Archive & Backup
Big Data
Grow
>50% of
workloads now
virtualized
Data & Content
Grow
Backup Window
Doesn’t Grow
3
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Data Center Floor Space
Doesn’t Grow
Confidential – Oracle Internal
Digital Multimedia
Data Grow
Budget for Storage
Expansion
NEVER Grow
- 4. Archive Versus Backup
Storage Requirements And Use Cases Are Different
Archive
Backup
•
Duplicate copy of
active data
• For Recovery
4
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
•
Original copy of
inactive data
• Ready to access
anytime
- 5. Oracle Database Backup
Oracle Optimized Solutions for Backup & Recovery
Performance
Throughput
FC – 4Gb/8Gb
DB
Server
Data Integrity
SAN
Replication
FC
Shared
SAN
Storage
5
SAN Replication
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
Backup
SAN Storage
Data Size
Storage
Capacity
- 6. Oracle Database Backup
Oracle Optimized Solutions for Backup & Recovery
Performance
Throughput
IB – 40Gb +
FC – 4Gb/8Gb
Direct NFS
DB
Server
Data Integrity
Data Integrity
ZFS
SAN
Checksum
Replication
work w/ RMAN
IB
Shared
SAN
Storage
6
SAN Replication
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
Oracle
ZFS Storage
Data Size
Data Size
Hybrid
Storage
Columnar
Capacity
Compression
- 7. Exceptional Performance for Oracle RMAN
Backup/Restore
Performance
• Infiniband w/ Highest BW 40Gbps
• Direct NFS (Optimized NFS Client for Oracle DB)
Data Integrity
• ZFS checksumming working with RMAN
Data
Compression
• Hybrid Columnar Compression (HCC)
3x – 5x less storage capacity
Faster backup/restore Shorter backup window
7
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 8. One of the Largest Logistic Companies in HK
Oracle Database Backup by
RMAN via IB + Direct NFS + HCC + ZFS Storage
35%
Faster Backup & Restore Rate w/ Better Data Protection
8
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 9. ZFS Storage – Best Support in Test/Dev/UAT
• Oracle Snap Management Utility for Oracle Database
• Specifically engineered to work with the ZFS Storage
• ZFS Copy-on-Write (Snap/Clone)
• Nearly instantaneous creation
• Near zero space consumption before delta change in clone
Better
Storage Efficiency
9
Lower
TCO
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 10. One of the World Largest Providers of Electric
Components in HK
ZFS Storage
meets the
Test/Dev
Requirements
Clone 10 copies of a 7TB
Database for Test/Dev in
1 hour DAILY
80% Less in Storage Capacity
10
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 11. Well Documented
On Oracle Database Backup/Restore
Backup and Recovery with Oracle’s Sun ZFS Storage Appliances and Oracle Recovery
Manager
http://www.oracle.com/us/products/servers-storage/storage/nas/zfs-storage-appliance-rman-db-507914.pdf
Sun ZFS Storage Appliance: Solution for Database Backup and Recovery
http://www.oracle.com/us/products/servers-storage/storage/nas/s7000-databasebur-150371.pdf
Oracle Secure Backup – High-Performance Tape Backup for Oracle Environments
http://www.oracle.com/technetwork/products/secure-backup/learnmore/osb-103-twp-166804
Oracle Optimized Solution for Backup and Recovery
http://www.oracle.com/technetwork/server-storage/hardware-solutions/oos-backup-recovery-1973210.pdf
11
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 12. Tape Backup
Not only for Better TCO but also…
To protect data losses against Software bugs,
viruses, application errors, human errors, terrorist
attacks.
Google GMAIL loss of data in Feb 2011 – Impacted 600,000 users
• Software bugs affected several copies of data on DISK backup
• Data was restored from TAPE. Offline tape were protected from the bugs
Gmail Blog Monday Feb 28, 2011
http://gmailblog.blogspot.com/2011/02/gmail-back-soon-for-everyone.htm
12
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 13. When NERSC read nearly 24,000 StorageTek
enterprise cartridges (approximately 15 million
meters of tape...)
of cartridges were read 100% error free after 12+ years
Source: Mark Peters, ESG Technology Brief, http://www.oracle.com/us/corporate/analystreports/corporate/esg-nersc-case-study-202702.pdf
13
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 14. Why Tape is more sustainable
Than Disk-only
Disk
Tape
Max shelf life (bit rot)
10 years
30 years
Best practices for data migration to new
technology
4-5 years
8-10 years
290X
X
10-15
( ~100TB)
10-22
(~100TB)
Power and cooling
Uncorrected Bit Error Rate
Probability (avg 1 error in x TB)
Tape is always an essential tier for:
Backup and Archive
14
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 15. New Technology for Big, “Forever” Archives
A variety of factors are driving a mindset of “keep everything forever.”
Cultural
Preservation
Business
Opportunity
Data & Content
Growth
15
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Compliance &
E-Discovery
Digitization
Confidential – Oracle Internal
- 16. Archive Data Lifecycle
Amount of Data Versus Usage
Data
Created
Active Use
Data
Retrieval
frequency /
usage
increasing
Less Frequent Use Data
Rare Use Data
16
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
Amount of data
in archive
increasing
- 17. Tiered Storage
Optimize Retrieval Time Versus Cost
Data
Created
Active Use
Data
Performance Disk
Less Frequent Use Data
Capacity Disk
Tape
Rare Use Data
17
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 18. Economics of Tiered Storage
Tape is the foundation: most of the data; lowest cost
Single
Tier of Disk
Storage
Disk
Multi-tiered Storage
Modern
Multi-tiered
Storage
2%
3%
20%
100%
Average
~$13,500,000/PB
18
80%
Average
~$11,000,000/PB
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
Flash Storage
$50 - $100/GB
Performance Disk
$7 - $20/GB
15%
Capacity Disk
$1 - $8/GB
80%
Tape Storage
$0.1 - $0.2/GB
Average
~$700,000/PB
Source: Horison Information Strategies,
Digital Curator Paper, Average Selling Prices, updated with T10000C
- 19. Oracle Storage is Engineered for Archiving
Industry Leading Scalability
Pillar Axiom
Storage
Maximum
Capacity*
ZFS Disk
Storage
StorageTek
Tape
1.66 PB / sys.
3.5 PB / sys.
2.1 EB / sys.
* Uncompressed
19
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 20. Storage Archive Manager (SAM-QFS)
SAM-QFS Server
Tier 1 Disk
Tier 2 Disk
Tier 3 Tape
Open Storage Format
Policy-driven, No change in user experience
Transparent auto-tiering from disk to tape without IT operator
Oracle one-stop solution with SAM-QFS, Disk, Tape & Support
20
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 21. One of the Top HK Universities in Asia
CHALLENGE
SOLUTION
• 1TB growth every 3 days
• Long retention period for
• SAM-QFS with Better TCO,
research scientists
• Operation management
21
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
Auto-tiering, and Single-vendor
Support
- 22. One of the Major Teleco Providers in HK
500GB/day CDR Data Growth
Regulation to keep 7 years of data
Simplified data management + Lower TCO by
SAM-QFS Auto-tiering Archive Solution
22
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 23. Data Integrity Validation with SAM-QFS and T10000D
Enables customers to verify the data in their archive is accessible
T10KD can verify the integrity of data:
– When data is written
– When data is read
– At any other time (using the tpverify command)
Record DIV CRC
checked; write
and read
Records have DIV
CRC added at host
Records Sent to Tape with DIV CRC
23
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 24. Integrity For The Life Of Your Data
StorageTek Tape Analytics
• Monitors over 150
health attributes
• Simplifies tape
management
• Leverages intelligent
analytics
• Grow with peace of mind
24
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 25. What’s Next For Your
Forever Archive?
25
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal
- 26. 26
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Confidential – Oracle Internal