More Related Content Similar to ZFS appliance (20) More from Fran Navarro (20) ZFS appliance1. Oracle’s ZS3 series
Enterprise Storage Systems
Fran Navarro
Preventa Sistemas Oracle
Nov 2013
1
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
2. Important Disclosure
The following is intended to outline our general product direction. It is
intended for information purposes only, and may not be incorporated into
any contract. It is not a commitment to deliver any material, code, or
functionality, and should not be relied upon in making purchasing
decisions.
The development, release, and timing of any features or functionality
described for Oracle‟s products remains at the sole discretion of Oracle.
2
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
3. Oracle is Driving the Storage System
Evolution
Application
Engineered Storage
Enterprise software drives system
performance and efficiency
Software-defined Storage
Storage software drives system
performance and efficiency
Hardware-defined Storage
Custom hardware drives system
performance and efficiency
3
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
4. Oracle ZS3 Storage
Application Engineered Storage
Extreme
Performance
World-record
performance and leading
price performance
4
Integrated
Analytics
Real-time visualizations
cuts troubleshooting
times by 50%
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Optimized for
Oracle Software
OISP cuts database tuning
times by 65%; HCC delivers
10-50X compression
5. ORACLE’S NEXT GENERATION
ZFS STORAGE APPLIANCE:
ZS3 SERIES
MOST EFFICIENT
5
BEST PERFORMANCE
ENGINEERED FOR ORACLE SOFTWARE
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
6. •
•
•
•
•
•
•
•
Oracle’s ZFS Storage Appliance
Strong and Steady Product Maturation
Analytics
2009
2010
•
•
•
•
•
•
1,000th Customer
Unified Storage (block)
InfiniBand
Replication
Thin Provisioning
Best-in-class User Interface
ZFS Filesystem
2008
6
• First Platform Release
- Compression, Replication, etc.
• Hybrid Storage Pool (with Flash)
• Analytics
• Development engaged in 2004
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
ZS3 series release
Software Release OS8
200PBs in Oracle *IT
World-record Performance
Oracle Database (OISP)
IaaS Offering
SMU/Oracle DB
DE2 Disk Enclosures
2011
•
•
•
•
•
•
•
2nd
Gen. Platform
Software Release OS7
Deduplication
Thin Provisioning
Enterprise RAS
Shadow Migration
Surpassed an Exabyte Stored
2013
2012
•
•
•
•
•
•
•
•
•
3,000th
Customer
10,000th system sold
Hybrid Columnar Compression
ZFS Backup Appliance
150PBs in Oracle *IT
Foundation for Oracle Cloud
Best-in-class SPC-1
Best-in-class SPC-2
Most efficient ($/IOP) SPECsfs
7. Engineered for Unified Storage
Storage OS
Application
I/O
NFS CIFS
IB
iSCSI
• Auto Administration
• System Analytics
• Virtual Storage Pools
• Dynamic Data Tiering
• Modular Scalability
• Oracle SW integration
FC
Virtual Pool
file, volume, and
data services
Compress
Thin
Provision
Dedup
Mirror,
RAID-Zx
Performance
Snap
Clone
Replication
Storage Pool
read flash, write
flash, and drives
Read
Intensive
I/O
Write
Intensive
I/O
Storage
-
Automates storage tiering (HSPs)
Eliminates distinct file and volume management
Concurrent block and file I/O, with shared data services
Multi-core, multi-threading RTOS
Data Integrity
- Entire I/O path validated before data stored
- Eliminates potential for bit rot, phantom writes, etc.
Analytics
- Comprehensive and precise file-level view
7
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
8. Oracle’s new ZS3 Series
ZFS Storage Operating System
• Most powerful storage software suite
• Engineered Integration with Oracle software
ZS3-2
2x Faster
3x More Scalable
OS8 Storage OS Support
•
•
•
•
•
•
Single or Dual Controllers
512GB DRAM
8 PCIe Slots
16 Disk Enclosures*
12TB Read Flash
4TB Write Flash*
* ZS3-2 will release with expansion to 8 disk enclosures. Scale to 16 expected within 6 months of release.
8
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
ZS3-4
•
•
•
•
•
•
Single or Dual Controllers
2TB DRAM
14 PCIe Slots
36 Disk Enclosures
12TB Read Flash
10TB Write Flash
9. Software | Hybrid Storage Pools
80 CPU cores
2TB Memory
12TB Read Flash
10TB Write Flash
9
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
10. DISK
30.00ms
Hybrid Storage Pool
Dynamically Serve 70-90%
of I/O from DRAM
Not to Scale
Introduced first by Oracle on
ZFS Storage Appliances in 2008
FLASH
0.10ms
DRAM
0.03ms
Storage Media Latencies
10
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
11. Comprehensive Suite of Enterprise Software
Data protocols
• Fibre channel
•
•
•
•
•
•
•
•
•
•
iSCSI
InfiniBand over IP/RDMA
iSER
SRP
NFS V3 and V4
CIFS
HTTP
WebDAV
FTP/SFTP/FTPS
ZFS NDMP V4
Data services
• OISP
• Hybrid Columnar Compression
• Hybrid Storage Pools
• Single, double and triple-parity RAID
(RAIDZ, RAIDZ2,RAIDZ3)
• Mirroring and triple mirroring
• End-to-end data integrity
• Local and remote replication
• Snapshots and clones
• Quota(s)
• In-line deduplication
• Compression
• Thin provisioning
• Antivirus via ICAP protocol
• Online data migration
• Clustering
11
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Management
• Browser and CLI interface
• Management dashboard
• Hardware/component view
• Role-based access control
• Phone home
• Event and threshold
based alerting
• Storage analytics
• Scripting
• Workflow automation
• Advanced networking
• Snap Management Utility
• Source aware routing
12. Majority of the Fortune 100
Rely on Oracle ZFS Storage
12
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
13. Majority of the Top 10 Global Banks
Rely on Oracle ZFS Storage
13
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
14. Oracle‟s ZFS Storage is the fastest
growing major storage vendor
14
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
15. Over 150 companies switch from
NetApp and EMC to Oracle ZFS
Storage every quarter…
15
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
17. Best Performance
2x Faster than NetApp in OLTP, 2x Faster than NetApp in File serving,
4x Faster than NetApp in OLAP/DSS, 4x Faster than NetApp in VDI/VM
4x Faster than NetApp in Backup, 5x Faster than NetApp in Restores.
#1
Most Efficient
85% Smaller backup windows than NetApp, 44% Faster trouble-shooting than
NetApp, 2x Better price/performance in OLTP than NetApp, 5x Better
price/performance in File serving than NetApp, #1 in Analytics and HSPs.
#1
Engineered for
Oracle Software
Only NAS vendor with Hybrid Columnar Compression, Only NAS vendor with
Oracle Intelligent Storage Protocol, Only NAS vendor engineered with ADG.
, Only NAS vendor that enables the full-featured Oracle 12c ADO capability.
#1
Storage for Oracle
*IT and Cloud
Only NAS vendor with over 225PBs in enterprise environments that get updated
before customers use the latest firmware releases. Only NAS with NFS cloud
environment generated 3.2B database transactions per hour.
#1
17
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
18. ZFS Storage Appliances
Engineered for extreme performance.
Increase database responsiveness.
Expedite large data queries.
Minimize backup windows.
18
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
18
19. Oracle’s ZS3 Storage
The Fastest Storage System Available
4-6X more efficient than every other storage product
17.3 GB/s @ $23/MB/s
World-record performance, streaming and on-line application processing (SPC-2)
has never exceeded
13GB/s @ $88/MB/s
19
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
has never exceeded
15GB/s @ $131/MB/s
has never exceeded
13GB/s @ $95/MS/s
20. Oracle’s ZS3 Storage
The Fastest Storage System Available
5-8X better $/IOP than everything in its class
450K IOPS / 700μs
Best-in-Class application responsiveness and performance (SPECsfs)
Best is 1.2ms with FAS6240 and
100K IOPS / 1.7ms on FAS3250
20
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Best is 3.2ms, 456K IOPS with a
56 node Isilon system
21. Best Performance is Not Enough
21
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
22. 87% of Storage Costs Are the Result
of Inefficient Systems or Software
Source: Oracle Customer Advisory Boards
22
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
23. ZFS Storage Appliances
Industry-leading storage efficiency.
Eliminate the time required to assess, tune, and deploy storage tiers.
Minimize the time it takes to trouble-shoot and resolve IT issues.
Eliminate management of disparate files and volumes.
23
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
23
24. Management Efficiency | Analytics
•
•
Visualize CPU, cache, protocol, disk,
memory, networking, and system-related
data, all at the same time.
•
Drill down quickly on areas of concern
•
Support multiple simultaneous application
and workload analysis in real-time, to help
compare various aspects of system stress
•
24
Industry‟s most comprehensive real-time
visualization of application- and storagerelated workloads (on right picture of
database and table index analytics)
Analysis can be saved, exported and
replayed for further analysis
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
MOST
EFFICIENT
25. ZFS Appliance Dashboard
Monitoring at a glance
• Starting point for
appliance analysis
– Ideal for single device
monitoring
• Real-time updates to
graphical view of
operations
– Utilization and alerts
easy to identify
25
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
26. ZFS Storage Appliance Analytics
Automatic real-time visualization of application and storage workloads
• Simple yet sophisticated
instrumentation
• Available on all ZFS Storage
Appliance models
• Analysis can be saved, exported
and replayed for further analysis
26
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
28. Statistics
• Statistics are a collection of data
displayed and graphed by ZFS
Analytics
• Every layer of the stack has available
statistics
–
–
–
–
28
CPU
Disk
Network
Protocols
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
29. Drilling Down into Statistics
• Statistics can be drilled down to form ad-hoc queries
– Which clients have the highest access rate on a certain day of the week?
– Which NFS operations are taking at least 2 milliseconds during high
production load?
– Which disks are seeing the most amount of activity over the past month?
29
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
30. Navigate Through Time
„Arrow‟ buttons move back and forth between the past and
present
„Pause‟ suspends the graph, but not data collection
„Zoom‟ buttons control the time scale of the graph
„Clocks‟ are pre-defined zooming to by-minute and by-hour
„Calendars‟ can display an entire day, entire week, or entire month
30
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
31. Worksheets
• A worksheet is a user-defined collection of statistics
• They are persistently saved and can be shared by users
• Handy for crafting just the family of statistics that are
relevant for your performance analysis
31
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
32. Phantom Workloads Exposed
File Level Visibility
• A user running a performance
test increases the load on the
storage in an unexpected way
and the storage administrator
can drill into the issue in real
time to understand where the
load is coming from.
32
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
36. ZFS Appliance Monitor
iPhone application that monitors multiple ZFS Storage Appliances
Brings the power of DTrace Analytics at your fingertips
Easily view the health/status of any ZFS Appliance, anywhere
Ideal for Execs/Storage Admins with need for instant access to information
Graphical and intuitive display of:
•
•
•
•
•
•
•
•
•
36
System and component status (disks, CPU, RAM, fans, etc)
Service status (NFS, iSCSI, SMB, etc)
Resource & I/O status
DTrace Analytics (real time statistics via saved worksheets)
Logs for alert, system, fault, audit, phone home
Active systems problems (can be marked as repaired via app)
High level group status including storage use, problems, hardware status
Storage utilization
Remote activation of system and component locator LED
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Available
now on
App Store
37. ZFSSA Monitoring and Management
monitoring with Enterprise Manager for single pane of glass
• Enterprise Grade Monitoring/Management Facility
– Comprehensive Dashboard View
• Central Repository for Analytics Storage
• Database Configuration, Hardware and Network Configuration
• Operational and Availability Analytics
– For Storage Platforms
• Information is collected by installed Plug-Ins
• Stored in real-time on the Oracle Enterprise Manager Repository
• For the Storage 7000
– Data collected by Dtrace Analytics and FMA
• Data is corroborative between SS7000 and OEMGC
• Includes capacity Utilization
• Cache usage and performance metrics
• Detailed Alerts
– Enables collaboration between the DBA and Storage Administrator
37
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
38. Oracle EM Cloud Control Plug-in for ZFSSA
ZFS Storage Appliances
• Oracle Enterprise Manager Cloud Control
(OCC) 12c communicates with the ZFSSA
appliance through a plug-in deployed to an
active OCC agent.
• The plug-in collects status and data from the
ZFSSA and relays it to the OCC
management server, which stores the data in
the OMS repository database.
• The ZFSSA plug-in formats screens and
reports in the OCC web interface.
38
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
39. Integrating ZFS with Enterprise Manager
Monitor ZFS appliances as part of the enterprise
• ZFS appliance becomes
an additional target to
monitor
• Provides method for nway monitoring of multiple
ZFSSA systems through
common EM interface
39
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
40. Wide Range of Individual Measurements
Complete set of metrics for system monitoring from EM
• Ability to monitor statistics
across all functions of the
appliance
–
–
–
–
–
Appliance status
Cache activity
Disk throughput
Network devices
Protocol activity
• Graphical view of metrics
40
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
41. ZFSSA – OEMCC Metrics
High Level Metric
Logical Status
Project Status
Configuration Service
Appliance Capacity Totals
Cache ARC
Cache L2ARC
CPU
Disk I/O Ops
Disk I/O Ops Latency
Disk I/O Bytes
Network Device
NFSv2 Ops
NFSv3 Ops
NFSv3 Ops Latency
NFSv4 Ops
SMB Ops
SMB Ops Latency
iSCSI Ops
iSCSI Ops Latency
Initiator and Target Groups
41
Sub-Metrics
High Level Metric
Sub-Metrics
Share identifier, Available (GB), Total allocated
(GB), Data (GB), Share percentage used, Quota
(GB), Reserved (GB), Unused Reserved (GB),
SCSI LUN
Project identifier, Available (GB), Total allocated
(GB), Project Data (GB), Project percentage
used, Quota (GB), Reserved (GB), Unused
Reserved (GB), Total Share Quota (GB), Project
Over Allocated
Service name, Service Status
Storage pool, Pool owner, Pool status, Data
profile, Available (GB), Total used (GB), Pool
used percentage, Total Capacity (GB), Data
disks, Spare disks, Cache Disks, Total project
quota (GB), Quota Allocation(GB), Reservations
(GB) Pool over allocated
Size (MB)
Size (MB)
Utilization %
Operations per Second
Operations per Second
KB per Second
KB per Second
Operations per Second
Operations per Second
Operations per Second
Operations per Second
Operations per Second
Operations per Second
Operations per Second
Operations per Second
Protocol, Group name, Address, Initiator or
target
ARC Activity
L2ARC Activity
ARC Activity by Share
L2ARC Activity by Share
NFSv3 Operations by Share
NFSv4 Operations by Share
Network IO Direction
Network IO by Device
Network Interface Performance
Activity, Accesses per sec
Activity, Accesses per sec
Share, Accesses per sec
Share, Accesses per sec
NFSv3 Share, Operations per sec
NFSv4 Share, Operations per sec
Direction, KB per sec
Device, KB per sec
Interface, KB per sec
Cluster state, Cluster state description, Cluster
peer state, Cluster peer state description
Reported node name, Product model, Appliance
serial nbr, Chasis serial nbr, Appliance SW
version, Install time, Last update time, Power on
time, Up time, Clustered, Cluster peer
Share identifier, Share type, Mount point, Data
profile, Data compression, Cache usage, NFS,
CIFS
Interface, IP Address, CIDR, IP Version,
Management enabled
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Physical Component Status
Appliance Information
Appliance Logical information
IP Network Interfaces
IP Network Interface to Datalink
relationship
Interface, Datalink, Jumbo frames
IP Datalink to device relationship Datalink, Link, Class
IP Network Devices
Network Device, Device speed, Device up
Problem ID, Time stamp, Alert description, Alert
Alert Log Contents
log problem type
Problem ID, Time stamp, Description, Fault log
Fault Log Contents
problem type
UUID, Description, Problem severity, Problem log
Problem Log Contents
code
Problem ID, Time stamp, Replication description.
Replication Activity
Replication log problem type
42. Set Custom Thresholds
Tune alerting to specific needs
• Manage alerting based
on specific limits
– Alerting can be turned on
or off, send messages
only on customer-defined
key metrics
– Generate alert levels
based on independent
system use cases
42
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
43. Expanded Reporting Features
Database relationship and Network performance monitoring
• Expanding monitoring through the Oracle stack
– Identify relationships between database and storage resources
– Track network performance
43
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
44. Redirect to Appliance for Detailed Management
Link directly from EM to launch ZFSSA GUI
• For more granular analysis
and control, link from the
appliance summary page
directly to the appliance
dashboard
– Will require ZFS appliance login
for security
44
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
45. Available Resources
Links
• Enterprise Manager Grid Control/Cloud Control
– http://www.oracle.com/us/products/servers-storage/storage/nas/oracleenterprise-grid-manager-ds-431598.pdf
– http://www.oracle.com/technetwork/oem/enterprisemanager/downloads/index.html
• ZFSSA EM Plug-in
– http://www.oracle.com/technetwork/oem/grid-control/downloads/zfsstorage-plugin-487867.html
– http://download.oracle.com/otn/java/oem/Oracle_GC_Plugin_InstallGuid
e.pdf
45
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
46. Oracle Software Runs
Fastest and Most Efficiently
on Oracle Storage
46
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
47. Application Engineered Storage
OISP
HCC
Dynamic and
automatic databasestorage tuning
47
ADO
Advanced and
dynamic database
(data) optimization
Superior
database, data
warehousing
compression
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
49. Oracle Intelligent Storage Protocol (OISP)
Cut Database and Storage Tuning Time in Half
Oracle Intelligent Storage Protocol: Unique language that
enables dynamic communication between an Oracle
Database and Oracle‟s ZFS Storage Appliances.
Database
data
DB I/O metadata
communicated to
ZFS Storage
Query Data
Response
Oracle Database
• Available only for Oracle Database 12c customers using
Oracle Direct NFS (dNFS) with Oracle ZFS Storage
Appliances that are running software version OS8
ZFS Storage
0.03ms 2TB DRAM
0.10ms 10TB FLASH (R / W)
30.00ms 2PB DISK
DB Control File
Writes prioritized
among other IO in
ZFS Storage
49
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Oracle’s ZS3 systems dynamically
assign system resources to optimize
Oracle Database performance and efficiency
50. OS8 | OISP: Auto Tuning of Record Size, LogBias
Without OISP
With OISP
OISP
Tunes
Logfile share
NFS
Server
NFS
Server
Multiple shares, each with
its own Record Size and
LogBias setting
/mnt/dbname/redo (Record Size, LogBias)
/mnt/dbname/control (Record Size, LogBias)
/mnt/dbname/pfile (Record Size, LogBias)
/mnt/dbname/datafile (Record Size, LogBias)
/mnt/dbname/tempfile (Record Size, LogBias)
/mnt/dbname/chgtrack (Record Size, LogBias)
/mnt/dbname/backup (Record Size, LogBias)
50
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Datafile share
Two shares:
logfile and datafile
/mnt/dbname/logfile (OISP sets Record Size, LogBias)
redo
/mnt/dbname/datafile (OISP sets Record Xize, LogBias)
control
pfile
datafile
tempfile
chgtrack
backup
52. ADO: Dynamically Assesses Data Usage Patterns
Database „heat map‟
0
0101110101001101
1
1
0 0 0 1 0 1 0 11 1 0 1 0 1 0 1
0
011 1010101010100
0
1
10 01000101010 101
1
1
1
0 0 0 1 0 11 1 0 1 0 1 0 1 0 1
0
0 1 0 1 0 1 0 1 0 1 0 10 1 0 1
1
1
011 1110100011100
0
1
10 01000101010 101
1
1
1
0 0 1 1 0 11 1 0 0 0 1 0 1 0 1
0
0 1 0 1 0 1 0 1 0 1 0 10 1 0 1
1
1
010 1110000011101
1
10 01000101010 101
1
1
10 01000101010 101
1
1
0 1 0 1 0 1 0 1 0 1 0 10 1 0 1
1
1
10 010 0010 10 10 10 1
1
1
10 01100101010 101
1
1
52
1 0 0 1 0 11 1 0 1 0 1 0 1 0 1
0
0
0 1 0 1 0 1 0 1 0 1 0 10 1 0 1
1
1
011 1010101010100
0
1
0 01000101010101
11
1
10 01000101010 101
1
1
011 1110101011101
0
1
011 1110100011100
0
1
10 01000101010 101
1
1
1
0 0 1 1 0 11 1 0 0 0 1 0 1 0 1
0
0 1 0 1 0 1 0 1 0 1 0 10 1 0 1
1
1
010 1110000011101
1
10 01000101010 101
1
1
1
0 0 0 1 0 11 1 0 1 0 1 0 1 0 1
0
1 1 0 1 0 1 0 1 0 1 0 10 1 0 1
1
1
011 1110101011101
0
1
10 01100101010 101
1
1
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
1
0 0 0 1 0 11 1 0 1 0 1 0 1 0 1
0
0 1 0 1 0 1 0 1 0 1 0 10 1 0 1
1
1
011 1010101010100
0
1
0 01000101010101
11
1
0
1 0 0 1 0 11 1 0 1 0 1 0 1 0 1
0
0 1 0 1 0 1 0 1 0 1 0 10 1 0 1
1
1
011 1110100011100
0
1
10 01000101010 101
1
1
1
0 0 1 1 0 11 1 0 0 0 1 0 1 0 1
0
0 1 0 1 0 1 0 1 0 1 0 10 1 0 1
1
1
10 01000101010 101
1
1
10 01000101010 101
1
1
011 1110101011101
0
1
1 1 0 1 0 1 0 1 0 1 0 10 1 0 1
1
1
011 1110101011101
0
1
10 01100101010 101
1
1
53. Heat Map
What it tracks
HOT
Active
Frequent
Access
Occasional
Access
Dormant
53
Actively
updated
Infrequently
updated, Freq
uently queried
Infrequent
access for
query and
updates
Long term
analytics &
compliance
COLD
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
“Heat Map” tracking
– Database level Heat Map shows which tables and partitions
are being used
– Block level Heat Map shows last modification at the block
level
Comprehensive
– Segment level shows both reads and writes
– Distinguishes index lookups from full table scans
– Automatically excludes stats gathering, DDLs, table
redefinitions, etc
High Performance
– Object level at no cost
– Block level < 5% cost
54. Automatic Data Optimization
Usage Based Data Compression
01110101010010
10000100010101
01011100001010
Warm Data
54
101010100101001001000010001010101101001011
1010101101001011010011100001010010
010011100001010010010100001001000010001010
0101101110101010010100100100001000
0101000010010000100010101011010010
101010101110101001101011100001010001011011
1010101101001011010011100001010010
1000010100100101001010110111000010
101010101110101001101011100001011101011001
1110010100100101001010110111011010
10X
3X
Advanced Row Compression
101010101110101001101011100001010001011011
0101101110101010010100100100001000
10101010111010100110101
11000010100010110111010
10100101001001000010001
011100001010001011011
01010110100101101001110
101010100101001001000
00010100100101000010010
010001010101101001011
00010001010101110011010
010101001010010010001
10100101001001000010001
Archive Data
1010101011101010011010111000010100
Hot Data
15X
Columnar Query Compression Columnar Archive Compression
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
57. Hybrid Columnar Compression (HCC)
Store Less Data AND Run Faster
Oracle Database
Hybrid Columnar Compression
Retail Data Warehouse Example
With Hybrid Columnar
Compression
Uncompressed
• Up to 50x space reduction
• Average 5x faster queries
735GB
• Only available on Oracle
storage
• Increases performance for most
data warehouse and data
protection
94%
Less
Storage
38GB
0
3
1
8x
Faster
Query
3
1
2
2
2 Hours, 22 Min, 44 Sec
57
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
16 Min, 50 Sec
58. More Software | Data Reduction
• Thin Provisioning
• Deduplication
• Compression
58
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
59. Software | Data Reduction: Thin Provisioning
Traditional Allocation
Thin Provisioned
58% consumed. 100% reserved.
No storage available.
58% consumed. 42% storage available.
Volume C
80% of Reserved
Space Consumed
Unused
Storage
Available
For All
Volumes
Data
Volume B
50% of Reserved
Space Consumed
Unused
Data
Unused
Data
100% of Consumed
Data
Volume A
Data
59
100% of Consumed
Volume B
Volume A
20% of Reserved
Space Consumed
Volume C
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
100% of Consumed
Data
60. Software | Data Reduction: Deduplication
• Block level (in-line) deduplication
Actual Data Blocks
• Not recommended for database backup,
active transactional workloads, or heavy
throughput workloads
• Recommended for data reduction VM boot
images
Hash Function
Physically Stored Data Blocks
60
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
61. Software | Data Reduction: Deduplication
• Reduce Costs
– Leverage current backup software
– “Inexpensive” and high performance Sun servers
– Shrink backup window by up to 90% (client dedupe)
• Flexibility
– Deduplication at the client, backup server, neither, or both
– Deduplicate by data type – eliminates “all or nothing” approach
• Reduce Risk
– No hardware vendor lock-in
– Regular disk and tape storage – taking advantage of compression and encryption
– Possible tape deduplication
Deduplication is often completed in the application software layer
61
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
62. Software | Data Reduction: Compression
ORACLE DATABASE COMPRESSION
STORAGE
COMPRESSION
HCC
ACO
• ZFS Storage Appliance
• 4 Levels of compression
• Algorithms executed at
the storage tier
• Data type agnostic
• Algorithms exeecuted at
• Algorithms calculated at
the database compute tier
the database compute tier
• Available at no additional
charge with Oracle
• No additional cost
62
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
storage only
• Additional license cost
63. More
Compression
LZJB – low-overhead compression, aka “compression for free”
GZIP-2 – lightweight version of gzip algorithm
GZIP – higher compression, but at some compute overhead penalty
GZIP-9 – highest compression, but can consume significant compute resources
ZFS Storage Compression Considerations
• No software license fees for compression
• Options: select compression to suit your workload
• Balance performance and data reduction
• LZJB is very lightweight – in fact it increases performance in some cases
• Higher compression options if more data reduction needed, more compute overhead tolerated
63
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
More
Performance
Software | Data Reduction: Compression Options
64. Software | Data Reduction: Database Compression
Advanced Compression Option
Hybrid Columnar Compression
(ACO)
(HCC)
• 2-4x reduction in storage
• Up to 50x reduction in data stored
• Faster queries in many
• Average 5x better performance
cases, due to improved I/O and • Included at no additional cost with
memory efficiency
Oracle storage devices
• Better network bandwidth
utilization
64
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
65. Snap Manager for Oracle DB
Manage snapshot copies in the ZFS Storage Appliance
• Allows for quick and efficient backup, restore, cloning and
provisioning of application instances
Snapshot
• “Application Aware” Ensures no data loss and
consistent backups
• Supports Oracle 10g, 11g, RAC
–
–
Currently supports NFS/dNFS and iSCSI protocols
CLI version for multiple client platforms (Solaris, Linux, Windows)
• Database host support includes Solaris, Linux, Windows
• Snapshot types
–
–
Hot: Online
Cold: Offline
• Snapshot maintenance
–
–
–
Automated scheduler
Retention policies
Custom Attributed (annotate snapshot with metadata)
• Rollback to a snapshot
65
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Rollback
66. Oracle Storage Best Practices for Oracle VM
66
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
66
67. Oracle Virtualization
The Full Stack, End-to-End
DATA CENTER
BROWSER
Software Delivery Cloud
VM
VM
VM
VM
VM
Application Stack
Oracle VM Servers
Network
Servers
Storage
Servers
Storage
Oracle VM
Templates
&
Assemblies
Oracle Secure Global Desktop
USERS
Oracle
Enterprise
Manager
12c
VM
Oracle Desktop
Virtualization
E-Business
Suite
VMs
THIN CLIENTS
Oracle Sun Ray Clients
Servers
PCs, MACs,
MOBILE
DEVICES
Oracle Virtual Desktop Client
Server Virtualization
Network Virtualization
• Oracle Xsigo Data Center Fabric
• Oracle VM Server for x86
• Oracle VM Server for SPARC
(LDoms)
• Oracle Solaris Zones
• Dynamic Domains
67
Application-Driven Virtualization
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Desktop Virtualization
• Oracle Secure Global Desktop
• Oracle VM VirtualBox
Contact Service Center
68. Virtualization Platform: Oracle VM
Server Virtualization and Management
• For both Oracle and non-Oracle applications
• The only server virtualization software supported and
certified with Oracle products
• Cost effective – no license fees
• High performance – virtualize apps with confidence
• Enterprise-quality support – global, 24x7 support
• Faster application deployment – Over 90+ templates
• Integrated stack- Interoperability, security across stack
68
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
69. Financing World Growth
Financial Institute Relies on Sun ZFS Storage
• VM Observability w/ Storage Analytics
– Optimized storage workload visibility
– 44% faster in diagnostics/troubleshooting
• Higher performance with Hybrid Storage Pools
– Accelerated read cache VM performance
– Improved virtualization write performance
• Storage Efficient Provisioning
– Accelerates Virtual Machine Deployment by 34%
– Faster Oracle VDI Provisioning by 40%
• Lower TCO
– 8x higher storage efficiencies with compression and de-dup
– Optimized Power/Space/Cooling
– No-charge for protocols
69
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Higher Storage agility with virtualization and
Oracle ZFS Storage appliance
70. Oracle Optimized Solution for Enterprise Cloud
Infrastructure
+
+
+
+
+
=
Sun Blade 6000 + Ethernet switched NEMs
Oracle and 3rd Party Applications
Oracle Solaris / Linux OS
ZFS
Storage
Appliance
70
Oracle Management
Oracle VM Server + Templates
Sun Blade Modular System
Oracle Network Fabric Architecture
Sun Unified Storage
Flash Enabled
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
71. Network Configuration
• NFS protocol over 10GigE network
– NFS integrates file access, file locking, and mount protocols into
a single, unified protocol to improve security
– NFS offers the utmost simplicity in attaching storage in Oracle VM
virtualization environments over Ethernet.
– NFS on Sun ZFS Storage Appliance scales well to many
concurrent I/O threads. This high I/O throughput enables more
VM stacks to perform I/O without sacrificing service levels.
– Two 10 GbE interfaces supply plenty of bandwidth to access
virtual machine data.
• IB and FC are also available alternatives to this configuration
71
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
72. Oracle VM 3.0
What‟s new for Storage?
• Storage Connect Framework
–
–
–
–
Support for Native Storage Services
Share/LUN creation, deletion, expansion
Access Group creation
Allows storage operations to be done via OVM Manager
• OCFS2 1.8 cluster file system
– Instant clone support
72
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
73. Oracle VM Storage Connect
Advanced Storage Operations
Storage Connect Plug-In Framework & API
Oracle ZFS Plug-In
Pillar Plug-In
Create LUN
vendor_specific_command_CREATE_LUN
Sun ZFS Storage
3.0
Pillar Storage
Storage Repositories
OCFS2 Plug-In
CLONE VM
_INSTANT_CLONE
Storage Connect Plug-Ins for Management…
• Oracle and
73
3rd
party storage…from the Manager UI
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
More than just
provisioning…
• Create LUNs or Volumes
• Expand LUNs or Volumes
• Associate, share with VMs
OCFS2 Filesystem
JBOD
74. Storage Connect for ZFSSA
• Current ZFSSA Storage Connect has support for iSCSI
and FC LUNS
– NFS support to come when OVM adds support in framework
– NFS can still be added as a Generic File Server or Generic FC
array
74
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
75. Configuration Best Practices
• Consider a Hybrid approach
– Template/VM repositories on iSCSI block LUN
• Takes advantage of OCFS2 cloning for rapid template/OS deployment
– Application data (database, middleware) mounted direct from
Guest VM via NFSv3.
• Takes advantage of excellent NAS performance of ZFSSA
–
–
–
–
75
EHCC & dNFS for the databases
Analytics to pinpoint application issues down to the VM and even down to the file
Snap&Clone on the ZFSSA for rapid Test/Dev rollout
Avoids issues with Block Alignment on data intensive shares or LUNs
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
77. Oracle’s ZFS Storage Systems
ORACLE CLOUD
Social. Mobile. Complete.
Storage foundation for Oracle‟s
Enterprise Cloud, IT, and
Product Development
Infrastructure
Over 225PBs in Production at Oracle!
77
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
78. Oracle Storage ZFS Storage Appliances
Best Performance. Best Efficiency. Engineered for Oracle Software.
Trusted by a majority of the F100, ~4000 enterprise business, and Oracle IT
Foundation storage for Oracle Cloud (over 25 million users)
Fastest Growing Storage Vendor
78
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
79. DEMOS
• Demo ZFS + Vmware
– http://www.youtube.com/watch?v=i47XhPsAVTQ
• Demo ZFS Analitics
– http://www.youtube.com/watch?v=JazDlzTe9vE
• Demo ZFS + OVM
– Instalar ZFS Appliance Simulator + OVM
http://www.oracle.com/technetwork/systems/hands-on-labs/hol-deploycloud-ovm-sunzfs-1889199.html
79
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Editor's Notes For notes-consideration:Maintains active data on Solid State MediaAll Cache protected by Disk Pool (7K, 10K, 15K) Once a customer logs into the ZFSSA, they will see the summary screen just as any other login. The measurements will match what is displayed in the EM interface, but provides deeper analytics and management than through EM. More on the analytics feature can be found through other ZFSSA training courses. This deck will describe some of the features of Enterprise Manager when using the ZFSSA plug-in. The monitoring of n ZFSSA appliances can be accomplished using EM, but much of the deeper management functions still reside on the appliance. To utilize EM for n-way monitoring, the plug-in must be installed and the appliance configured to report through EM. The ZFSSA plug-in for EM is deployed using an agent on the appliance to talk with EM. This plug-in collects the data from the appliance and relays the content to the EM server. This data is now stored in EM for further reporting and historical views. Once activated, EM will display a set of screens and metrics specific to monitoring the ZFSSA. By adding the ZFSSA plug-in to the existing EM instance, it is now possible to include monitoring of the ZFSSA along with monitoring of the entire environment. EM can be used as a stand-alone monitoring tools for multiple ZFSSA appliances, the ability to view systems from across the organization provides a greater opportunity to identify system performance and utilization. The common interface better integrates monitoring from a diverse set of resources. Beyond the metrics presented in the summary, a broad set of statistics can be captured by EM for further analysis. The set of metrics is comprehensive of the appliance, including capture of cache, disk, network and protocol statistics. Collection can be turned on or off, and the collection frequency can be set individually, gathering more static measures less frequently, and performance measures more frequently. There is a very broad list of metrics that can be captured in the EM interface. This is the comprehensive list of metrics that the plug-in can provide to EM for collection. Many of the metric families have a number of sub-metrics that can also be captured. For alerting through EM, it is possible to set custom thresholds for the customer-defined metrics. This is in addition to collection frequency. The ability to set thresholds allows for differentiation of pool or share alerting based on level of criticality to the customer. In the graph view of metric history, it is also possible to test the thresholds, identifying when the alert may have been generated based on the defined target levels. The integration from across various system types allows for reports to span across systems. Reports to map databases to storage targets or to view a history of network performance are available as an EM report. From the controller summary page in EM, there is a link that will take you directly to the BUI of the ZFSSA. This will require a separate login, separating monitoring of system status and system management to allow for a wider set of enterprise roles. More on EM and the ZFSSA plug-in can be found at these links. For more information on the plug-in, or for feedback on future enhancements, please contact Doug Chamberlain (doug.chamberlain@oracle.com). No Performance Impact ?? Source: Oracle Testing, published in “A Hybrid Columnar Compression Case Study with ExternalNAS and SAN Storage” by Art Licht, April 2012 To put the extreme efficiency of ZFS Storage in perspective, consider a typical virtual server environment…Using ZFS Storage to consolidate tens to 100’s of virtual machines…Customers have been able to achieve…… an 8x data reduction ratio (using native ZFS Storage compression and deduplication)… and faster VDI and VM performance… while dramatically increasing their overall virtual server reliability and control For customers looking to add highly virtualized or cloud infrastructures to their existing datacenters, Oracle now offers optimized solution for cloud infrastructure , which allows you to build customized enterprise virtualized infrastructure. This solution guides you through selection of Oracle blades, networking, storage, virtualization, OS and management software to create your own customized deployment.