• Like
  • Save
ZFS appliance
Upcoming SlideShare
Loading in...5
×
 

ZFS appliance

on

  • 1,765 views

ZFS Appliance

ZFS Appliance

Statistics

Views

Total Views
1,765
Views on SlideShare
1,765
Embed Views
0

Actions

Likes
1
Downloads
92
Comments
1

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel

11 of 1

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
  • Hi,
    i am trying to configure email alerts for zfs storage 7420 via smarthost. but i am not receiving emails. even when i tried to send test email it didnt work. any suggestion??
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • For notes-consideration:Maintains active data on Solid State MediaAll Cache protected by Disk Pool (7K, 10K, 15K)
  • Once a customer logs into the ZFSSA, they will see the summary screen just as any other login. The measurements will match what is displayed in the EM interface, but provides deeper analytics and management than through EM. More on the analytics feature can be found through other ZFSSA training courses.
  • This deck will describe some of the features of Enterprise Manager when using the ZFSSA plug-in. The monitoring of n ZFSSA appliances can be accomplished using EM, but much of the deeper management functions still reside on the appliance. To utilize EM for n-way monitoring, the plug-in must be installed and the appliance configured to report through EM.
  • The ZFSSA plug-in for EM is deployed using an agent on the appliance to talk with EM. This plug-in collects the data from the appliance and relays the content to the EM server. This data is now stored in EM for further reporting and historical views. Once activated, EM will display a set of screens and metrics specific to monitoring the ZFSSA.
  • By adding the ZFSSA plug-in to the existing EM instance, it is now possible to include monitoring of the ZFSSA along with monitoring of the entire environment. EM can be used as a stand-alone monitoring tools for multiple ZFSSA appliances, the ability to view systems from across the organization provides a greater opportunity to identify system performance and utilization. The common interface better integrates monitoring from a diverse set of resources.
  • Beyond the metrics presented in the summary, a broad set of statistics can be captured by EM for further analysis. The set of metrics is comprehensive of the appliance, including capture of cache, disk, network and protocol statistics. Collection can be turned on or off, and the collection frequency can be set individually, gathering more static measures less frequently, and performance measures more frequently. There is a very broad list of metrics that can be captured in the EM interface.
  • This is the comprehensive list of metrics that the plug-in can provide to EM for collection. Many of the metric families have a number of sub-metrics that can also be captured.
  • For alerting through EM, it is possible to set custom thresholds for the customer-defined metrics. This is in addition to collection frequency. The ability to set thresholds allows for differentiation of pool or share alerting based on level of criticality to the customer. In the graph view of metric history, it is also possible to test the thresholds, identifying when the alert may have been generated based on the defined target levels.
  • The integration from across various system types allows for reports to span across systems. Reports to map databases to storage targets or to view a history of network performance are available as an EM report.
  • From the controller summary page in EM, there is a link that will take you directly to the BUI of the ZFSSA. This will require a separate login, separating monitoring of system status and system management to allow for a wider set of enterprise roles.
  • More on EM and the ZFSSA plug-in can be found at these links. For more information on the plug-in, or for feedback on future enhancements, please contact Doug Chamberlain (doug.chamberlain@oracle.com).
  • No Performance Impact ??
  • Source: Oracle Testing, published in “A Hybrid Columnar Compression Case Study with ExternalNAS and SAN Storage” by Art Licht, April 2012
  • To put the extreme efficiency of ZFS Storage in perspective, consider a typical virtual server environment…Using ZFS Storage to consolidate tens to 100’s of virtual machines…Customers have been able to achieve…… an 8x data reduction ratio (using native ZFS Storage compression and deduplication)… and faster VDI and VM performance… while dramatically increasing their overall virtual server reliability and control
  • For customers looking to add highly virtualized or cloud infrastructures to their existing datacenters, Oracle now offers optimized solution for cloud infrastructure , which allows you to build customized enterprise virtualized infrastructure. This solution guides you through selection of Oracle blades, networking, storage, virtualization, OS and management software to create your own customized deployment.

ZFS appliance ZFS appliance Presentation Transcript

  • Oracle’s ZS3 series Enterprise Storage Systems Fran Navarro Preventa Sistemas Oracle Nov 2013 1 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Important Disclosure The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle‟s products remains at the sole discretion of Oracle. 2 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Oracle is Driving the Storage System Evolution Application Engineered Storage Enterprise software drives system performance and efficiency Software-defined Storage Storage software drives system performance and efficiency Hardware-defined Storage Custom hardware drives system performance and efficiency 3 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Oracle ZS3 Storage Application Engineered Storage Extreme Performance World-record performance and leading price performance 4 Integrated Analytics Real-time visualizations cuts troubleshooting times by 50% Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Optimized for Oracle Software OISP cuts database tuning times by 65%; HCC delivers 10-50X compression
  • ORACLE’S NEXT GENERATION ZFS STORAGE APPLIANCE: ZS3 SERIES   MOST EFFICIENT  5 BEST PERFORMANCE ENGINEERED FOR ORACLE SOFTWARE Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • • • • • • • • • Oracle’s ZFS Storage Appliance Strong and Steady Product Maturation Analytics 2009 2010 • • • • • • 1,000th Customer Unified Storage (block) InfiniBand Replication Thin Provisioning Best-in-class User Interface ZFS Filesystem 2008 6 • First Platform Release - Compression, Replication, etc. • Hybrid Storage Pool (with Flash) • Analytics • Development engaged in 2004 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. ZS3 series release Software Release OS8 200PBs in Oracle *IT World-record Performance Oracle Database (OISP) IaaS Offering SMU/Oracle DB DE2 Disk Enclosures 2011 • • • • • • • 2nd Gen. Platform Software Release OS7 Deduplication Thin Provisioning Enterprise RAS Shadow Migration Surpassed an Exabyte Stored 2013 2012 • • • • • • • • • 3,000th Customer 10,000th system sold Hybrid Columnar Compression ZFS Backup Appliance 150PBs in Oracle *IT Foundation for Oracle Cloud Best-in-class SPC-1 Best-in-class SPC-2 Most efficient ($/IOP) SPECsfs
  • Engineered for Unified Storage Storage OS Application I/O NFS CIFS IB iSCSI • Auto Administration • System Analytics • Virtual Storage Pools • Dynamic Data Tiering • Modular Scalability • Oracle SW integration FC  Virtual Pool file, volume, and data services Compress Thin Provision Dedup Mirror, RAID-Zx Performance  Snap Clone Replication  Storage Pool read flash, write flash, and drives Read Intensive I/O Write Intensive I/O Storage - Automates storage tiering (HSPs) Eliminates distinct file and volume management Concurrent block and file I/O, with shared data services Multi-core, multi-threading RTOS Data Integrity  - Entire I/O path validated before data stored - Eliminates potential for bit rot, phantom writes, etc. Analytics - Comprehensive and precise file-level view 7 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Oracle’s new ZS3 Series ZFS Storage Operating System • Most powerful storage software suite • Engineered Integration with Oracle software ZS3-2 2x Faster 3x More Scalable OS8 Storage OS Support • • • • • • Single or Dual Controllers 512GB DRAM 8 PCIe Slots 16 Disk Enclosures* 12TB Read Flash 4TB Write Flash* * ZS3-2 will release with expansion to 8 disk enclosures. Scale to 16 expected within 6 months of release. 8 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. ZS3-4 • • • • • • Single or Dual Controllers 2TB DRAM 14 PCIe Slots 36 Disk Enclosures 12TB Read Flash 10TB Write Flash
  • Software | Hybrid Storage Pools 80 CPU cores 2TB Memory 12TB Read Flash 10TB Write Flash 9 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • DISK 30.00ms Hybrid Storage Pool Dynamically Serve 70-90% of I/O from DRAM Not to Scale Introduced first by Oracle on ZFS Storage Appliances in 2008 FLASH 0.10ms DRAM 0.03ms Storage Media Latencies 10 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Comprehensive Suite of Enterprise Software Data protocols • Fibre channel • • • • • • • • • • iSCSI InfiniBand over IP/RDMA iSER SRP NFS V3 and V4 CIFS HTTP WebDAV FTP/SFTP/FTPS ZFS NDMP V4 Data services • OISP • Hybrid Columnar Compression • Hybrid Storage Pools • Single, double and triple-parity RAID (RAIDZ, RAIDZ2,RAIDZ3) • Mirroring and triple mirroring • End-to-end data integrity • Local and remote replication • Snapshots and clones • Quota(s) • In-line deduplication • Compression • Thin provisioning • Antivirus via ICAP protocol • Online data migration • Clustering 11 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Management • Browser and CLI interface • Management dashboard • Hardware/component view • Role-based access control • Phone home • Event and threshold based alerting • Storage analytics • Scripting • Workflow automation • Advanced networking • Snap Management Utility • Source aware routing
  • Majority of the Fortune 100 Rely on Oracle ZFS Storage 12 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Majority of the Top 10 Global Banks Rely on Oracle ZFS Storage 13 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Oracle‟s ZFS Storage is the fastest growing major storage vendor 14 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Over 150 companies switch from NetApp and EMC to Oracle ZFS Storage every quarter… 15 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • 16 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Best Performance 2x Faster than NetApp in OLTP, 2x Faster than NetApp in File serving, 4x Faster than NetApp in OLAP/DSS, 4x Faster than NetApp in VDI/VM 4x Faster than NetApp in Backup, 5x Faster than NetApp in Restores. #1 Most Efficient 85% Smaller backup windows than NetApp, 44% Faster trouble-shooting than NetApp, 2x Better price/performance in OLTP than NetApp, 5x Better price/performance in File serving than NetApp, #1 in Analytics and HSPs. #1 Engineered for Oracle Software Only NAS vendor with Hybrid Columnar Compression, Only NAS vendor with Oracle Intelligent Storage Protocol, Only NAS vendor engineered with ADG. , Only NAS vendor that enables the full-featured Oracle 12c ADO capability. #1 Storage for Oracle *IT and Cloud Only NAS vendor with over 225PBs in enterprise environments that get updated before customers use the latest firmware releases. Only NAS with NFS cloud environment generated 3.2B database transactions per hour. #1 17 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • ZFS Storage Appliances Engineered for extreme performance. Increase database responsiveness. Expedite large data queries. Minimize backup windows. 18 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 18
  • Oracle’s ZS3 Storage The Fastest Storage System Available 4-6X more efficient than every other storage product 17.3 GB/s @ $23/MB/s World-record performance, streaming and on-line application processing (SPC-2) has never exceeded 13GB/s @ $88/MB/s 19 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. has never exceeded 15GB/s @ $131/MB/s has never exceeded 13GB/s @ $95/MS/s
  • Oracle’s ZS3 Storage The Fastest Storage System Available 5-8X better $/IOP than everything in its class 450K IOPS / 700μs Best-in-Class application responsiveness and performance (SPECsfs) Best is 1.2ms with FAS6240 and 100K IOPS / 1.7ms on FAS3250 20 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Best is 3.2ms, 456K IOPS with a 56 node Isilon system
  • Best Performance is Not Enough 21 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • 87% of Storage Costs Are the Result of Inefficient Systems or Software Source: Oracle Customer Advisory Boards 22 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • ZFS Storage Appliances Industry-leading storage efficiency. Eliminate the time required to assess, tune, and deploy storage tiers. Minimize the time it takes to trouble-shoot and resolve IT issues. Eliminate management of disparate files and volumes. 23 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 23
  • Management Efficiency | Analytics • • Visualize CPU, cache, protocol, disk, memory, networking, and system-related data, all at the same time. • Drill down quickly on areas of concern • Support multiple simultaneous application and workload analysis in real-time, to help compare various aspects of system stress • 24 Industry‟s most comprehensive real-time visualization of application- and storagerelated workloads (on right picture of database and table index analytics) Analysis can be saved, exported and replayed for further analysis Copyright © 2013, Oracle and/or its affiliates. All rights reserved. MOST EFFICIENT
  • ZFS Appliance Dashboard Monitoring at a glance • Starting point for appliance analysis – Ideal for single device monitoring • Real-time updates to graphical view of operations – Utilization and alerts easy to identify 25 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • ZFS Storage Appliance Analytics Automatic real-time visualization of application and storage workloads • Simple yet sophisticated instrumentation • Available on all ZFS Storage Appliance models • Analysis can be saved, exported and replayed for further analysis 26 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • ZFS Storage Analytics 27 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Statistics • Statistics are a collection of data displayed and graphed by ZFS Analytics • Every layer of the stack has available statistics – – – – 28 CPU Disk Network Protocols Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Drilling Down into Statistics • Statistics can be drilled down to form ad-hoc queries – Which clients have the highest access rate on a certain day of the week? – Which NFS operations are taking at least 2 milliseconds during high production load? – Which disks are seeing the most amount of activity over the past month? 29 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Navigate Through Time  „Arrow‟ buttons move back and forth between the past and present  „Pause‟ suspends the graph, but not data collection  „Zoom‟ buttons control the time scale of the graph  „Clocks‟ are pre-defined zooming to by-minute and by-hour  „Calendars‟ can display an entire day, entire week, or entire month 30 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Worksheets • A worksheet is a user-defined collection of statistics • They are persistently saved and can be shared by users • Handy for crafting just the family of statistics that are relevant for your performance analysis 31 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Phantom Workloads Exposed File Level Visibility • A user running a performance test increases the load on the storage in an unexpected way and the storage administrator can drill into the issue in real time to understand where the load is coming from. 32 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Phantom Workloads Exposed Where is my IO load coming from? 33 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Phantom Workloads Exposed What is that client doing? 34 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Phantom Workloads Exposed What‟s happening inside that file? 35 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • ZFS Appliance Monitor  iPhone application that monitors multiple ZFS Storage Appliances  Brings the power of DTrace Analytics at your fingertips  Easily view the health/status of any ZFS Appliance, anywhere  Ideal for Execs/Storage Admins with need for instant access to information  Graphical and intuitive display of: • • • • • • • • • 36 System and component status (disks, CPU, RAM, fans, etc) Service status (NFS, iSCSI, SMB, etc) Resource & I/O status DTrace Analytics (real time statistics via saved worksheets) Logs for alert, system, fault, audit, phone home Active systems problems (can be marked as repaired via app) High level group status including storage use, problems, hardware status Storage utilization Remote activation of system and component locator LED Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Available now on App Store
  • ZFSSA Monitoring and Management monitoring with Enterprise Manager for single pane of glass • Enterprise Grade Monitoring/Management Facility – Comprehensive Dashboard View • Central Repository for Analytics Storage • Database Configuration, Hardware and Network Configuration • Operational and Availability Analytics – For Storage Platforms • Information is collected by installed Plug-Ins • Stored in real-time on the Oracle Enterprise Manager Repository • For the Storage 7000 – Data collected by Dtrace Analytics and FMA • Data is corroborative between SS7000 and OEMGC • Includes capacity Utilization • Cache usage and performance metrics • Detailed Alerts – Enables collaboration between the DBA and Storage Administrator 37 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Oracle EM Cloud Control Plug-in for ZFSSA ZFS Storage Appliances • Oracle Enterprise Manager Cloud Control (OCC) 12c communicates with the ZFSSA appliance through a plug-in deployed to an active OCC agent. • The plug-in collects status and data from the ZFSSA and relays it to the OCC management server, which stores the data in the OMS repository database. • The ZFSSA plug-in formats screens and reports in the OCC web interface. 38 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Integrating ZFS with Enterprise Manager Monitor ZFS appliances as part of the enterprise • ZFS appliance becomes an additional target to monitor • Provides method for nway monitoring of multiple ZFSSA systems through common EM interface 39 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Wide Range of Individual Measurements Complete set of metrics for system monitoring from EM • Ability to monitor statistics across all functions of the appliance – – – – – Appliance status Cache activity Disk throughput Network devices Protocol activity • Graphical view of metrics 40 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • ZFSSA – OEMCC Metrics High Level Metric Logical Status Project Status Configuration Service Appliance Capacity Totals Cache ARC Cache L2ARC CPU Disk I/O Ops Disk I/O Ops Latency Disk I/O Bytes Network Device NFSv2 Ops NFSv3 Ops NFSv3 Ops Latency NFSv4 Ops SMB Ops SMB Ops Latency iSCSI Ops iSCSI Ops Latency Initiator and Target Groups 41 Sub-Metrics High Level Metric Sub-Metrics Share identifier, Available (GB), Total allocated (GB), Data (GB), Share percentage used, Quota (GB), Reserved (GB), Unused Reserved (GB), SCSI LUN Project identifier, Available (GB), Total allocated (GB), Project Data (GB), Project percentage used, Quota (GB), Reserved (GB), Unused Reserved (GB), Total Share Quota (GB), Project Over Allocated Service name, Service Status Storage pool, Pool owner, Pool status, Data profile, Available (GB), Total used (GB), Pool used percentage, Total Capacity (GB), Data disks, Spare disks, Cache Disks, Total project quota (GB), Quota Allocation(GB), Reservations (GB) Pool over allocated Size (MB) Size (MB) Utilization % Operations per Second Operations per Second KB per Second KB per Second Operations per Second Operations per Second Operations per Second Operations per Second Operations per Second Operations per Second Operations per Second Operations per Second Protocol, Group name, Address, Initiator or target ARC Activity L2ARC Activity ARC Activity by Share L2ARC Activity by Share NFSv3 Operations by Share NFSv4 Operations by Share Network IO Direction Network IO by Device Network Interface Performance Activity, Accesses per sec Activity, Accesses per sec Share, Accesses per sec Share, Accesses per sec NFSv3 Share, Operations per sec NFSv4 Share, Operations per sec Direction, KB per sec Device, KB per sec Interface, KB per sec Cluster state, Cluster state description, Cluster peer state, Cluster peer state description Reported node name, Product model, Appliance serial nbr, Chasis serial nbr, Appliance SW version, Install time, Last update time, Power on time, Up time, Clustered, Cluster peer Share identifier, Share type, Mount point, Data profile, Data compression, Cache usage, NFS, CIFS Interface, IP Address, CIDR, IP Version, Management enabled Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Physical Component Status Appliance Information Appliance Logical information IP Network Interfaces IP Network Interface to Datalink relationship Interface, Datalink, Jumbo frames IP Datalink to device relationship Datalink, Link, Class IP Network Devices Network Device, Device speed, Device up Problem ID, Time stamp, Alert description, Alert Alert Log Contents log problem type Problem ID, Time stamp, Description, Fault log Fault Log Contents problem type UUID, Description, Problem severity, Problem log Problem Log Contents code Problem ID, Time stamp, Replication description. Replication Activity Replication log problem type
  • Set Custom Thresholds Tune alerting to specific needs • Manage alerting based on specific limits – Alerting can be turned on or off, send messages only on customer-defined key metrics – Generate alert levels based on independent system use cases 42 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Expanded Reporting Features Database relationship and Network performance monitoring • Expanding monitoring through the Oracle stack – Identify relationships between database and storage resources – Track network performance 43 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Redirect to Appliance for Detailed Management Link directly from EM to launch ZFSSA GUI • For more granular analysis and control, link from the appliance summary page directly to the appliance dashboard – Will require ZFS appliance login for security 44 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Available Resources Links • Enterprise Manager Grid Control/Cloud Control – http://www.oracle.com/us/products/servers-storage/storage/nas/oracleenterprise-grid-manager-ds-431598.pdf – http://www.oracle.com/technetwork/oem/enterprisemanager/downloads/index.html • ZFSSA EM Plug-in – http://www.oracle.com/technetwork/oem/grid-control/downloads/zfsstorage-plugin-487867.html – http://download.oracle.com/otn/java/oem/Oracle_GC_Plugin_InstallGuid e.pdf 45 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Oracle Software Runs Fastest and Most Efficiently on Oracle Storage 46 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Application Engineered Storage OISP HCC Dynamic and automatic databasestorage tuning 47 ADO Advanced and dynamic database (data) optimization Superior database, data warehousing compression Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Oracle Intelligent Storage Protocol 48 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Eliminates hundreds of hours spent tuning (and re-tuning) storage and database for optimal performance
  • Oracle Intelligent Storage Protocol (OISP) Cut Database and Storage Tuning Time in Half Oracle Intelligent Storage Protocol: Unique language that enables dynamic communication between an Oracle Database and Oracle‟s ZFS Storage Appliances. Database data DB I/O metadata communicated to ZFS Storage Query Data Response Oracle Database • Available only for Oracle Database 12c customers using Oracle Direct NFS (dNFS) with Oracle ZFS Storage Appliances that are running software version OS8 ZFS Storage 0.03ms 2TB DRAM 0.10ms 10TB FLASH (R / W) 30.00ms 2PB DISK DB Control File Writes prioritized among other IO in ZFS Storage 49 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Oracle’s ZS3 systems dynamically assign system resources to optimize Oracle Database performance and efficiency
  • OS8 | OISP: Auto Tuning of Record Size, LogBias Without OISP With OISP OISP Tunes Logfile share NFS Server NFS Server Multiple shares, each with its own Record Size and LogBias setting /mnt/dbname/redo (Record Size, LogBias) /mnt/dbname/control (Record Size, LogBias) /mnt/dbname/pfile (Record Size, LogBias) /mnt/dbname/datafile (Record Size, LogBias) /mnt/dbname/tempfile (Record Size, LogBias) /mnt/dbname/chgtrack (Record Size, LogBias) /mnt/dbname/backup (Record Size, LogBias) 50 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Datafile share Two shares: logfile and datafile /mnt/dbname/logfile (OISP sets Record Size, LogBias) redo /mnt/dbname/datafile (OISP sets Record Xize, LogBias) control pfile datafile tempfile chgtrack backup
  • Automatic Data Optimization 51 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Increases database efficiency and performance, by dynamically moving data across storage tiers and compression algorithms
  • ADO: Dynamically Assesses Data Usage Patterns Database „heat map‟ 0 0101110101001101 1 1 0 0 0 1 0 1 0 11 1 0 1 0 1 0 1 0 011 1010101010100 0 1 10 01000101010 101 1 1 1 0 0 0 1 0 11 1 0 1 0 1 0 1 0 1 0 0 1 0 1 0 1 0 1 0 1 0 10 1 0 1 1 1 011 1110100011100 0 1 10 01000101010 101 1 1 1 0 0 1 1 0 11 1 0 0 0 1 0 1 0 1 0 0 1 0 1 0 1 0 1 0 1 0 10 1 0 1 1 1 010 1110000011101 1 10 01000101010 101 1 1 10 01000101010 101 1 1 0 1 0 1 0 1 0 1 0 1 0 10 1 0 1 1 1 10 010 0010 10 10 10 1 1 1 10 01100101010 101 1 1 52 1 0 0 1 0 11 1 0 1 0 1 0 1 0 1 0 0 0 1 0 1 0 1 0 1 0 1 0 10 1 0 1 1 1 011 1010101010100 0 1 0 01000101010101 11 1 10 01000101010 101 1 1 011 1110101011101 0 1 011 1110100011100 0 1 10 01000101010 101 1 1 1 0 0 1 1 0 11 1 0 0 0 1 0 1 0 1 0 0 1 0 1 0 1 0 1 0 1 0 10 1 0 1 1 1 010 1110000011101 1 10 01000101010 101 1 1 1 0 0 0 1 0 11 1 0 1 0 1 0 1 0 1 0 1 1 0 1 0 1 0 1 0 1 0 10 1 0 1 1 1 011 1110101011101 0 1 10 01100101010 101 1 1 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1 0 0 0 1 0 11 1 0 1 0 1 0 1 0 1 0 0 1 0 1 0 1 0 1 0 1 0 10 1 0 1 1 1 011 1010101010100 0 1 0 01000101010101 11 1 0 1 0 0 1 0 11 1 0 1 0 1 0 1 0 1 0 0 1 0 1 0 1 0 1 0 1 0 10 1 0 1 1 1 011 1110100011100 0 1 10 01000101010 101 1 1 1 0 0 1 1 0 11 1 0 0 0 1 0 1 0 1 0 0 1 0 1 0 1 0 1 0 1 0 10 1 0 1 1 1 10 01000101010 101 1 1 10 01000101010 101 1 1 011 1110101011101 0 1 1 1 0 1 0 1 0 1 0 1 0 10 1 0 1 1 1 011 1110101011101 0 1 10 01100101010 101 1 1
  • Heat Map What it tracks HOT Active Frequent Access Occasional Access Dormant 53 Actively updated Infrequently updated, Freq uently queried Infrequent access for query and updates Long term analytics & compliance COLD Copyright © 2013, Oracle and/or its affiliates. All rights reserved.  “Heat Map” tracking – Database level Heat Map shows which tables and partitions are being used – Block level Heat Map shows last modification at the block level  Comprehensive – Segment level shows both reads and writes – Distinguishes index lookups from full table scans – Automatically excludes stats gathering, DDLs, table redefinitions, etc  High Performance – Object level at no cost – Block level < 5% cost
  • Automatic Data Optimization Usage Based Data Compression 01110101010010 10000100010101 01011100001010 Warm Data 54 101010100101001001000010001010101101001011 1010101101001011010011100001010010 010011100001010010010100001001000010001010 0101101110101010010100100100001000 0101000010010000100010101011010010 101010101110101001101011100001010001011011 1010101101001011010011100001010010 1000010100100101001010110111000010 101010101110101001101011100001011101011001 1110010100100101001010110111011010 10X 3X Advanced Row Compression 101010101110101001101011100001010001011011 0101101110101010010100100100001000 10101010111010100110101 11000010100010110111010 10100101001001000010001 011100001010001011011 01010110100101101001110 101010100101001001000 00010100100101000010010 010001010101101001011 00010001010101110011010 010101001010010010001 10100101001001000010001 Archive Data 1010101011101010011010111000010100 Hot Data 15X Columnar Query Compression Columnar Archive Compression Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Heat Map Enterprise Manager 55 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Hybrid Columnar Compression 56 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Increases database efficiency and performance, by enacting columnar compression for data warehousing, analytics, and mining operations
  • Hybrid Columnar Compression (HCC) Store Less Data AND Run Faster Oracle Database Hybrid Columnar Compression Retail Data Warehouse Example With Hybrid Columnar Compression Uncompressed • Up to 50x space reduction • Average 5x faster queries 735GB • Only available on Oracle storage • Increases performance for most data warehouse and data protection 94% Less Storage 38GB 0 3 1 8x Faster Query 3 1 2 2 2 Hours, 22 Min, 44 Sec 57 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 16 Min, 50 Sec
  • More Software | Data Reduction • Thin Provisioning • Deduplication • Compression 58 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Software | Data Reduction: Thin Provisioning Traditional Allocation Thin Provisioned 58% consumed. 100% reserved. No storage available. 58% consumed. 42% storage available. Volume C 80% of Reserved Space Consumed Unused Storage Available For All Volumes Data Volume B 50% of Reserved Space Consumed Unused Data Unused Data 100% of Consumed Data Volume A Data 59 100% of Consumed Volume B Volume A 20% of Reserved Space Consumed Volume C Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 100% of Consumed Data
  • Software | Data Reduction: Deduplication • Block level (in-line) deduplication Actual Data Blocks • Not recommended for database backup, active transactional workloads, or heavy throughput workloads • Recommended for data reduction VM boot images Hash Function Physically Stored Data Blocks 60 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Software | Data Reduction: Deduplication • Reduce Costs – Leverage current backup software – “Inexpensive” and high performance Sun servers – Shrink backup window by up to 90% (client dedupe) • Flexibility – Deduplication at the client, backup server, neither, or both – Deduplicate by data type – eliminates “all or nothing” approach • Reduce Risk – No hardware vendor lock-in – Regular disk and tape storage – taking advantage of compression and encryption – Possible tape deduplication Deduplication is often completed in the application software layer 61 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Software | Data Reduction: Compression ORACLE DATABASE COMPRESSION STORAGE COMPRESSION HCC ACO • ZFS Storage Appliance • 4 Levels of compression • Algorithms executed at the storage tier • Data type agnostic • Algorithms exeecuted at • Algorithms calculated at the database compute tier the database compute tier • Available at no additional charge with Oracle • No additional cost 62 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. storage only • Additional license cost
  • More Compression LZJB – low-overhead compression, aka “compression for free” GZIP-2 – lightweight version of gzip algorithm GZIP – higher compression, but at some compute overhead penalty GZIP-9 – highest compression, but can consume significant compute resources ZFS Storage Compression Considerations • No software license fees for compression • Options: select compression to suit your workload • Balance performance and data reduction • LZJB is very lightweight – in fact it increases performance in some cases • Higher compression options if more data reduction needed, more compute overhead tolerated 63 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. More Performance Software | Data Reduction: Compression Options
  • Software | Data Reduction: Database Compression Advanced Compression Option Hybrid Columnar Compression (ACO) (HCC) • 2-4x reduction in storage • Up to 50x reduction in data stored • Faster queries in many • Average 5x better performance cases, due to improved I/O and • Included at no additional cost with memory efficiency Oracle storage devices • Better network bandwidth utilization 64 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Snap Manager for Oracle DB Manage snapshot copies in the ZFS Storage Appliance • Allows for quick and efficient backup, restore, cloning and provisioning of application instances Snapshot • “Application Aware”  Ensures no data loss and consistent backups • Supports Oracle 10g, 11g, RAC – – Currently supports NFS/dNFS and iSCSI protocols CLI version for multiple client platforms (Solaris, Linux, Windows) • Database host support includes Solaris, Linux, Windows • Snapshot types – – Hot: Online Cold: Offline • Snapshot maintenance – – – Automated scheduler Retention policies Custom Attributed (annotate snapshot with metadata) • Rollback to a snapshot 65 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Rollback
  • Oracle Storage Best Practices for Oracle VM 66 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 66
  • Oracle Virtualization The Full Stack, End-to-End DATA CENTER BROWSER Software Delivery Cloud VM VM VM VM VM Application Stack Oracle VM Servers Network Servers Storage Servers Storage Oracle VM Templates & Assemblies Oracle Secure Global Desktop USERS Oracle Enterprise Manager 12c VM Oracle Desktop Virtualization E-Business Suite VMs THIN CLIENTS Oracle Sun Ray Clients Servers PCs, MACs, MOBILE DEVICES Oracle Virtual Desktop Client Server Virtualization Network Virtualization • Oracle Xsigo Data Center Fabric • Oracle VM Server for x86 • Oracle VM Server for SPARC (LDoms) • Oracle Solaris Zones • Dynamic Domains 67 Application-Driven Virtualization Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Desktop Virtualization • Oracle Secure Global Desktop • Oracle VM VirtualBox Contact Service Center
  • Virtualization Platform: Oracle VM Server Virtualization and Management • For both Oracle and non-Oracle applications • The only server virtualization software supported and certified with Oracle products • Cost effective – no license fees • High performance – virtualize apps with confidence • Enterprise-quality support – global, 24x7 support • Faster application deployment – Over 90+ templates • Integrated stack- Interoperability, security across stack 68 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Financing World Growth Financial Institute Relies on Sun ZFS Storage • VM Observability w/ Storage Analytics – Optimized storage workload visibility – 44% faster in diagnostics/troubleshooting • Higher performance with Hybrid Storage Pools – Accelerated read cache VM performance – Improved virtualization write performance • Storage Efficient Provisioning – Accelerates Virtual Machine Deployment by 34% – Faster Oracle VDI Provisioning by 40% • Lower TCO – 8x higher storage efficiencies with compression and de-dup – Optimized Power/Space/Cooling – No-charge for protocols 69 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. Higher Storage agility with virtualization and Oracle ZFS Storage appliance
  • Oracle Optimized Solution for Enterprise Cloud Infrastructure + + + + + = Sun Blade 6000 + Ethernet switched NEMs Oracle and 3rd Party Applications Oracle Solaris / Linux OS ZFS Storage Appliance 70 Oracle Management Oracle VM Server + Templates Sun Blade Modular System Oracle Network Fabric Architecture Sun Unified Storage Flash Enabled Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Network Configuration • NFS protocol over 10GigE network – NFS integrates file access, file locking, and mount protocols into a single, unified protocol to improve security – NFS offers the utmost simplicity in attaching storage in Oracle VM virtualization environments over Ethernet. – NFS on Sun ZFS Storage Appliance scales well to many concurrent I/O threads. This high I/O throughput enables more VM stacks to perform I/O without sacrificing service levels. – Two 10 GbE interfaces supply plenty of bandwidth to access virtual machine data. • IB and FC are also available alternatives to this configuration 71 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Oracle VM 3.0 What‟s new for Storage? • Storage Connect Framework – – – – Support for Native Storage Services Share/LUN creation, deletion, expansion Access Group creation Allows storage operations to be done via OVM Manager • OCFS2 1.8 cluster file system – Instant clone support 72 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Oracle VM Storage Connect Advanced Storage Operations Storage Connect Plug-In Framework & API Oracle ZFS Plug-In Pillar Plug-In Create LUN vendor_specific_command_CREATE_LUN Sun ZFS Storage 3.0 Pillar Storage Storage Repositories OCFS2 Plug-In CLONE VM _INSTANT_CLONE Storage Connect Plug-Ins for Management… • Oracle and 73 3rd party storage…from the Manager UI Copyright © 2013, Oracle and/or its affiliates. All rights reserved. More than just provisioning… • Create LUNs or Volumes • Expand LUNs or Volumes • Associate, share with VMs OCFS2 Filesystem JBOD
  • Storage Connect for ZFSSA • Current ZFSSA Storage Connect has support for iSCSI and FC LUNS – NFS support to come when OVM adds support in framework – NFS can still be added as a Generic File Server or Generic FC array 74 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Configuration Best Practices • Consider a Hybrid approach – Template/VM repositories on iSCSI block LUN • Takes advantage of OCFS2 cloning for rapid template/OS deployment – Application data (database, middleware) mounted direct from Guest VM via NFSv3. • Takes advantage of excellent NAS performance of ZFSSA – – – – 75 EHCC & dNFS for the databases Analytics to pinpoint application issues down to the VM and even down to the file Snap&Clone on the ZFSSA for rapid Test/Dev rollout Avoids issues with Block Alignment on data intensive shares or LUNs Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Final Considerations Oracle ZFS Storage Appliances NAS and Unified Storage 76 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Oracle’s ZFS Storage Systems ORACLE CLOUD Social. Mobile. Complete. Storage foundation for Oracle‟s Enterprise Cloud, IT, and Product Development Infrastructure Over 225PBs in Production at Oracle! 77 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • Oracle Storage ZFS Storage Appliances  Best Performance. Best Efficiency. Engineered for Oracle Software.  Trusted by a majority of the F100, ~4000 enterprise business, and Oracle IT  Foundation storage for Oracle Cloud (over 25 million users)  Fastest Growing Storage Vendor 78 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • DEMOS • Demo ZFS + Vmware – http://www.youtube.com/watch?v=i47XhPsAVTQ • Demo ZFS Analitics – http://www.youtube.com/watch?v=JazDlzTe9vE • Demo ZFS + OVM – Instalar ZFS Appliance Simulator + OVM http://www.oracle.com/technetwork/systems/hands-on-labs/hol-deploycloud-ovm-sunzfs-1889199.html 79 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • 80 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
  • 81 Copyright © 2013, Oracle and/or its affiliates. All rights reserved.