Optimize solution for oracle db technical presentation

<Insert Picture Here>
Oracle Optimized Solution for Oracle Database
Mission Critical Systems Environments
Technical Architecture Presentation
Systems Solutions and Business Planning Group

3
The following is intended to outline our general
product direction. It is intended for information
purposes only, and may not be incorporated into any
contract. It is not a commitment to deliver any
material, code, or functionality, and should not be
relied upon in making purchasing decisions.
The development, release, and timing of any
features or functionality described for Oracle’s
products remains at the sole discretion of Oracle.

4
Agenda
• Introduction: Systems for Oracle Database
• Key architectural components
– Oracle M-Series
– Oracle Solaris
– Oracle FlashFire
– Oracle Storage
• Systems for Oracle Database
– Using dynamic domains for non-stop database operations
– Configuring high scale solutions on SPARC
– Configuring storage for Oracle databases
– Using FlashFire to reduce transaction times
• Summary — for more information
© 2011 Oracle Corporation – Proprietary and Confidential

5
Small
M5000
Pre-Sized Configurations
Medium
M5000
X-Large
M9000
Large
M8000 
Oracle Flash
F5100 Storage Arrays 
Flash Acceleration & Disk Storage
For Mission Critical Oracle Environments*
Network
(VLAN)
SAN
Oracle Software
Oracle
Storage 6000
(pictured right center)
Oracle Flash
F20 PCI Cards
(Not pictured)
Oracle ZFS
Storage Appliance
(pictured bottom right)
© 2011 Oracle Corporation – Proprietary and Confidential – Do Not Distribute
*Mission Critical Solution for New and Legacy Oracle (9i/10g/11g) Databases which support various Business Critical Applications
Enterprise Solutions for Business Critical Environments
Oracle RAC/Oracle DataGuard/Oracle Solaris Cluster

6
Value Proposition
• Simple, live scaling across entire system –
processors, memory, operating system, I/O, etc.
• World Record Performance – PeopleSoft, TPC-H,
App Server/11gR2, JD Edwards
Workload Scaling
• Predictive Self Healing – continue operations
even in light of CPU, memory or I/O failures
• Extensive non-disruptive service and upgrades
Non-Stop Database
Operation
• Complete solution provider
• One deployment organization
• Single support organization
Simplification
Investment
Protection
• Extended system life — in-place upgrades vs.
forklift strategy for competitors
• Broad support for legacy software and hardware
• Leading Total Cost of Ownership

7
Agenda
• Introduction: systems for Oracle Database
– Oracle M-Series
– Oracle Solaris
– Oracle Storage

8
M8000
M5000
M9000
Sun Systems for Oracle Database Infrastructure
Over 20 Years of Joint Mission Critical Deployments
Enterprise class platforms
• Reliability, availability, serviceability,
and security
• Highly scalable (vertical, horizontal)
• Flash optimized for business critical
database performance acceleration

9
Oracle SPARC Enterprise M5000 Example
Physical and Logical View
• Almost everything redundant
• However, Memory/CPU changes require system
(node) outage

10
SPARC Enterprise M5000 Example
Basic Specifications and Configuration
• Typical configuration 2 SBs
– XSB's with IOUs
• Single domain recommended
– Two domains: one Uni-XSB
per each OK
SPARC ENTERPRISE
M5000 SERVER
Enclosure • 10 rack units
SPARC64 VI
Processors
• 2.15 GHz
• 5 MB L2 cache
• Up to 8 dual-core chips
SPARC64 VII/VII+
Processors
• 2.4 GHz with 5 MB L2 cache
• 2.53 GHz with 5.5 MB L2 cache
• 2.66 GHz with 11MB L2 cache*
• Up to 8 quad-core chips
Memory
• Up to 512 GB
• 64 DIMM slots
Internal I/O Slots
• 8 PCI Express
• 2 PCI eXtended
External I/O
Chassis
• Up to 4 units
Internal Storage
• Serial attached SCSI
• Up to 4 hard drives
Dynamic Domains • Up to 4
* For 11MB cache support, must have new MOBO_B (SC+ chip.)

11
SPARC Enterprise M9000-32 Example
Specifications and Physical View
SPARC ENTERPRISE
M9000-32 SERVER
Enclosure • One cabinet
SPARC64 VI
Processors
• 2.28GHz with 5 MB L2 cache
• Up to 32 dual-core chips
SPARC64 VII/VII+
Processors
• 3.0 GHz with 12 MB L2 cache*
• Up to 32 quad-core chips
Memory
• Up to 2 TB
• 256 DIMM slots
Internal I/O Slots • 64 PCI Express
External I/O
Chassis
• Up to 16 units
Internal Storage
• Serial Attached SCSI
• Up to 32 drives
Dynamic Domains • Up to 24
* For 12MB cache support, must have new CMU_C (SC+ chip.)

12
Modes and Mixed Configuration of CPUs
Domain 0
CMU#0 CMU#1 CMU#2 CMU#3
CMU mounted with
VII/VII+ only
CMU mounted with
VI only
CMU of mixed CPU
configuration
CMU of mixed CPU
configuration
: SPARC64 VII/VII+ processor : SPARC64 VI processor
Domain 2
Domain 1

13
Implications of CPU Mode and Dynamic Reconfiguration
• To verify domain mode
> on XSCF: showdomainmode
> on domain: prtdiag
• Set mode to compatible if there is a possibly of adding SPARC64 VI cpus to a
domain that only has SPARC64 VII/VII+
Domain CPU
Configuration
Value of
cpumode
Current CPU
Operational
Mode
CPU Configuration that
can be added by DR
Operation
SPARC64 VII auto SPARC64 VII
enhanced mode
SPARC64 VII or VII+
SPARC64 VII/VII+ compatible SPARC64 VI
compatibility mode
Any CPU
SPARC64
VI/VII/VII+
auto or
compatible
SPARC64 VI
compatibility mode
Any CPU
SPARC64 VI Auto or
compatible
SPARC64 VI
compatibility mode
Any CPU

14
Mixing VII+ Processors With VI or VII Processors
• To achieve the 11MB or 12MB L2$ capacity, two
conditions must be met:
– All four processors on the system board must be SPARC64
VII+. None of the four can be either SPARC64 VI or
SPARC64 VII.
– The motherboard on the M4000/M5000 must be at least
version MOBO_B, and the CMU on the M8000/M9000 must
be at least version CMU_C
• The new MOBO_B and CMU_C have the new SC+
chip, which will provide L2$ addressing up to 12MB.
• When SPARC64 VII+ is set to half of its L2$, a
message notifying this event, will be displayed and
logged.

15
Oracle SPARC Enterprise M9000-32 Example
RAS and Logical View
1–8 CMU/IOU Pairs
• 8 CMUs max
• CMU and IOU
hard paired
• Everything hot
swap: CMU, IOU,
XB, XSCF,
Clock, etc.

16
SPARC Enterprise M9000-32 Example
• 8 Uni-XSBs max
– Quad-XSB shown not
recommended
• Grouped as single
hard domain
• Dynamic reconfiguration
used to give fine grain
upgrades and service
1–8 CMU/IOU Pairs

17
Oracle Database 11g on M-series and Solaris
Record-breaking Performance
SPARC
Enterprise M9000
(2.88 GHz)
Supports database tier of SPECjAppServer2004 benchmark and beats IBM p595 with DB2 and
HP Superdome 9000. Delivers breakthrough performance of
28,648.74 SPECjAppServer2004 JOPS@Standard on the SPECjAppServer2004 benchmark. with
SPARC Enterprise T5440 servers at the application tier(2)
.
World
Record
SPARC
Enterprise M9000
(3.0 GHz)
Top TWO results for non-cluster Oracle Database 11g Decision Support result on TPC-H
benchmark with performance of 386,478.3 QphH@3000GB. Beats POWER6-based IBM p595
with Sybase IQ by 2.5x(1)
.
SPARC
Enterprise M4000/M5000
(2.53 GHz)
M4000, running Oracle PeopleSoft N.A. Payroll 240K employees and Oracle Database 11g,
accelerated by the Sun Storage F5100 Flash Array is 2.1x faster than IBM. М5000,
running 500K employees, processed payroll 18% faster than IBM Z10-class mainframe with a
list price of over $6M and defeated HP Itanium-based system(3)
New
World
Record
SPARC
Enterprise M5000
(2.66 GHz)
M5000 server configured with Oracle's Sun Storage F5100 Flash Array Ands running Oracle
Database 11g Release 2 software supported a
world record result on Oracle PeopleSoft Enterprise Financials 9.0 (4)
.
SPARC
Enterprise M4000
(2.53 GHz)
World
Record
World
Record
Best database hardware for Oracle PeopleSoft Enterprise Campus solutions. Oracle Solaris
with Oracle Database 11g boosted by Sun Flash Accelerator F20 card delivered up to 40%
improvement on batch jobs compared to Itanium-based HP rx6600 solution(7)
.
New
World
Record
SPARC
Enterprise M5000
(2.53 GHz)
Posts the new world record on Oracle Hyperion Essbase ASO benchmark. Essbase is a
component of Oracle Fusion Middleware that uses Oracle Database 11g to manage over one
billion data items(5)
.
World
Record
SPARC
Enterprise M3000
(2.53 GHz)
M3000 server running at the database tier, enabled Oracle's SPARC T3-1 server running
Oracle JD Edwards EnterpriseOne to post a record result of 5,000 users, with 0.523 seconds
of average transaction time. This result beats IBM POWER7 result by 25%(6)
.
New
World
Record
Results as of 03/22/11. Footnotes and required benchmark disclosures on slide 73.

18
Agenda
– Oracle M-Series
– Oracle Solaris
– Oracle Storage

19
• Oracle is the leader in Unix system scaling – best able to handle
your workload growth
– Family scales to 2x the number of sockets/cores/threads than
competition 64/256/512 (M9000-64)
– Oracle Solaris is the only OS that scales to 512 threads today and
has been doing so for years
• Every other OS will need a major update and shakeout time to handle
the thread counts coming with the next generation of high core/high
thread counts
– Flexible and easy – just add boards
• Vs. competition’s more complex pre-installation of boards and
additional nodes
– Dynamic reconfiguration lets you easily add new resources to
operating database
• Competitors’ offers are more complex, limiting and requires extra
software costs
Workload Scaling
Deployment Longevity, Legacy Support
Oracle Differentiator

20
Investment Protection — TCO
Support for Legacy Technologies
• Oracle also preserves your other investments
– 10+ year guaranteed binary compatibility – save time and
money, load and run old applications without recompiling
– Run legacy software on new hardware via Oracle Solaris
Containers
• Oracle Solaris 8 or 9, Oracle Database 9i,10g,11g, and
older custom codes
– Broad compatibility with installed non-Oracle technologies
• SANs and networks
• Applications
• Management tools
• ...many more

21
Links to competitive details in reference section.
Non-Stop Database Operations
Predictive Self Healing
• Mitigating risk with unique features
– Can operate after memory and chip failures
– Guaranteed data path integrity – network to disk
– Provides fault and electrical isolation between domains
• Predictive Self Healing – detects and corrects
multitude of system failures without service disruption,
retries failed instructions
– Includes processor or system boards, memory, all levels of
cache, backplane, power source, power supply, fans, network
and storage connections, service processor, storage
components, etc.

22
• Simplify management with unique online service and
upgrade features
– Live HW addition or replacement (no reboot required) of system
boards* and memory*, I/O modules
• HP requires performance trade off for HA
• IBM does not support live system hardware upgrades
(hot swappable CPU/Memory boards)
– Live expansion of operating database instance after adding CPUs,
memory, I/O channels, storage capacity
• Online service and upgrades also include
– Repair and replacement of virtually all components
– Database, firmware, microcode and Oracle Solaris updates
– Live migration of databases between Oracle Solaris Containers
Non-Stop Database Operations (cont.)
Online Service and Upgrades
*Hot swap system and memory boards in M8000/M9000 only.Oracle Differentiator

23
Non-Disruptive Service, Repair and Upgrades
Eliminate Planned Downtime
• Live hardware expansion or
replacement
– System boards
(CPUs and memory)
– Power supplies and fans
– Network and storage
connections
– Service processor
– Storage system components
• Live growth of an operating
environment
– CPUs, memory, I/O channels,
storage capacity
• Live upgrades of
– Oracle Solaris
– Firmware and microcode
– Database
• Live migration of Databases
between Oracle Solaris
Containers

24
Investment Protection (and Availability)
Deployment Longevity, Legacy Support
• Oracle saves you money and downtime by providing a longer
system life
– Designed for in-system upgrades (3 and counting for M-Series)
vs. forklift replacements required by competitors
• Oracle upgrades can be 1/5 the cost of IBM*
– Add new processor speeds and generations to existing vs. 100%
replacement required by IBM
– New processors support existing I/O cards vs. replacement
sometimes required by competitors
– Extend system life by adding FlashFire to boost database
performance by up 2–4x
– In-system upgrades can be done non-disruptively, forklift
replacements can’t
*Links to competitive details in reference section.Oracle Differentiator

25
Agenda
– Oracle M-Series
– Oracle Solaris
– Oracle Storage

26
Oracle’s FlashFire Technology
Oracle’s Flash Accelerator
F20 PCIe Card
Oracle’s Storage F5100 Flash Array
Oracle’s Flash Module

27
Quick Intro to FlashFire
• Based on Oracle Flash Modules
– ‘Different’ than standard SSDs of others
– Optimized for database acceleration
• Unique RAS, environmental and performance
characteristics
Oracle’s Storage F5100 Flash Array

28
World Record Flash Performance
Storage Performance Council SPC-1C
• Oracle F5100 driven by M5000 vs. IBM EXP12s
driven by P575
– Nearly 7x better performance
• Delivered this in half the space of IBM
– 2.7x better access density (IOPS/GB)
– 2.5x better service times (better LRT and max recorded)
– 3.9x better price/performance
– 31% better $/GB
SPC-1C, SPC-1C IOPS, and SPC-1C LRT are trademarks of Storage Performance Council (SPC). See http://www.storageperformance.org for more
information. Sun Storage F5100 Flash Array SPC-1C submission identifier C00010 results of 300,873.47 SPC-1C IOPS over a total ASU capacity of
1374.390 GB using unprotected data protection, a SPC-1C LRT of 0.33 milliseconds, a 100% load over all ASU response time of 2.63 milliseconds and a
total TSC price (including three-year maintenance) of $151,381. This compares with IBM System Storage EXP12S SPC-1C/E Submission identifier
E00001 results of 45,000.20 SPC-1C IOPS over a total ASU capacity of 547.61 GB using unprotected data protection level, a SPC-1C LRT of 0.46
milliseconds, a 100% load over all ASU response time of 6.95 milliseconds and a total TSC price (including three-year maintenance) of $87,468.The Sun
Storage F5100 Flash Array is a 1RU (1.75") array. The IBM System Storage EXP12S is a 2RU (3.5") array.

29
World Record FlashFire Price/Performance
Storage Performance Council SPC-1C
• Oracle F20 driven by X4270M2 vs. IBM EXP12s
driven by P570
– 9x better price/performance
• In the same space (2 RU for Oracle, including our
workload server!)
– 6x better access density (IOPS/GB)
– 60% better performance
• At 1/5th the TSC price
– 50% better $/GB
SPC-1C, SPC-1C IOPS, and SPC-1C LRT are trademarks of Storage Performance Council (SPC). See http://www.storageperformance.org for more
information. Sun Flash Accelerator F20 PCIe Card SPC-1C submission identifier C00011 results of 72521.11 SPC-1C IOPS over a total ASU capacity of
147.413GB using unprotected data protection, and a total TSC price (not including three-year maintenance) of $15,553.55. This compares with IBM
System Storage EXP12S SPC-1C/E Submission identifier E00001 results of 45,000.20 SPC-1C IOPS over a total ASU capacity of 547.61GB using
unprotected data protection and a total TSC price (including three-year maintenance) of $87,468. The Sun Fire X4270M2 server with Sun Flash
Accelerator F20 PCIe cards is a 2RU (3.5") server, while the IBM System Storage EXP12S is a 2RU (3.5") array.

30
Agenda
– Oracle M-Series
– Oracle Solaris
– Oracle Storage

31
• Best value: 3 of top 10 SPC-2 results
• Best in class data-rate
– 5.6 SPC-2 GB/sec for 6780
– 1.2 SPC-2 GB/sec for 6180
• Outstanding service times
– 160 μs SPC-1 write LRT for 6780
– 340 μs SPC-1 write LRT for 6180
Oracle Storage 6000 Series

32
Sun Storage 6000: Data Rate Performance
• The SPC-2 benchmark results below show both the competitive advantage
and generational improvement of the Sun Storage 6780 array configured
using 8Gb fibre channel (FC) host interfaces using RAID 5 and RAID 6 data-
protection schemes
– The Sun Storage 6780 delivered the best price/performance of any top ten SPC-2
performers. All systems that performed better had at least 6x higher tested
storage configuration (TSC) prices
– The Sun Storage 6780 array delivered 58% better SPC-2 price/performance than
the IBM DS5300 on the SPC-2 benchmark in both RAID 5 and RAID 6
configurations
– The Sun Storage 6780 array delivered nearly identical performance for both
RAID 5 and RAID 6 configurations, showing only 1.6% less performance using
double-parity data protection (RAID 6) vs. single parity (RAID 5)
– The Sun Storage 6780 array delivered 4x more SPC-2 MB/sec than the previous
generation of Oracle's StorageTek 6540 array
– The Sun Storage 6780 array provides 1.7x better SPC-2 price/performance than
the previous-generation StorageTek 6540 array

33
Sun Storage 6000: Transactional Performance
• These SPC-1 benchmark results below show both the competitive
advantage and generational improvement of the Sun Storage 6780
array configured using 8Gb fibre channel (FC) host interfaces
– The Sun Storage 6780 array delivered 2.5x better performance, 3x better price/
performance, and over 2x better response times than the EMC CLARiiON CX3
Model 40
– The Sun Storage 6780 array delivered over 2x better SPC-1 price/performance
than the IBM DS5300 on the SPC-1 benchmark
– The Sun Storage 6780 array delivered 34% more SPC-1 IOPS than the previous
generation of Oracle's StorageTek 6540 array
– The Sun Storage 6780 array delivered a SPC-1 LRT of 1.78 milliseconds, which is
2.7x better than the StorageTek 6540 array SPC-1 LRT of 4.82 milliseconds

34
Sun Storage 6000: Best Practices
• Use SAME strategy throughout for all disk storage
– Strip And Mirror Everything
• Use ASM to manage 6000 series LUNS presented
• For high insert rate OLTP
– Insure Redo Logs have separate:
– Paths including HBAs, switch ports and controller ports
– LUNs — make sure SAME not mixed with other tables
– Sharing controllers OK with read heavy workloads: 6x80
provides good cache management

35
Agenda
– Oracle M-Series
– Oracle Solaris
– Oracle Storage

36
SPARC Enterprise M-Series Servers Dynamic
Reconfiguration Investment Protection Choice
• Dynamic reconfiguration
– Add or remove system boards without Oracle
instance downtime
• Database system server size can be Increased
without forklift approach
• M-Series extended system control facility
(XSCF) manage
– Access the system remotely
• Securely via SSH or SSL
– Dynamic Reconfiguration
• Add CPU Boards
• Add Memory Boards
• Add IO Boards

37
SPARC Enterprise M-Series Servers — Extended
System Control Facility (XSCF) Command Line
XSCF> showhardconf
SPARC Enterprise M4000 ;
+ Serial:BCF0712005; Operator_Panel_Switch:Locked;
+ Power_Supply_System:Single; SCF-ID:XSCF#0;
+ System_Power:On; System_Phase:Cabinet Power On;
Domain#0 Domain_Status:Running;
MBU_A Status:Normal; Ver:0101h; Serial:BF064202NR;
+ FRU-Part-Number:541-0894-02 ;
+ Memory_Size:16 GB;
CPUM#0-CHIP#0 Status:Normal; Ver:0201h; Serial:PP0631P640 ;
+ FRU-Part-Number:CA06761-D104 A3 ;
+ Freq:2.150 GHz; Type:16;
+ Core:2; Strand:2;
Snip
Power_Status:On; AC:200 V;
XSCF>
XSCF provides a command line interface to manage and
control the M-Series system via remote SSH or serial console

38
SPARC Enterprise M-Series Servers — Extended System
Control Facility (XSCF) Web Console
XSCF provides a web-based interface to manage and control
the M-Series system via SSL

39
XB
Domain #0 Domain #0
Best Practices for Dynamic Reconfiguration with DB
• Place all MCU and IOU in single domain
– If multi-domain required, ensure MCU/IOUs that could be moved between
domains have no I/O devices for faster DR config.
• Configure MCUs as Uni_XSB
– Quad_XSB not best practice as increases dynamic reconfiguration steps

40
Removing System Boards Live
For Reassignment or Replacement
• No reboot required: modest changes to DB CPU OK with instance restart
• Dynamic Intimate Shared Memory Allows add/remove/deletes for Oracle memory
– But take care in Oracle memory sizing to insure no instance restart required

41
CMU mounted with
SPARC64 VII only
CMU mounted with
SPARC64 VI only
CMU of mixed CPU
configuration
CMU of mixed CPU
configuration
Domain 0 Domain 2
CMU#0 CMU#1 CMU#2 CMU#3
Domain 1
SPARC64 VII processor SPARC64 VI processor
Adding System Boards Live
For Reassignment or Upgrades
• No reboot required: modest changes to DB CPU OK without instance restart
• Dynamic Intimate Shared Memory allows add/remove/deletes for Oracle memory
– But take care in Oracle memory sizing to insure no instance restart required
• Mixed memory and CPUs allowed
– Best practice to have same memory type within each SB

42
Agenda
– Oracle M-Series
– Oracle Solaris
– Oracle Storage

43
RAC for Non-Stop Operation
For Small and Medium Configurations: M5000
Shared Storage
and SAN
M5000
Memory
Coherence
M5000
Two Node RAC
Example
• Straight forward design
of No Single Point of
Failure (NSPF)
• Most of server and all of
SAN and storage hot
swap
• But RAC needed to
insure NSPF for
CPU/memory swap.

44
SGA, ISM and Non-Stop Operation
• Intimate Shared Memory –
Performance Benefits
– Locked – no swap, mutexes
– Saves kernel CPU, memory
resources
– Single cache for all Oracle
processes, IPC
• But cannot be resized
– So care with Dynamic
Reconfiguration
LOCKED
Memory
Shared
Processes

45
Dynamic Intimate Shared Memory
• Gives nearly all performance
benefits of ISM
– Also helps NUMA MPO
• But CAN be resized
– Much greater flexibility with
Dynamic Reconfiguration
– Allows Dynamic resize of SGA
• If no DR or dynamic SGA
sizing needed, use ISM.
LOCKED
Memory
Shared
Processes
Resize

46
No Reboot or Instance Restart!
Oracle Database
+ RAC
+ ASM
+ M-Series RAS
+ XSCF & Dynamic Reconfiguration
+ Solaris Optimizations (I.E. DISM)
NON-STOP OPERATIONS
• Set SGA_MAX_SIZE carefully
Only read at Oracle instance restart!
• IBM requires reboot, let alone instance restart!

47
Configuration Rule Best Practices
• For mid-range systems, configure each server as
RAC node instance
– Each node defines the availability granularity level
• For high-end systems, use M9000-32 or RAC
multiples of this system for best availability and
performance
• Use Dynamic Intimate Shared Memory (DISM) if
Dynamic Reconfiguration will be used

48
Agenda
– Oracle M-Series
– Oracle Solaris
– Oracle Storage

49
Do you have a Database I/O Bottleneck?
Using ADDM / AWR / Statspack
• Statspack ‘free’ PL code download since Oracle 8.1.7
• AWR since 10g
• Use SWAT to determine what causing waits.
Top 5 Timed Events Avg %Total
~~~~~~~~~~~~~~~~~~ wait Call
Event Waits Time (s) (ms) Time Wait Class
---------------------------- ---------- -------- ---- ------ ----------
db file sequential read 19,858,182 72,997 4 41.0 User I/O
CPU time 55,805 31.4
log file sync 3,840,570 33,452 9 18.8 Commit
log file parallel write 3,356,001 12,749 4 7.2 System I/O
db file scattered read 3,672,892 10,018 3 5.6 User I/O
-------------------------------------------------------------

50
Database I/O Bottlenecks: Wait Events
• Typical I/O wait types, foreground
– db file sequential read: disk to database buffer cache wait
– db file scatter read: wait for multi-block read into buffer cache
– read by other session: another session waiting for block above
– direct path read: read bypassing buffer cache directly into PGA
• Typical I/O wait types, background
– log file parallel write: write log data (typically to NVRAM) from LGWR
– db file parallel write: write to tables async from DBWR
– log file sequential read: to build archive log, DataGuard
– Log archive I/O, RMAN, etc.

51
Typical Storage Bottlenecks
• Maximum IOPS delivered
– Talked about the most, but least
important for enterprise Apps
– Really measures concurrency
• Maximum data rate delivered
– Really measured channel and disk
bandwidth
• Shortest service time delivered
– Usually most important for databases
• All are dependant on I/O workload
– Read-write mix
– Transfer/block size
– ‘Sequentiality’/randomness
Demand Supply
IOPS
MB/Sec
milliseconds

52
Storage I/O Interconnect Template (Small/Medium)
FC HBA
FLASH
10GE/IB
FLASH
NIC
FC HBA
FLASH
10GE/IB
FLASH
NIC
PCIe x8
0
1
2
3
4
0
1
2
3
4
8 Gb FC
24 Port
FC Switches
Controller A
Controller B
6180
FC Array
Controller
…
CSM2
Expansion
Trays
“RDAC”
Multipath I/O

53
Storage I/O Interconnect Template (Large/XLarge)
FC HBA
SAS
NIC
SAS
10GE/IB
FC HBA
SAS
NIC
SAS
10GE/IB
PCIe x8 (Slots 6&7 unused)
0
1
2
3
4
0
1
2
3
4
8 Gb FC
24 Port
FC Switches
Controller A
Controller B
6780
FC Array
Controller
…
CSM2
Expansion
Trays
“RDAC”
Multipath I/O
BASE
I/O
BASE
I/O
5
5

54
What is Oracle ASM?
Operating SystemOperating System
HardwareHardware
Oracle DatabaseOracle Database
ASM
File System & Volume Management
ASM
File System & Volume Management
Operating SystemOperating System
HardwareHardware
Logical Volume ManagerLogical Volume Manager
File SystemFile System
Oracle DatabaseOracle Database
• With Oracle 10g/11g, ASM provides
– Simplicity of management of a File System
– Performance equal to raw disks
– Provides a Cluster File System required for RAC
– Reduces storage product and management costs

55
Mission Critical Requires “Always Online”
ASM– Re-Balancing
• Automatic online rebalance whenever storage
configuration changes
Disk Group Disk Group
Disk Add
Rebalance

56
OSB Architecture Overview

57
Backup I/O Interconnect Template (Large example)
FC HBA
SAS
NIC
SAS
QDR IB
FC HBA
SAS
NIC
SAS
QDR IB
PCIe x8 (Slots 6&7 unused)
0
1
2
3
4
0
1
2
3
4
IPoIB-CM
40 Gb
36 Port
QDR IB Switches
T3-1
Media
Servers
Tape
Drives
BASE I/O
BASE I/O
5
5
FC HBA
FC HBA
QDR IB0
1
2
FC HBA
FC HBA
QDR IB0
1
2

58
Agenda
– Oracle M-Series
– Oracle Solaris
– Oracle Storage

59
Four FlashFire Deployment Practices
• 11gR2 Database Flash Cache – Single Node
• 11gR2 Database Flash Cache – RAC
• Use of Flash Disk Groups (ASM recommend)
– Proven to work very well with previous Oracle Database
Versions
– Single instance only
• Combination of Flash Cache and Flash Disk Groups
– Single instance only

60
11gR2 Database Flash Cache
• Acts as extension of SGA
buffer cache
• Reduces physical read I/Os
– Converts to logical I/O in DB
• Principally accelerates read
intensive workloads
Storage
Few
I/O’s
Buffer Cache
Storage
Buffer Cache
Database
Flash Cache
Many
I/O’s

61
O On O -- Flash Cache Acceleration
• 5X better
transaction times
• 5x better
transaction rates
• 3X better power
than HDD

62
Flash Disk Group Configuration
F5100 Flash Arrays
Mirrored
SAS x4
SAS x4
M-Series Server
• ASM Normal Redundancy (Flash Modules Mirrored)
• Failure groups across SAS domains
– Across chassis (shown,) even better
8Gb FC X 8
Logical View

63
Oracle’s Sun Storage F5100 Flash Array — Database
Accelerator and Flash Cache Target
• Large production database system performance increased with
database on Flash
– A production database of over 200 million objects was placed on Flash and
yielded 5x the performance improvement over existing system on both
• Oracle 10gR2 and Oracle 11gR2
• In addition, used as a target for Flash Cache with Oracle 11gR2
– Increases system efficiency even further
• 2x to 5x speedup with database on hard disk drives
• 3x Speedup with database on Flash above what was achieved
with improvements of the database on Flash in the first place!
• Focuses on two important metrics
– Database response times due to I/O latency and database bandwidth
throughput

64
F5100 Flash Array
Improves I/O
Performance
Oracle FlashFire Technology Reduces Database Latency
Use of Flash provides better response time
Increased System Efficiency
Accelerating a Large Production Oracle Database —
Improving I/O Response Time by 100x

65
Oracle FlashFire Technology Increases Database Throughput
Increased System Efficiency
Accelerating a Large Production Oracle Database —
Increasing Data I/O Bandwidth by 10x
F5100 Flash Array
Increases
Database Productivity
Use of Flash yields higher MB/s

66
Oracle’s Sun Storage F5100 Flash Array – Adding Flash
Cache Target and Dynamically Changing Settings

67
Agenda
– Oracle M-Series
– Oracle Solaris
– Oracle Storage

68
Next Steps
• Core Content in the Solution
– Systems Site (main), Systems Site (solutions)
– Main pages for - SPARC, Flash, Disk Storage, Unified Storage,
Oracle 11g, OEM Ops Center,
Oracle Solaris and Oracle Solaris Cluster,
StorageTek Workload Analysis Tool (SWAT)
• Oracle Customer Successes
– For all Servers (for Oracle database and M-Series, see Kookmin
Bank, ETSA Utilities, Ricoh Company Ltd., StubHub and others)
• Services Information
– Advanced Customer Services for Servers and Storage
Contact your local Oracle sales office for an
assessment of how we can help your organization

69
Resources (Additional)
Select technical content
• M-Series Architecture Paper
• High Availability Using M-Series paper
• External Benchmarks
• Oracle Enterprise Manager Ops Center:
Changing the Economics of Datacenter Operations
• Sun Systems Handbook
• Brief info on Oracle database Flash Recovery Area
• StorageTek Workload Analysis Tool
• Dynamic SGA Tuning of Oracle Database on Oracle Solaris with DISM
• Oracle Optimized Solution for Oracle Database: Storage Best Practices
• Oracle Optimized Solution for Oracle Secure Backup
• Oracle Solaris: Internal and OTN
• Oracle Solaris Cluster: Internal and External

72
<Insert Picture Here>
Appendix

73
Required Substantiation for Benchmarks
1)TPC-H, QphH, $/QphH tm of Transaction Processing Performance Council (TPC). More info www.tpc.org. TPC-H@3000GB as of
3/22/2011. Sun SPARC Enterprise M9000 server: 386,478.3 QphH@3000GB, $19.25/QphH@3000GB, available 09/20/2011 (world record
non-clustered TPC-H 3TB result). Sun SPARC Enterprise M9000 server: 198,907.5 QphH@3000GB, $16.58/QphH@3000GB, available
12/09/2010. IBM POWER 595 Model 9119-FHA, 156,537.3 QphH@3000GB, $20.60/QphH@3000GB, available 11/24/2009. (Best IBM TPC-H
3000GB performance (QphH) and price/performance ($/QphH) result)
2) SPEC, SPECjAppServer are registered trademarks of Standard Performance Evaluation Corporation. Results as of March 7, 2011.
Source: www.spec.org. SPECjAppServer2004. App. tier: Sun SPARC Enterprise T5440 cluster (20 chips, 160 cores) 28,648.74
SPECjAppServer2004 JOPS@Standard. DB tier: Sun SPARC Enterprise M9000. App. Tier: HP BL870c cluster (68 chips, 136 cores)
28,463.03 SPECjAppServer2004 JOPS@Standard. DB tier: HP Superdome 9000. App. tier: IBM HS21 cluster (32 chips, 128 cores)
22,634.13 SPECjAppServer2004 JOPS@Standard. DB tier: IBM p595.
3)Oracle's PeopleSoft Payroll NA 9.0. Sun SPARC Enterprise M4000 (4x 2.53GHz SPARC64) 43.78 min, IBM Z990 (6 gen1) 91.70 min, HP
rx6600 (4 1.6GHz Itanium2) 68.07 min, Oracle's PeopleSoft Payroll NA 9.0. Sun SPARC Enterprise M5000 (8 2.53GHz SPARC64 VII) 50.11
min, IBM z10 (9 gen1) 58.96 min, HP rx7640 (8 1.6GHz Itanium2) 96.17 min www.oracle.com/apps_benchmark/html/white-papers-
peoplesoft.html
4)Oracle's PeopleSoft Financials 9.0. SPARC T3-1 (1x 1.65GHz SPARC-T3), Oracle's SPARC Enterprise M5000 (8 2.53GHz SPARC64),
38.66 min. http://www.oracle.com/us/solutions/benchmark/apps-benchmark/ora-fin-d-i-t-l-oracle-m4k-286901.pdf
5)Oracle Essbase: www.oracle.com/solutions/mid/oracle-hyperion-enterprise.html, as of 3/3/2011.
6)Copyright 2011, Oracle and/or its affiliates. All rights reserved. Oracle and Java are registered trademarks of Oracle and/or its
affiliates. Other names may be trademarks of their respective owners. Results as of 3/6/2011.
7)Oracle’s PeopleSoft Campus 9.0. For more information, please see http://www.oracle.com/us/solutions/benchmark/apps-
benchmark/ps9-campus-9-ora-sun-sparc-solaris-166427.pdf

74
M-Series ZERO Downtime Database Availability
Achieving Resiliency
• Sustain operations after
failure of
– Processor or memory chip,
system board
– System backplane
– Power source, supply or fan
– Network and storage connection
– Service processor
• Fault and electrical isolation
between domains
• Guaranteed data path integrity –
network to disk
• Automatic self healing of Service
processor
– Recover and retry failed
instructions
– SRAM registers
– Correct double bit memory failures
– Storage and network I/O path
• Oracle RAC and cluster support

75
M-Series Scaling, Expansion and Upgrading
Deployment Longevity
• Oracle Solaris – proven scaling
– Over 144 CPUs since 2004
• Single system scaling to
– 4TB in a single NUMA memory
image
– 64 sockets, 256 cores, 512
simultaneous threads
– 737 GB/sec system
interconnect bandwidth
– 776 MB of cache
• Ease of upgrades
– 12+ year SPARC binary
compatibility guarantee
– 3rd in-chassis hardware
upgrade and counting
– Live reallocation of CPU,
memory and I/O resources
– Support for legacy software
stack on new hardware
• Broad industry support
– 3rd party applications
– 3rd party SAN and network
solutions

Optimize solution for oracle db technical presentation

More Related Content

What's hot

Similar to Optimize solution for oracle db technical presentation

More from xKinAnx

Recently uploaded

Optimize solution for oracle db technical presentation

Editor's Notes