Uploaded byadmdbarac
PDF, PPTX2,448 views

11g r2 rac grid clusterware doug presentation 10 21-10

./orainstRoot.sh -deleteInventory 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 53 Step 17 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 54 Step 18 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 55 Step 19 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 56 Step 20 11GR2 Grid Clusterware

Embed presentation

Download as PDF, PPTX
11gR2 RAC/Grid Clusterware: Best Practices, Pitfalls, and Lessons Learned Presented during DOUG meeting held on 10/21/2010 at Dallas, TX Ramkumar Rajagopal Presented on 10/21/2010 at DOUG meeting in Dallas, TX 1
Introduction DBARAC is a specialty database consulting firm with expertise in a variety of industries based at Austin, Texas. Our people are experts in Oracle Real application clustered database focused solutions for managing large database systems. We provide proactive database management services including but not limited to In-house, on-shore DBA support , remote DB support, database maintenance and backup and recovery. Our DBA Experts provide specialized services in the areas of - Root cause analysis Capacity planning Performance tuning, Database migration and consolidation Broad industry expertise High-Availability RAC database specialists End-to-end database support 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 2
Introduction Presenter • Senior Database Consultant DBARAC • Oracle Database/Applications DBA since 1995 • Dell, JP Morgan Chase, Verizon • Presenter @ Oracle Open world 2007 • Author Dell Power Solutions articles 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 3
AGENDA • Introduction • Node eviction issue in 10g • What is “11GR2 Grid Clusterware”? • The Challenges • What’s different today? • “We’ve seen this before, smart guy…” • Architecture and Capacity Planning • Upgrade Paths • Pre-installation best practices • Grid Clusterware Installation • Clusterware Startup sequence • Post Install steps • RAC Database build steps • Summary • Q&A 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 4
Why a node is evicted? • Split brain condition • • IO fencing • CRS keeps the lowest number node up • Node eviction detection 11GR2 Grid clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 5
Root Causes of Node Eviction Network heartbeat lost Voting disk problems cssd is not healthy Oprocd Hang check timer cssd and oclsomon race to suicide 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 6
11GR2 Grid Clusterware Improvements • Node eviction algorithm is enhanced • Prevent a split-brain problem without rebooting the node • Oracle High Availability Services Daemon • Will still reboot in some cases • Faster relocation of services on node failure in 11GR2 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 7
9i/10g RAC Scenario • Several separate versions of databases • Several servers • Space/resource issues • Lesser resources • Provisioning takes time 11GR2 Grid clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 8
Top concerns • How many are using 11GR2 Grid clusterware? • Do you have more than one mission-critical databases within single RAC cluster? • Can you allocate resources dynamically to handle peak volumes of various application loads without downtime? • Issues on using shared infrastructure • Will my database availability and recovery suffer ? • Will my database performance suffer ? • How to manage a large clustered environment to meet sla’s for several applications? 11GR2 Grid clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 9
Why 11GR2 Grid CRS? 11GR2 Grid Clusterware is… An Architecture An IT Strategy – Clusterware & ASM storage deployed together – Many, many Oracle Database Instances – Drives Consolidation 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 10
Challenges • Skilled resources • Meeting SLA’s • End-to-end testing not possible • Security Controls • Capacity issues • Higher short-term costs 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 11
What’s different today? • 11gR2 Grid CRS & ASM supports • 11GR2, 11GR1, 10gR1 and 10gR2 Single Instances • • Powerful servers, 64Bit O/s • Provisioning Framework to deploy • Grid control 11GR2 Grid clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 12
11GR2 RAC DB Architecture Planning 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 13
Capacity Planning • What are the current requirements? • What are the future growth requirements in the next 6-12months? • To meet the demand – estimate the hardware requirements • Data retention requirements • Archiving and purging 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 14
Capacity Planning metrics • Database metrics for capacity planning • CPU & memory Utilization • I/O rates • Device utilization • Queue length • Storage utilization • Response time • Transaction rate • Network Packet loss • Network Bandwidth utilization 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 15
Capacity Planning Strategy • Examine existing engagement processes • Examine existing capacity of servers/storage • Define Hardware/database scalability • Provisioning for adding capacity • Integration testing • Large clustered database • SLA requirements • 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 16
Comparison – 10g vs 11GR2 • Server consolidation • Database consolidation • Instance consolidation • Storage consolidation 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 17
AGENDA so far… • Introduction • Node eviction issue in 10g • What is “11GR2 Grid clusterware”? • The Challenges • What’s different today? • “We’ve seen this before, smart guy…” • Architecture and Capacity Planning • Upgrade Paths • Pre-installation best practices • Grid Clusterware Installation • Clusterware Startup sequence • Post Install steps • RAC Database build steps • Summary • Q&A 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 18
• Upgrade Paths • Out-of-place clusterware upgrade • Rolling Upgrade • Oracle 10gR2 - from 10.2.0.3 • Oracle 11gR1 - from 11.1.0.6 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 19
Pre-installation best practices • Network Requirements • Cluster Hardware Requirements • ASM Storage Requirements • Verification Checks 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 20
Pre-Installation best practices Network Configuration • SCAN -Single Client Access Name • Failover - Faster relocation of services • Better Load balancing • MTU package size of Network Adapter (NIC) • Forwarder, zone entries and reverse lookup • Ping tests • Two dedicated interconnect switches for redundant interconnects • Run cluvfy 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 21
Pre install - Network - SCAN Configuration 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 22
Pre Install Network - SCANVIP Troubleshooting • SCAN Configuration: • $GRID_HOME/bin/srvctl config scan • SCAN Listener Configuration: • $GRID_HOME/bin/srvctl config scan_listener • SCAN Listener Resource Status: • $GRID_HOME/bin/crsctl stat res -w "TYPE = ora.scan_listener.type“ • $GRID_HOME/Listener.ora • Local and remote listener parameters 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 23
Pre Install -Cluster Hardware requirements • Os/kernel same on all servers in the cluster • Minimum 32 GB of RAM • Minimum Swap space 16GB • Minimum Grid Home free space 16GB • For each Oracle Home directory allocate 32 GB of space (for each db -32GB) • Allocate adequate disk space for centralized backups • Allocate adequate storage for ASM diskgroups – DATA and FRA 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 24
Cluster Hardware requirements continued… Most cases: use UDP over 1 Gigabit Ethernet For large databases - Infiniband/IP or 10 Gigabit Ethernet Use OS Bonding/teaming to “virtualize” interconnect Set UDP send/receive buffers high enough Crossover cables are not supported 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 25
Pre Install - ASM Storage configuration • In 11gR2 ASM diskgroups are used • Grid infrastructure - OCR, Voting disk and ASMspfile. • Database - DATA and FRA. • OCR and voting disks for Grid clusterware • OCR can now be stored in Automatic Storage Management (ASM). • Add Second diskgroup for ocr using • - ./ocrconfig -add +DATA02 Change the compatibility of the new diskgroup to 11.2 as follows: ALTER DISKGROUP DATA02 SET ATTRIBUTE ‘COMPATIBILITY.ASM’=’11.2’; ALTER DISKGROUP DATA02 SET ATTRIBUTE ‘COMPATIBILITY.RDBMS’=’11.2’; 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 26
AGENDA so far… • Introduction • Node eviction issue in 10g • What is “11GR2 Grid clusterware”? • The Challenges • What’s different today? • “We’ve seen this before, smart guy…” • Architecture and Capacity Planning • Upgrade Paths • Pre-installation best practices • Grid Clusterware Installation • Clusterware Startup sequence • Post Install steps • RAC Database build steps • Q&A 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 27
Hardware/Software details • 10gR2 architecture – 9 database servers, 25TB storage – Original Database Version: 10.2.0.5 – Original RAC cluster version : 10.2.0.1 – Original Operating System: Ret Hat Linux 5 As 64 Bit – Storage Type : ASM & RAW Storage • 11gR2 Grid architecture – 4 database servers, 40TB storage – New Database Version: 11.2.0.2 – New Grid Clusterware/ASM version: 11.2.0.2 – New Operating System : Ret Hat Linux 5 As 64Bit – Data migration steps using Rman backup and restore and data pump export dump files 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 28
11GR2 Migration Steps • Install 11gR2 Grid clusterware and Asm • Install 11gR2 database binaries for each database separately • Create the 11gR2 database • Add additional ASM diskgroups • Install 11GR1/10gR2 database binaries • Create 11GR1/10gR2 databases • Take backup • Restore the data 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 29
Pre-verification checks- cluvfy • Before Clusterware installation • ./cluvfy stage -pre crsinst -n node1,node2, node3 –verbose • Before Database installation • ./cluvfy stage -pre dbinst -n node1,node2, node3 -fixup -verbose 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 30
11gR2 Grid Clusterware Installation – Step 1 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 31
Step-2 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 32
Step-3 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 33
Step-4 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 34
Step 5 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 35
Step 6 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 36
Step 7 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 37
Step 8 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 38
Step 8 cont.. 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 39
Step 9 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 40
Step 9 cont... 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 41
Step 10 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 42
Step 11 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 43
Step 11 cont.. 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 44
Step 12 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 45
Step 12 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 46
Step 13 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 47
Step 14 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 48
Runfixup.sh 11GR2 Grid Clusterware • root> /tmp/runfixup.sh • Response file being used is :/tmp/CVU_11.2.0.1.0_grid/fixup.response • Enable file being used is :/tmp/CVU_11.2.0.1.0_grid/fixup.enable • Log file location: /tmp/CVU_11.2.0.1.0_grid/orarun.log • Setting Kernel Parameters... • fs.file-max = 327679 • fs.file-max = 6815744 • net.ipv4.ip_local_port_range = 9000 65500 • net.core.wmem_max = 262144 • net.core.wmem_max = 1048576 • uid=501(grid)gid=502(oinstall)groups=502(oinstall), • 503(asmadmin),504(asmdba) Presented on 10/21/2010 at DOUG meeting in Dallas, TX 49
Step 15 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 50
Step 16 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 51
Step 16 cont.… 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 52
./orainstRoot.sh 11GR2 Grid Clusterware Cd /home/oracle/oraInventory [root@oradb-grid1 oraInventory]# ./orainstRoot.sh Changing permissions of /home/oracle/oraInventory. Adding read, write permissions for group. Removing read,write,execute permissions for world. Changing groupname of /home/oracle/oraInventory to oinstall. The execution of the script is complete. [root@oradb-grid1 oraInventory]# cd /u01/app/oracle [root@oradb-grid1 oracle]# ls product scripts [root@oradb-grid1 oracle]# cd product [root@oradb-grid1 product]# ls 11.2.0 [root@oradb-grid1 product]# cd 11* [root@oradb-grid1 11.2.0]# ls grid [root@oradb-grid1 11.2.0]# cd db* [root@oradb-grid1 grid]# ls root* root.sh [root@oradb-grid1 grid]# ./root.sh Running Oracle 11g root.sh script... Presented on 10/21/2010 at DOUG meeting in Dallas, TX 53
./orainstRoot.sh 11GR2 Grid Clusterware The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /u01/app/oracle/product/11.2.0/grid Enter the full pathname of the local bin directory: [/usr/local/bin]: The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: Creating /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. 2009-10-02 10:31:44: Parsing the host name 2009-10-02 10:31:44: Checking for super user privileges 2009-10-02 10:31:44: User has super user privileges Using configuration parameter file: /u01/app/oracle/product/11.2.0/grid/crs/install/crsconfig_params Creating trace directory LOCAL ADD MODE Presented on 10/21/2010 at DOUG meeting in Dallas, TX 54
./orainstRoot.sh 11GR2 Grid Clusterware Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. root wallet root wallet cert root cert export peer wallet profile reader wallet pa wallet peer wallet keys pa wallet keys peer cert request pa cert request peer cert pa cert peer root cert TP profile reader root cert TP pa root cert TP peer pa cert TP pa peer cert TP profile reader pa cert TP profile reader peer cert TP peer user cert pa user cert Adding daemon to inittab Presented on 10/21/2010 at DOUG meeting in Dallas, TX 55
./orainstRoot.sh 11GR2 Grid Clusterware CRS-4123: Oracle High Availability Services has been started. ohasd is starting CRS-2672: Attempting to start 'ora.gipcd' on 'oradb-grid1' CRS-2672: Attempting to start 'ora.mdnsd' on 'oradb-grid1' CRS-2676: Start of 'ora.gipcd' on 'oradb-grid1' succeeded CRS-2676: Start of 'ora.mdnsd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'oradb-grid1' CRS-2676: Start of 'ora.gpnpd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'oradb-grid1' CRS-2676: Start of 'ora.cssdmonitor' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'oradb-grid1' CRS-2672: Attempting to start 'ora.diskmon' on 'oradb-grid1' CRS-2676: Start of 'ora.diskmon' on 'oradb-grid1' succeeded CRS-2676: Start of 'ora.cssd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.ctssd' on 'oradb-grid1' CRS-2676: Start of 'ora.ctssd' on 'oradb-grid1' succeeded ASM created and started successfully. DiskGroup DATA created successfully. Presented on 10/21/2010 at DOUG meeting in Dallas, TX 56
./orainstRoot.sh 11GR2 Grid Clusterware clscfg: -install mode specified Successfully accumulated necessary OCR keys. Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. CRS-2672: Attempting to start 'ora.crsd' on 'oradb-grid1' CRS-2676: Start of 'ora.crsd' on 'oradb-grid1' succeeded CRS-4256: Updating the profile Successful addition of voting disk 659585bf3a834f39bf281fd47e9ed6db. Successful addition of voting disk 762177cd6f844f25bfc677fb681a02ab. Successful addition of voting disk 154c17a0de9c4ffdbff9a3b2f22b52f6. Successfully replaced voting disk group with +DATA. CRS-4256: Updating the profile CRS-4266: Voting file(s) successfully replaced ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 659585bf3a834f39bf281fd47e9ed6db (/dev/oracleasm/disks/VOL1) [DATA] 2. ONLINE 762177cd6f844f25bfc677fb681a02ab (/dev/oracleasm/disks/VOL2) [DATA] 3. ONLINE 154c17a0de9c4ffdbff9a3b2f22b52f6 (/dev/oracleasm/disks/VOL4) [DATA] Located 3 voting disk(s). Presented on 10/21/2010 at DOUG meeting in Dallas, TX 57
./orainstRoot.sh 11GR2 Grid Clusterware CRS-2673: Attempting to stop 'ora.crsd' on 'oradb-grid1' CRS-2677: Stop of 'ora.crsd' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'oradb-grid1' CRS-2677: Stop of 'ora.asm' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.ctssd' on 'oradb-grid1' CRS-2677: Stop of 'ora.ctssd' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'oradb-grid1' CRS-2677: Stop of 'ora.cssdmonitor' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'oradb-grid1' CRS-2677: Stop of 'ora.cssd' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.gpnpd' on 'oradb-grid1' CRS-2677: Stop of 'ora.gpnpd' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'oradb-grid1' CRS-2677: Stop of 'ora.gipcd' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.mdnsd' on 'oradb-grid1' CRS-2677: Stop of 'ora.mdnsd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.mdnsd' on 'oradb-grid1' CRS-2676: Start of 'ora.mdnsd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'oradb-grid1' CRS-2676: Start of 'ora.gipcd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'oradb-grid1' CRS-2676: Start of 'ora.gpnpd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'oradb-grid1' CRS-2676: Start of 'ora.cssdmonitor' on 'oradb-grid1' succeeded Presented on 10/21/2010 at DOUG meeting in Dallas, TX 58
./orainstRoot.sh 11GR2 Grid Clusterware CRS-2672: Attempting to start 'ora.cssd' on 'oradb-grid1' CRS-2672: Attempting to start 'ora.diskmon' on 'oradb-grid1' CRS-2676: Start of 'ora.diskmon' on 'oradb-grid1' succeeded CRS-2676: Start of 'ora.cssd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.ctssd' on 'oradb-grid1' CRS-2676: Start of 'ora.ctssd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.asm' on 'oradb-grid1' CRS-2676: Start of 'ora.asm' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.crsd' on 'oradb-grid1' CRS-2676: Start of 'ora.crsd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.evmd' on 'oradb-grid1' CRS-2676: Start of 'ora.evmd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.asm' on 'oradb-grid1' CRS-2676: Start of 'ora.asm' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.DATA.dg' on 'oradb-grid1' CRS-2676: Start of 'ora.DATA.dg' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.registry.acfs' on 'oradb-grid1' CRS-2676: Start of 'ora.registry.acfs' on 'oradb-grid1' succeeded Presented on 10/21/2010 at DOUG meeting in Dallas, TX 59
./orainstRoot.sh 11GR2 Grid Clusterware oradb-grid1 2009/10/02 10:37:08 /u01/app/oracle/product/11.2.0/grid/cdata/oradb- grid1/backup_20091002_103708.olr Preparing packages for installation... cvuqdisk-1.0.7-1 Configure Oracle Grid Infrastructure for a Cluster ... succeeded Updating inventory properties for clusterware Starting Oracle Universal Installer... Checking swap space: must be greater than 500 MB. Actual 39997 MB Passed The inventory pointer is located at /etc/oraInst.loc The inventory is located at /home/oracle/oraInventory 'UpdateNodeList' was successful. oradb-grid2 output :- [root@oradb-grid2 oraInventory]# pwd /home/oracle/oraInventory [root@oradb-grid2 oraInventory]# ./orainstRoot.sh Changing permissions of /home/oracle/oraInventory. Presented on 10/21/2010 at DOUG meeting in Dallas, TX 60
Step 16 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 61
Step 16 cont.… 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 62
Grid CRS Startup sequence 11GR2 Grid Clusterware OHASD oraRootAgent oraAgent cssdAgent cssdMonitor crsd ctssd Diskmon ACFS mdnsd gipcd gpnpd evmd crsdRootAgent GCS VIP ASM crsdOraAgent networkResource SCAN VIPs Node VIPs ACFS Reg DB Resource SCAN Listener Services ONS Presented on 10/21/2010 at DOUG meeting in Dallas, TX 63
Clusterware verification Clusterware processes – $ ps -ef|grep -v grep |grep d.bin oracle 9824 1 0 Jul14 ? 00:00:00 /u01/app/grid11gR2/bin/oclskd.bin root 22161 1 0 Jul13 ? 00:00:15 /u01/app/grid11gR2/bin/ohasd.bin reboot oracle 24161 1 0 Jul13 ? 00:00:00 /u01/app/grid11gR2/bin/mdnsd.bin oracle 24172 1 0 Jul13 ? 00:00:00 /u01/app/grid11gR2/bin/gipcd.bin oracle 24183 1 0 Jul13 ? 00:00:03 /u01/app/grid11gR2/bin/gpnpd.bin oracle 24257 1 0 Jul13 ? 00:01:26 /u01/app/grid11gR2/bin/ocssd.bin root 24309 1 0 Jul13 ? 00:00:06 /u01/app/grid11gR2/bin/octssd.bin root 24323 1 0 Jul13 ? 00:01:03 /u01/app/grid11gR2/bin/crsd.bin reboot root 24346 1 0 Jul13 ? 00:00:00 /u01/app/grid11gR2/bin/oclskd.bin oracle 24374 1 0 Jul13 ? 00:00:03 /u01/app/grid11gR2/bin/evmd.bin 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 64
Clusterware verification Clusterware checks – $ crsctl check crs CRS-4638: Oracle High Availability Services is online CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online $ crsctl check has CRS-4638: Oracle High Availability Services is online $ crsctl query crs activeversion Oracle Clusterware active version on the cluster is [11.2.0.2.0] 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 65
Clusterware verification Clusterware processes $ crsctl check cluster -all ************************************************************** rat-rm2-ipfix006: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** rat-rm2-ipfix007: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** rat-rm2-ipfix008: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 66
Clusterware verification $ crsctl status resource -t NAME TARGET STATE SERVER STATE_DETAILS ------------------------------------------------ ora.DATA.dg ASM disk group (new resource) ONLINE ONLINE rat-rm2-ipfix006 ONLINE ONLINE rat-rm2-ipfix007 ONLINE ONLINE rat-rm2-ipfix008 ora.LISTENER.lsnr ONLINE ONLINE rat-rm2-ipfix006 ONLINE ONLINE rat-rm2-ipfix007 ONLINE ONLINE rat-rm2-ipfix008 ora.asm ONLINE ONLINE rat-rm2-ipfix006 Started ONLINE ONLINE rat-rm2-ipfix007 Started ONLINE ONLINE rat-rm2-ipfix008 Started ora.eons new resource ONLINE ONLINE rat-rm2-ipfix006 ONLINE ONLINE rat-rm2-ipfix007 ONLINE ONLINE rat-rm2-ipfix008 ora.gsd 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 67
Post Install Steps • One-off patch –unlock the Grid home first • # perl rootcrs.pl -unlock -crshome /u01/app/11.2.0/grid • Download and Install the latest Patch Updates • Back Up the root.sh Script • Install Cluster Health Management • Install OS Watcher and RACDDT • Check the backups of OCR and voting disks • Lock the Grid home after patch installation 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 68
Manageability • Grid control • Adding/dropping nodes • Automatically discovers services • Policy-based cluster management • Automated Cluster Patching • End to end management of the cluster 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 69
flexibility Scalability & Flexibility • Sever pools of hardware available • Consolidation of hardware and storage • Rapid provisioning of resources to add capacity where its required • Improved utilization of resources • Better ROI 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 70
Summary • Reduced Hardware • Improved availability –SLAs • Shorter Time to add additional server or storage • Higher Security • Data Sharing & visibility • Better application performance • Centralized backup and archive • Higher ROI – higher utilization • Manageability • Pride in Ownership, Eliminating the Assembly Line • Bottom line = reduce TCO! 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 71
References • 11gR2Oracle® Clusterware Administration and Deployment Guide • Metalink ID 1054902.1 for Network configuration • RAC Assurance Support Team: RAC Starter Kit and Best Practices (Linux) • Metalink NOTE:887522.1 - 11gR2 Grid Infrastructure Single Client Access Name • Metalink NOTE:946452.1 - DNS and DHCP Setup Example for Grid Infrastructure GNS Metalink Pre 11.2 Database Issues in 11gR2 Grid Infrastructure Environment [ID 948456.1] 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 72
11GR2 Grid cluster Q & A Email @ ramkumar.rajagopal@dbarac.com 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 73

More Related Content

PDF
Vizuri Exadata East Coast Users Conference
byIsaac Christoffersen
 
PDF
How to Modernize Your Database Platform to Realize Consolidation Savings
byIsaac Christoffersen
 
PDF
Introduction to GlusterFS Webinar - September 2011
byGlusterFS
 
DOC
karthik_resume
byKarthik Borige
 
PPT
An Introduction to Netezza
byVijaya Chandrika
 
PPTX
Collaborate 17 - Database consolidation using the oracle multitenant architec...
byPini Dibask
 
PPTX
5 Steps for Migrating Relational Databases to Next-Gen Architectures
byNuoDB
 
PDF
London + Dublin Cassandra 2.0
byjbellis
 
Vizuri Exadata East Coast Users Conference
byIsaac Christoffersen
 
How to Modernize Your Database Platform to Realize Consolidation Savings
byIsaac Christoffersen
 
Introduction to GlusterFS Webinar - September 2011
byGlusterFS
 
karthik_resume
byKarthik Borige
 
An Introduction to Netezza
byVijaya Chandrika
 
Collaborate 17 - Database consolidation using the oracle multitenant architec...
byPini Dibask
 
5 Steps for Migrating Relational Databases to Next-Gen Architectures
byNuoDB
 
London + Dublin Cassandra 2.0
byjbellis
 

What's hot

PDF
Integrating data stored in rdbms and hadoop
byleorick lin
 
PDF
Hadoop 3.0 - Revolution or evolution?
byUwe Printz
 
PDF
State of Cassandra 2012
byjbellis
 
PDF
From docker to kubernetes: running Apache Hadoop in a cloud native way
byDataWorks Summit
 
PPTX
Lessons Learned From Running 1800 Clusters (Brooke Jensen, Instaclustr) | Cas...
byDataStax
 
PDF
Home For Gypsies – Storage for NoSQL Databases​
byAtish Kathpal
 
PDF
Yarn 3.1 and Beyond in ApacheCon North America 2018
byNaganarasimha Garla
 
PDF
FAQ
bymobigen
 
PDF
Mcitp server administrator
by97148881557
 
PDF
Cisco UCS Integrated Infrastructure for Big Data with Cassandra
byDataStax Academy
 
PPTX
Red Hat Storage Day Seattle: Stabilizing Petabyte Ceph Cluster in OpenStack C...
byRed_Hat_Storage
 
PDF
Using R on Netezza
byAjay Ohri
 
PDF
Cassandra 1.1
byjbellis
 
PDF
Practical Partitioning in Production with Postgres
byEDB
 
PDF
Deploying OpenStack Private Cloud on NEC DX1000 MicroServer Chassis
byPrincipled Technologies
 
PDF
GLORIAD's New Measurement and Monitoring System
byEd Dodds
 
PPTX
Building Data Pipelines with SMACK: Designing Storage Strategies for Scale an...
byDataStax
 
PPT
Managing user Online Training in IBM Netezza DBA Development by www.etraining...
byRavikumar Nandigam
 
PDF
DX2000 from NEC lets you put big data to work
byPrincipled Technologies
 
DOC
zahidCvFinal(Updated Jan 17)-2
byZahid Ayub
 
Integrating data stored in rdbms and hadoop
byleorick lin
 
Hadoop 3.0 - Revolution or evolution?
byUwe Printz
 
State of Cassandra 2012
byjbellis
 
From docker to kubernetes: running Apache Hadoop in a cloud native way
byDataWorks Summit
 
Lessons Learned From Running 1800 Clusters (Brooke Jensen, Instaclustr) | Cas...
byDataStax
 
Home For Gypsies – Storage for NoSQL Databases​
byAtish Kathpal
 
Yarn 3.1 and Beyond in ApacheCon North America 2018
byNaganarasimha Garla
 
FAQ
bymobigen
 
Mcitp server administrator
by97148881557
 
Cisco UCS Integrated Infrastructure for Big Data with Cassandra
byDataStax Academy
 
Red Hat Storage Day Seattle: Stabilizing Petabyte Ceph Cluster in OpenStack C...
byRed_Hat_Storage
 
Using R on Netezza
byAjay Ohri
 
Cassandra 1.1
byjbellis
 
Practical Partitioning in Production with Postgres
byEDB
 
Deploying OpenStack Private Cloud on NEC DX1000 MicroServer Chassis
byPrincipled Technologies
 
GLORIAD's New Measurement and Monitoring System
byEd Dodds
 
Building Data Pipelines with SMACK: Designing Storage Strategies for Scale an...
byDataStax
 
Managing user Online Training in IBM Netezza DBA Development by www.etraining...
byRavikumar Nandigam
 
DX2000 from NEC lets you put big data to work
byPrincipled Technologies
 
zahidCvFinal(Updated Jan 17)-2
byZahid Ayub
 

Viewers also liked

PPSX
Oracle 11g R2 RAC implementation and concept
bySantosh Kangane
 
PDF
UTHOC2 - Under The Hood of Oracle Clusterware 2.0 - Grid Infrastructure by Al...
byAlex Gorbachev
 
PDF
Paper: Oracle RAC and Oracle RAC One Node on Extended Distance (Stretched) Cl...
byMarkus Michalewicz
 
PPTX
Oracle RAC - Standard Edition, Enterprise Edition & One Node
byLeighton Nelson
 
PDF
Understanding oracle rac internals part 2 - slides
byMohamed Farouk
 
PPTX
OpenStack + VMware at the Hong Kong OpenStack Summit
byDan Wendlandt
 
PDF
Understanding oracle rac internals part 1 - slides
byMohamed Farouk
 
PPTX
Understand oracle real application cluster
bySatishbabu Gunukula
 
PDF
Understanding Oracle RAC 11g Release 2 Internals
byMarkus Michalewicz
 
DOCX
Dba 3+ exp qus
bykrreddy21
 
DOCX
Oracle 12c RAC On your laptop Step by Step Implementation Guide 1.0
byYury Velikanov
 
PDF
RMAN best practices for RAC
bySyed Hussain
 
PDF
Alphorm.com Support de la formation Vmware Esxi 6.0
byAlphorm
 
Oracle 11g R2 RAC implementation and concept
bySantosh Kangane
 
UTHOC2 - Under The Hood of Oracle Clusterware 2.0 - Grid Infrastructure by Al...
byAlex Gorbachev
 
Paper: Oracle RAC and Oracle RAC One Node on Extended Distance (Stretched) Cl...
byMarkus Michalewicz
 
Oracle RAC - Standard Edition, Enterprise Edition & One Node
byLeighton Nelson
 
Understanding oracle rac internals part 2 - slides
byMohamed Farouk
 
OpenStack + VMware at the Hong Kong OpenStack Summit
byDan Wendlandt
 
Understanding oracle rac internals part 1 - slides
byMohamed Farouk
 
Understand oracle real application cluster
bySatishbabu Gunukula
 
Understanding Oracle RAC 11g Release 2 Internals
byMarkus Michalewicz
 
Dba 3+ exp qus
bykrreddy21
 
Oracle 12c RAC On your laptop Step by Step Implementation Guide 1.0
byYury Velikanov
 
RMAN best practices for RAC
bySyed Hussain
 
Alphorm.com Support de la formation Vmware Esxi 6.0
byAlphorm
 

Similar to 11g r2 rac grid clusterware doug presentation 10 21-10

PPT
Upgrade 11gR2 to 12cR1 Clusterware
byNikhil Kumar
 
PPSX
RAC - The Savior of DBA
byNikhil Kumar
 
PDF
Managing troubleshooting cluster_360dgrees
bySyed Hussain
 
PPT
Extreme Availability using Oracle 12c Features: Your very last system shutdown?
byToronto-Oracle-Users-Group
 
PPT
Oracle clusterware overview_11g_en
by小新 制造
 
PDF
AIOUG-GroundBreakers-Jul 2019 - 19c RAC
bySandesh Rao
 
PDF
Presentation 12c grid_upgrade
byJacques Kostic
 
DOC
Oracle10g rac course_contents
byamolmh
 
PDF
Oracle RAC 12c Overview
byMarkus Michalewicz
 
PPT
les_01.ppt of the Oracle course train_1 file
byYulinLiu27
 
PDF
Troug 11 gnf
bySyed Hussain
 
PDF
The Oracle RAC Family of Solutions - Presentation
byMarkus Michalewicz
 
PDF
Oracle Real Application Clusters 19c- Best Practices and Internals- EMEA Tour...
bySandesh Rao
 
PDF
Oracle database high availability solutions
byKirill Loifman
 
PDF
Best practices oracle_clusterware_session355_wp
bywardell henley
 
PDF
An introduction to_rac_system_test_planning_methods
byAjith Narayanan
 
PPTX
Oracle real application clusters system tests with demo
byAjith Narayanan
 
PPT
Cloug Troubleshooting Oracle 11g Rac 101 Tips And Tricks
byScott Jenner
 
PDF
Oracle Failover Database Cluster with Grid Infrastructure 12c
byTrivadis
 
PDF
AUSOUG - NZOUG-GroundBreakers-Jun 2019 - 19c RAC
bySandesh Rao
 
Upgrade 11gR2 to 12cR1 Clusterware
byNikhil Kumar
 
RAC - The Savior of DBA
byNikhil Kumar
 
Managing troubleshooting cluster_360dgrees
bySyed Hussain
 
Extreme Availability using Oracle 12c Features: Your very last system shutdown?
byToronto-Oracle-Users-Group
 
Oracle clusterware overview_11g_en
by小新 制造
 
AIOUG-GroundBreakers-Jul 2019 - 19c RAC
bySandesh Rao
 
Presentation 12c grid_upgrade
byJacques Kostic
 
Oracle10g rac course_contents
byamolmh
 
Oracle RAC 12c Overview
byMarkus Michalewicz
 
les_01.ppt of the Oracle course train_1 file
byYulinLiu27
 
Troug 11 gnf
bySyed Hussain
 
The Oracle RAC Family of Solutions - Presentation
byMarkus Michalewicz
 
Oracle Real Application Clusters 19c- Best Practices and Internals- EMEA Tour...
bySandesh Rao
 
Oracle database high availability solutions
byKirill Loifman
 
Best practices oracle_clusterware_session355_wp
bywardell henley
 
An introduction to_rac_system_test_planning_methods
byAjith Narayanan
 
Oracle real application clusters system tests with demo
byAjith Narayanan
 
Cloug Troubleshooting Oracle 11g Rac 101 Tips And Tricks
byScott Jenner
 
Oracle Failover Database Cluster with Grid Infrastructure 12c
byTrivadis
 
AUSOUG - NZOUG-GroundBreakers-Jun 2019 - 19c RAC
bySandesh Rao
 

Recently uploaded

PPTX
The Landscape of Computer Software Development Companies
byYash Singh
 
PPTX
Basics of Identity Access Management In mordern Infrastructure
byPrinceXavier18
 
PDF
Generative AI in 2026: Hype, Bubble, Winter or The Real Deal?
byDr. Tathagat Varma
 
DOCX
Introduction to the World of Computers (Hardware & Software)
byALIABBAS ABASOV
 
PDF
Digit Expo 2025 - EICC Edinburgh 27th November
byRay Bugg
 
PDF
Ransomware_Resilience_Strategic_Playbook.pdf
byAfonso Henrique Rodrigues Alves
 
PPTX
Ritesh_kumar_Aatmanirbhar Bharat: Make in India, Make for the World.pptx
byriteshrkgs2008
 
PPTX
Combining Induction and Transduction for Abstract Reasoning.pptx
byallen578468
 
PDF
Zero Trust & Defense-in-Depth: The Future of Critical Infrastructure Security
byYasir Naveed Riaz
 
PPTX
RISE with SAP for Automotive - S4 HANA Value.pptx
byAmira Jemi
 
PDF
The major tech developments for 2026 by Pluralsight, a research and training ...
byChris Skinner
 
PDF
Session 1 - Solving Semi-Structured Documents with Document Understanding
byDianaGray10
 
PDF
Top Cybersecurity Threats 2025 Guide by Sureshdas
byPrintersassist
 
PDF
8 LLM Surveys https://tinyurl.com/bdz8e6fp
byBob Marcus
 
PDF
Making Sense of Raster: From Bit Depth to Better Workflows
bySafe Software
 
PDF
DIGITAL FORENSICS - Notes for Everything.pdf
bypankajkumavatbeit
 
PDF
Incident Response Planning with a Foundation Model
byKim Hammar
 
PDF
Safeguarding AI-Based Financial Infrastructure
byYasir Naveed Riaz
 
PDF
eResource Scheduler Enterprise Resource Management and Scheduling Software.pdf
byeResource Scheduler
 
PDF
Guided Substation Engineering with CoMPAS: Simplifying IEC 61850
byDanBrown980551
 
The Landscape of Computer Software Development Companies
byYash Singh
 
Basics of Identity Access Management In mordern Infrastructure
byPrinceXavier18
 
Generative AI in 2026: Hype, Bubble, Winter or The Real Deal?
byDr. Tathagat Varma
 
Introduction to the World of Computers (Hardware & Software)
byALIABBAS ABASOV
 
Digit Expo 2025 - EICC Edinburgh 27th November
byRay Bugg
 
Ransomware_Resilience_Strategic_Playbook.pdf
byAfonso Henrique Rodrigues Alves
 
Ritesh_kumar_Aatmanirbhar Bharat: Make in India, Make for the World.pptx
byriteshrkgs2008
 
Combining Induction and Transduction for Abstract Reasoning.pptx
byallen578468
 
Zero Trust & Defense-in-Depth: The Future of Critical Infrastructure Security
byYasir Naveed Riaz
 
RISE with SAP for Automotive - S4 HANA Value.pptx
byAmira Jemi
 
The major tech developments for 2026 by Pluralsight, a research and training ...
byChris Skinner
 
Session 1 - Solving Semi-Structured Documents with Document Understanding
byDianaGray10
 
Top Cybersecurity Threats 2025 Guide by Sureshdas
byPrintersassist
 
8 LLM Surveys https://tinyurl.com/bdz8e6fp
byBob Marcus
 
Making Sense of Raster: From Bit Depth to Better Workflows
bySafe Software
 
DIGITAL FORENSICS - Notes for Everything.pdf
bypankajkumavatbeit
 
Incident Response Planning with a Foundation Model
byKim Hammar
 
Safeguarding AI-Based Financial Infrastructure
byYasir Naveed Riaz
 
eResource Scheduler Enterprise Resource Management and Scheduling Software.pdf
byeResource Scheduler
 
Guided Substation Engineering with CoMPAS: Simplifying IEC 61850
byDanBrown980551
 

11g r2 rac grid clusterware doug presentation 10 21-10

  • 1.
    11gR2 RAC/Grid Clusterware: BestPractices, Pitfalls, and Lessons Learned Presented during DOUG meeting held on 10/21/2010 at Dallas, TX Ramkumar Rajagopal Presented on 10/21/2010 at DOUG meeting in Dallas, TX 1
  • 2.
    Introduction DBARAC is aspecialty database consulting firm with expertise in a variety of industries based at Austin, Texas. Our people are experts in Oracle Real application clustered database focused solutions for managing large database systems. We provide proactive database management services including but not limited to In-house, on-shore DBA support , remote DB support, database maintenance and backup and recovery. Our DBA Experts provide specialized services in the areas of - Root cause analysis Capacity planning Performance tuning, Database migration and consolidation Broad industry expertise High-Availability RAC database specialists End-to-end database support 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 2
  • 3.
    Introduction Presenter • Senior DatabaseConsultant DBARAC • Oracle Database/Applications DBA since 1995 • Dell, JP Morgan Chase, Verizon • Presenter @ Oracle Open world 2007 • Author Dell Power Solutions articles 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 3
  • 4.
    AGENDA • Introduction • Nodeeviction issue in 10g • What is “11GR2 Grid Clusterware”? • The Challenges • What’s different today? • “We’ve seen this before, smart guy…” • Architecture and Capacity Planning • Upgrade Paths • Pre-installation best practices • Grid Clusterware Installation • Clusterware Startup sequence • Post Install steps • RAC Database build steps • Summary • Q&A 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 4
  • 5.
    Why a nodeis evicted? • Split brain condition • • IO fencing • CRS keeps the lowest number node up • Node eviction detection 11GR2 Grid clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 5
  • 6.
    Root Causes ofNode Eviction Network heartbeat lost Voting disk problems cssd is not healthy Oprocd Hang check timer cssd and oclsomon race to suicide 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 6
  • 7.
    11GR2 Grid Clusterware Improvements •Node eviction algorithm is enhanced • Prevent a split-brain problem without rebooting the node • Oracle High Availability Services Daemon • Will still reboot in some cases • Faster relocation of services on node failure in 11GR2 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 7
  • 8.
    9i/10g RAC Scenario •Several separate versions of databases • Several servers • Space/resource issues • Lesser resources • Provisioning takes time 11GR2 Grid clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 8
  • 9.
    Top concerns • Howmany are using 11GR2 Grid clusterware? • Do you have more than one mission-critical databases within single RAC cluster? • Can you allocate resources dynamically to handle peak volumes of various application loads without downtime? • Issues on using shared infrastructure • Will my database availability and recovery suffer ? • Will my database performance suffer ? • How to manage a large clustered environment to meet sla’s for several applications? 11GR2 Grid clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 9
  • 10.
    Why 11GR2 GridCRS? 11GR2 Grid Clusterware is… An Architecture An IT Strategy – Clusterware & ASM storage deployed together – Many, many Oracle Database Instances – Drives Consolidation 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 10
  • 11.
    Challenges • Skilled resources •Meeting SLA’s • End-to-end testing not possible • Security Controls • Capacity issues • Higher short-term costs 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 11
  • 12.
    What’s different today? •11gR2 Grid CRS & ASM supports • 11GR2, 11GR1, 10gR1 and 10gR2 Single Instances • • Powerful servers, 64Bit O/s • Provisioning Framework to deploy • Grid control 11GR2 Grid clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 12
  • 13.
    11GR2 RAC DBArchitecture Planning 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 13
  • 14.
    Capacity Planning • Whatare the current requirements? • What are the future growth requirements in the next 6-12months? • To meet the demand – estimate the hardware requirements • Data retention requirements • Archiving and purging 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 14
  • 15.
    Capacity Planning metrics •Database metrics for capacity planning • CPU & memory Utilization • I/O rates • Device utilization • Queue length • Storage utilization • Response time • Transaction rate • Network Packet loss • Network Bandwidth utilization 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 15
  • 16.
    Capacity Planning Strategy •Examine existing engagement processes • Examine existing capacity of servers/storage • Define Hardware/database scalability • Provisioning for adding capacity • Integration testing • Large clustered database • SLA requirements • 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 16
  • 17.
    Comparison – 10gvs 11GR2 • Server consolidation • Database consolidation • Instance consolidation • Storage consolidation 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 17
  • 18.
    AGENDA so far… •Introduction • Node eviction issue in 10g • What is “11GR2 Grid clusterware”? • The Challenges • What’s different today? • “We’ve seen this before, smart guy…” • Architecture and Capacity Planning • Upgrade Paths • Pre-installation best practices • Grid Clusterware Installation • Clusterware Startup sequence • Post Install steps • RAC Database build steps • Summary • Q&A 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 18
  • 19.
    • Upgrade Paths •Out-of-place clusterware upgrade • Rolling Upgrade • Oracle 10gR2 - from 10.2.0.3 • Oracle 11gR1 - from 11.1.0.6 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 19
  • 20.
    Pre-installation best practices • NetworkRequirements • Cluster Hardware Requirements • ASM Storage Requirements • Verification Checks 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 20
  • 21.
    Pre-Installation best practices NetworkConfiguration • SCAN -Single Client Access Name • Failover - Faster relocation of services • Better Load balancing • MTU package size of Network Adapter (NIC) • Forwarder, zone entries and reverse lookup • Ping tests • Two dedicated interconnect switches for redundant interconnects • Run cluvfy 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 21
  • 22.
    Pre install -Network - SCAN Configuration 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 22
  • 23.
    Pre Install Network- SCANVIP Troubleshooting • SCAN Configuration: • $GRID_HOME/bin/srvctl config scan • SCAN Listener Configuration: • $GRID_HOME/bin/srvctl config scan_listener • SCAN Listener Resource Status: • $GRID_HOME/bin/crsctl stat res -w "TYPE = ora.scan_listener.type“ • $GRID_HOME/Listener.ora • Local and remote listener parameters 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 23
  • 24.
    Pre Install -Cluster Hardwarerequirements • Os/kernel same on all servers in the cluster • Minimum 32 GB of RAM • Minimum Swap space 16GB • Minimum Grid Home free space 16GB • For each Oracle Home directory allocate 32 GB of space (for each db -32GB) • Allocate adequate disk space for centralized backups • Allocate adequate storage for ASM diskgroups – DATA and FRA 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 24
  • 25.
    Cluster Hardware requirements continued… Mostcases: use UDP over 1 Gigabit Ethernet For large databases - Infiniband/IP or 10 Gigabit Ethernet Use OS Bonding/teaming to “virtualize” interconnect Set UDP send/receive buffers high enough Crossover cables are not supported 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 25
  • 26.
    Pre Install -ASM Storage configuration • In 11gR2 ASM diskgroups are used • Grid infrastructure - OCR, Voting disk and ASMspfile. • Database - DATA and FRA. • OCR and voting disks for Grid clusterware • OCR can now be stored in Automatic Storage Management (ASM). • Add Second diskgroup for ocr using • - ./ocrconfig -add +DATA02 Change the compatibility of the new diskgroup to 11.2 as follows: ALTER DISKGROUP DATA02 SET ATTRIBUTE ‘COMPATIBILITY.ASM’=’11.2’; ALTER DISKGROUP DATA02 SET ATTRIBUTE ‘COMPATIBILITY.RDBMS’=’11.2’; 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 26
  • 27.
    AGENDA so far… •Introduction • Node eviction issue in 10g • What is “11GR2 Grid clusterware”? • The Challenges • What’s different today? • “We’ve seen this before, smart guy…” • Architecture and Capacity Planning • Upgrade Paths • Pre-installation best practices • Grid Clusterware Installation • Clusterware Startup sequence • Post Install steps • RAC Database build steps • Q&A 11GR2 Grid clusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 27
  • 28.
    Hardware/Software details • 10gR2architecture – 9 database servers, 25TB storage – Original Database Version: 10.2.0.5 – Original RAC cluster version : 10.2.0.1 – Original Operating System: Ret Hat Linux 5 As 64 Bit – Storage Type : ASM & RAW Storage • 11gR2 Grid architecture – 4 database servers, 40TB storage – New Database Version: 11.2.0.2 – New Grid Clusterware/ASM version: 11.2.0.2 – New Operating System : Ret Hat Linux 5 As 64Bit – Data migration steps using Rman backup and restore and data pump export dump files 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 28
  • 29.
    11GR2 Migration Steps •Install 11gR2 Grid clusterware and Asm • Install 11gR2 database binaries for each database separately • Create the 11gR2 database • Add additional ASM diskgroups • Install 11GR1/10gR2 database binaries • Create 11GR1/10gR2 databases • Take backup • Restore the data 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 29
  • 30.
    Pre-verification checks- cluvfy • BeforeClusterware installation • ./cluvfy stage -pre crsinst -n node1,node2, node3 –verbose • Before Database installation • ./cluvfy stage -pre dbinst -n node1,node2, node3 -fixup -verbose 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 30
  • 31.
    11gR2 Grid Clusterware Installation– Step 1 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 31
  • 32.
    Step-2 11GR2 Grid Clusterware Presentedon 10/21/2010 at DOUG meeting in Dallas, TX 32
  • 33.
    Step-3 11GR2 Grid Clusterware Presentedon 10/21/2010 at DOUG meeting in Dallas, TX 33
  • 34.
    Step-4 11GR2 Grid Clusterware Presentedon 10/21/2010 at DOUG meeting in Dallas, TX 34
  • 35.
    Step 5 11GR2 GridClusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 35
  • 36.
    Step 6 11GR2 GridClusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 36
  • 37.
    Step 7 11GR2 GridClusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 37
  • 38.
    Step 8 11GR2 GridClusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 38
  • 39.
    Step 8 cont.. 11GR2Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 39
  • 40.
    Step 9 11GR2 GridClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 40
  • 41.
    Step 9 cont... 11GR2Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 41
  • 42.
    Step 10 11GR2 GridClusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 42
  • 43.
    Step 11 11GR2 GridClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 43
  • 44.
    Step 11 cont.. 11GR2Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 44
  • 45.
    Step 12 11GR2 GridClusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 45
  • 46.
    Step 12 11GR2 GridClusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 46
  • 47.
    Step 13 11GR2 GridClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 47
  • 48.
    Step 14 11GR2 GridClusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 48
  • 49.
    Runfixup.sh 11GR2 Grid Clusterware •root> /tmp/runfixup.sh • Response file being used is :/tmp/CVU_11.2.0.1.0_grid/fixup.response • Enable file being used is :/tmp/CVU_11.2.0.1.0_grid/fixup.enable • Log file location: /tmp/CVU_11.2.0.1.0_grid/orarun.log • Setting Kernel Parameters... • fs.file-max = 327679 • fs.file-max = 6815744 • net.ipv4.ip_local_port_range = 9000 65500 • net.core.wmem_max = 262144 • net.core.wmem_max = 1048576 • uid=501(grid)gid=502(oinstall)groups=502(oinstall), • 503(asmadmin),504(asmdba) Presented on 10/21/2010 at DOUG meeting in Dallas, TX 49
  • 50.
    Step 15 11GR2 GridClusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 50
  • 51.
    Step 16 11GR2 GridClusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 51
  • 52.
    Step 16 cont.… 11GR2Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 52
  • 53.
    ./orainstRoot.sh 11GR2 Grid Clusterware Cd/home/oracle/oraInventory [root@oradb-grid1 oraInventory]# ./orainstRoot.sh Changing permissions of /home/oracle/oraInventory. Adding read, write permissions for group. Removing read,write,execute permissions for world. Changing groupname of /home/oracle/oraInventory to oinstall. The execution of the script is complete. [root@oradb-grid1 oraInventory]# cd /u01/app/oracle [root@oradb-grid1 oracle]# ls product scripts [root@oradb-grid1 oracle]# cd product [root@oradb-grid1 product]# ls 11.2.0 [root@oradb-grid1 product]# cd 11* [root@oradb-grid1 11.2.0]# ls grid [root@oradb-grid1 11.2.0]# cd db* [root@oradb-grid1 grid]# ls root* root.sh [root@oradb-grid1 grid]# ./root.sh Running Oracle 11g root.sh script... Presented on 10/21/2010 at DOUG meeting in Dallas, TX 53
  • 54.
    ./orainstRoot.sh 11GR2 Grid Clusterware Thefollowing environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /u01/app/oracle/product/11.2.0/grid Enter the full pathname of the local bin directory: [/usr/local/bin]: The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n) [n]: Creating /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root.sh script. Now product-specific root actions will be performed. 2009-10-02 10:31:44: Parsing the host name 2009-10-02 10:31:44: Checking for super user privileges 2009-10-02 10:31:44: User has super user privileges Using configuration parameter file: /u01/app/oracle/product/11.2.0/grid/crs/install/crsconfig_params Creating trace directory LOCAL ADD MODE Presented on 10/21/2010 at DOUG meeting in Dallas, TX 54
  • 55.
    ./orainstRoot.sh 11GR2 Grid Clusterware CreatingOCR keys for user 'root', privgrp 'root'.. Operation successful. root wallet root wallet cert root cert export peer wallet profile reader wallet pa wallet peer wallet keys pa wallet keys peer cert request pa cert request peer cert pa cert peer root cert TP profile reader root cert TP pa root cert TP peer pa cert TP pa peer cert TP profile reader pa cert TP profile reader peer cert TP peer user cert pa user cert Adding daemon to inittab Presented on 10/21/2010 at DOUG meeting in Dallas, TX 55
  • 56.
    ./orainstRoot.sh 11GR2 Grid Clusterware CRS-4123:Oracle High Availability Services has been started. ohasd is starting CRS-2672: Attempting to start 'ora.gipcd' on 'oradb-grid1' CRS-2672: Attempting to start 'ora.mdnsd' on 'oradb-grid1' CRS-2676: Start of 'ora.gipcd' on 'oradb-grid1' succeeded CRS-2676: Start of 'ora.mdnsd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'oradb-grid1' CRS-2676: Start of 'ora.gpnpd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'oradb-grid1' CRS-2676: Start of 'ora.cssdmonitor' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'oradb-grid1' CRS-2672: Attempting to start 'ora.diskmon' on 'oradb-grid1' CRS-2676: Start of 'ora.diskmon' on 'oradb-grid1' succeeded CRS-2676: Start of 'ora.cssd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.ctssd' on 'oradb-grid1' CRS-2676: Start of 'ora.ctssd' on 'oradb-grid1' succeeded ASM created and started successfully. DiskGroup DATA created successfully. Presented on 10/21/2010 at DOUG meeting in Dallas, TX 56
  • 57.
    ./orainstRoot.sh 11GR2 Grid Clusterware clscfg:-install mode specified Successfully accumulated necessary OCR keys. Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. CRS-2672: Attempting to start 'ora.crsd' on 'oradb-grid1' CRS-2676: Start of 'ora.crsd' on 'oradb-grid1' succeeded CRS-4256: Updating the profile Successful addition of voting disk 659585bf3a834f39bf281fd47e9ed6db. Successful addition of voting disk 762177cd6f844f25bfc677fb681a02ab. Successful addition of voting disk 154c17a0de9c4ffdbff9a3b2f22b52f6. Successfully replaced voting disk group with +DATA. CRS-4256: Updating the profile CRS-4266: Voting file(s) successfully replaced ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 659585bf3a834f39bf281fd47e9ed6db (/dev/oracleasm/disks/VOL1) [DATA] 2. ONLINE 762177cd6f844f25bfc677fb681a02ab (/dev/oracleasm/disks/VOL2) [DATA] 3. ONLINE 154c17a0de9c4ffdbff9a3b2f22b52f6 (/dev/oracleasm/disks/VOL4) [DATA] Located 3 voting disk(s). Presented on 10/21/2010 at DOUG meeting in Dallas, TX 57
  • 58.
    ./orainstRoot.sh 11GR2 Grid Clusterware CRS-2673:Attempting to stop 'ora.crsd' on 'oradb-grid1' CRS-2677: Stop of 'ora.crsd' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'oradb-grid1' CRS-2677: Stop of 'ora.asm' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.ctssd' on 'oradb-grid1' CRS-2677: Stop of 'ora.ctssd' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'oradb-grid1' CRS-2677: Stop of 'ora.cssdmonitor' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'oradb-grid1' CRS-2677: Stop of 'ora.cssd' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.gpnpd' on 'oradb-grid1' CRS-2677: Stop of 'ora.gpnpd' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'oradb-grid1' CRS-2677: Stop of 'ora.gipcd' on 'oradb-grid1' succeeded CRS-2673: Attempting to stop 'ora.mdnsd' on 'oradb-grid1' CRS-2677: Stop of 'ora.mdnsd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.mdnsd' on 'oradb-grid1' CRS-2676: Start of 'ora.mdnsd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'oradb-grid1' CRS-2676: Start of 'ora.gipcd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'oradb-grid1' CRS-2676: Start of 'ora.gpnpd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'oradb-grid1' CRS-2676: Start of 'ora.cssdmonitor' on 'oradb-grid1' succeeded Presented on 10/21/2010 at DOUG meeting in Dallas, TX 58
  • 59.
    ./orainstRoot.sh 11GR2 Grid Clusterware CRS-2672:Attempting to start 'ora.cssd' on 'oradb-grid1' CRS-2672: Attempting to start 'ora.diskmon' on 'oradb-grid1' CRS-2676: Start of 'ora.diskmon' on 'oradb-grid1' succeeded CRS-2676: Start of 'ora.cssd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.ctssd' on 'oradb-grid1' CRS-2676: Start of 'ora.ctssd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.asm' on 'oradb-grid1' CRS-2676: Start of 'ora.asm' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.crsd' on 'oradb-grid1' CRS-2676: Start of 'ora.crsd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.evmd' on 'oradb-grid1' CRS-2676: Start of 'ora.evmd' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.asm' on 'oradb-grid1' CRS-2676: Start of 'ora.asm' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.DATA.dg' on 'oradb-grid1' CRS-2676: Start of 'ora.DATA.dg' on 'oradb-grid1' succeeded CRS-2672: Attempting to start 'ora.registry.acfs' on 'oradb-grid1' CRS-2676: Start of 'ora.registry.acfs' on 'oradb-grid1' succeeded Presented on 10/21/2010 at DOUG meeting in Dallas, TX 59
  • 60.
    ./orainstRoot.sh 11GR2 Grid Clusterware oradb-grid12009/10/02 10:37:08 /u01/app/oracle/product/11.2.0/grid/cdata/oradb- grid1/backup_20091002_103708.olr Preparing packages for installation... cvuqdisk-1.0.7-1 Configure Oracle Grid Infrastructure for a Cluster ... succeeded Updating inventory properties for clusterware Starting Oracle Universal Installer... Checking swap space: must be greater than 500 MB. Actual 39997 MB Passed The inventory pointer is located at /etc/oraInst.loc The inventory is located at /home/oracle/oraInventory 'UpdateNodeList' was successful. oradb-grid2 output :- [root@oradb-grid2 oraInventory]# pwd /home/oracle/oraInventory [root@oradb-grid2 oraInventory]# ./orainstRoot.sh Changing permissions of /home/oracle/oraInventory. Presented on 10/21/2010 at DOUG meeting in Dallas, TX 60
  • 61.
    Step 16 11GR2 GridClusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 61
  • 62.
    Step 16 cont.… 11GR2Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 62
  • 63.
    Grid CRS Startupsequence 11GR2 Grid Clusterware OHASD oraRootAgent oraAgent cssdAgent cssdMonitor crsd ctssd Diskmon ACFS mdnsd gipcd gpnpd evmd crsdRootAgent GCS VIP ASM crsdOraAgent networkResource SCAN VIPs Node VIPs ACFS Reg DB Resource SCAN Listener Services ONS Presented on 10/21/2010 at DOUG meeting in Dallas, TX 63
  • 64.
    Clusterware verification Clusterware processes – $ps -ef|grep -v grep |grep d.bin oracle 9824 1 0 Jul14 ? 00:00:00 /u01/app/grid11gR2/bin/oclskd.bin root 22161 1 0 Jul13 ? 00:00:15 /u01/app/grid11gR2/bin/ohasd.bin reboot oracle 24161 1 0 Jul13 ? 00:00:00 /u01/app/grid11gR2/bin/mdnsd.bin oracle 24172 1 0 Jul13 ? 00:00:00 /u01/app/grid11gR2/bin/gipcd.bin oracle 24183 1 0 Jul13 ? 00:00:03 /u01/app/grid11gR2/bin/gpnpd.bin oracle 24257 1 0 Jul13 ? 00:01:26 /u01/app/grid11gR2/bin/ocssd.bin root 24309 1 0 Jul13 ? 00:00:06 /u01/app/grid11gR2/bin/octssd.bin root 24323 1 0 Jul13 ? 00:01:03 /u01/app/grid11gR2/bin/crsd.bin reboot root 24346 1 0 Jul13 ? 00:00:00 /u01/app/grid11gR2/bin/oclskd.bin oracle 24374 1 0 Jul13 ? 00:00:03 /u01/app/grid11gR2/bin/evmd.bin 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 64
  • 65.
    Clusterware verification Clusterware checks – $crsctl check crs CRS-4638: Oracle High Availability Services is online CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online $ crsctl check has CRS-4638: Oracle High Availability Services is online $ crsctl query crs activeversion Oracle Clusterware active version on the cluster is [11.2.0.2.0] 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 65
  • 66.
    Clusterware verification Clusterware processes $crsctl check cluster -all ************************************************************** rat-rm2-ipfix006: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** rat-rm2-ipfix007: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** rat-rm2-ipfix008: CRS-4537: Cluster Ready Services is online CRS-4529: Cluster Synchronization Services is online CRS-4533: Event Manager is online ************************************************************** 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 66
  • 67.
    Clusterware verification $ crsctlstatus resource -t NAME TARGET STATE SERVER STATE_DETAILS ------------------------------------------------ ora.DATA.dg ASM disk group (new resource) ONLINE ONLINE rat-rm2-ipfix006 ONLINE ONLINE rat-rm2-ipfix007 ONLINE ONLINE rat-rm2-ipfix008 ora.LISTENER.lsnr ONLINE ONLINE rat-rm2-ipfix006 ONLINE ONLINE rat-rm2-ipfix007 ONLINE ONLINE rat-rm2-ipfix008 ora.asm ONLINE ONLINE rat-rm2-ipfix006 Started ONLINE ONLINE rat-rm2-ipfix007 Started ONLINE ONLINE rat-rm2-ipfix008 Started ora.eons new resource ONLINE ONLINE rat-rm2-ipfix006 ONLINE ONLINE rat-rm2-ipfix007 ONLINE ONLINE rat-rm2-ipfix008 ora.gsd 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 67
  • 68.
    Post Install Steps •One-off patch –unlock the Grid home first • # perl rootcrs.pl -unlock -crshome /u01/app/11.2.0/grid • Download and Install the latest Patch Updates • Back Up the root.sh Script • Install Cluster Health Management • Install OS Watcher and RACDDT • Check the backups of OCR and voting disks • Lock the Grid home after patch installation 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 68
  • 69.
    Manageability • Grid control •Adding/dropping nodes • Automatically discovers services • Policy-based cluster management • Automated Cluster Patching • End to end management of the cluster 11GR2 Grid Clusterware Presented on 10/21/2010 at DOUG meeting in Dallas, TX 69
  • 70.
    flexibility Scalability & Flexibility •Sever pools of hardware available • Consolidation of hardware and storage • Rapid provisioning of resources to add capacity where its required • Improved utilization of resources • Better ROI 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 70
  • 71.
    Summary • Reduced Hardware •Improved availability –SLAs • Shorter Time to add additional server or storage • Higher Security • Data Sharing & visibility • Better application performance • Centralized backup and archive • Higher ROI – higher utilization • Manageability • Pride in Ownership, Eliminating the Assembly Line • Bottom line = reduce TCO! 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 71
  • 72.
    References • 11gR2Oracle® ClusterwareAdministration and Deployment Guide • Metalink ID 1054902.1 for Network configuration • RAC Assurance Support Team: RAC Starter Kit and Best Practices (Linux) • Metalink NOTE:887522.1 - 11gR2 Grid Infrastructure Single Client Access Name • Metalink NOTE:946452.1 - DNS and DHCP Setup Example for Grid Infrastructure GNS Metalink Pre 11.2 Database Issues in 11gR2 Grid Infrastructure Environment [ID 948456.1] 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 72
  • 73.
    11GR2 Grid cluster Q& A Email @ ramkumar.rajagopal@dbarac.com 11GR2 Grid ClusterwarePresented on 10/21/2010 at DOUG meeting in Dallas, TX 73