Oracle 11g R2 RAC setup on rhel 5.0

4,230 views

Published on

Download ppt from
http://www.slideshare.net/slideshow/embed_code/14108797

Published in: Technology, News & Politics

Oracle 11g R2 RAC setup on rhel 5.0

  1. 1. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b Oracle 11g R2 Real Application Cluster Implementation on RHEL 5.0Please download the Presentation from http://www.slideshare.net/slideshow/embed_code/14108797I have added all concepts in this ppt.Specification: 1) 2 Node RAC setup 2) OS: Each Node machine with Red Hat Enterprise Linux Server release 5 (x86_64 bit, Kernel: 2.6.18-8.el5) 3) Storage server: 73 GB, Ubuntu 12.04 (x86_64 bit) 4) Oracle 11gR2 Database 5) Oracle 11gR2 Grid Infrastructure.Pre-Installation: 1) All the nodes should have same OS and Kernel version and bits (x86 or x86_64) For Linux use $uname –a command, it should show same output on all the nodes. 2) Each of the servers should have 2 NIC cards - Where group of 2 (one from each machine) should have same name(say eth0/eth1) and IP subnet Mask Ex: 1) Each of the machines has eth0 as Ethernet card number and IP on subnet say 10.88.33.X (Public Network) 2) Each of the machines has eth1 as Ethernet card number and IP on subnet say 10.88.32.X (Private Network for interconnects) - Both of these groups on different VLANs as above. all can co-exist on the same Physical switch; that should not be an issue 3) Configure VIP by adding entries in /etc/hosts file (VIPs must be from same subnet as that of Public IPs) 4) Stop ntpd service: Linux syncs the system time using NTP protocol. In RAC oracle has cluster time sync service built in. if ntpd service is up then oracle will use it else oracle will create cluster synchronization service; It’s recommended that we should use oracle cluster sync service. So will disable the ntpd service on all the nodes: [root@PTS0009 ~]# service ntpd stop ntpd is stopped [root@PTS0009 ~]# chkconfig ntpd off [root@PTS0009 ~]# chkconfig --list ntpd ntpd 0:off 1:off 2:off 3:off 4:off 5:off 6:off [root@PTS0009 ~]# chkconfig ntpd --del [root@PTS0009 ~]# mv /etc/ntp.conf /etc/ntp.conf.org [root@PTS0009 ~]# mv /var/run/ntpd.pid /var/run/ntpd.pid.org 5) Configure SCAN (Single Client Access Name:http://www.oracle.com/technetwork/products/clustering/overview/scan-129069.pdf) I have DNS setup in my network so I will use the same. If you don’t have DNS setup you can hardcode these IP addresses under /etc/hosts file. SCAN using DNS: 1) Add Scan entry on DNS server with 3 IP addresses for same host. Enable Round Robin on DNS (Demo: http://www.oraclemasters.in/?p=1296#dns) Ex: ORARAC-SCAN: 10.88.33.24
  2. 2. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b ORARAC-SCAN: 10.88.33.25 ORARAC-SCAN: 10.88.33.26 2) Once the entry is added in DNS test it from Local Client as root@PTS0009:~# nslookup orarac-scan Server: 10.77.224.101 Address: 10.77.224.101#53 Name: orarac-scan Address: 10.88.33.26 Name: orarac-scan Address: 10.88.33.24 Name: orarac-scan Address: 10.88.33.25 If you execute this command multiple times, you will notice that the list of IP addresses is varying in Round robin fashion. If not then ask your DNS admin to enable round robin on server. 3) These above 3 IP addresses are Virtual IPs. So your Ping should fail for each of them till the time we install Grid clusterware.<< Execute following setups 6-9 on all the nodes >> 6) make sure each of the nodes has following Packages Installed: Oracle Software Prerequisites Install required packages: binutils-2.17.50.0.6 compat-libstdc++-33-3.2.3 elfutils-libelf-0.125 elfutils-libelf-devel-0.125 elfutils-libelf-devel-static-0.125 gcc-4.1.2 gcc-c++-4.1.2 glibc-2.5-24 glibc-common-2.5 glibc-devel-2.5 glibc-headers-2.5 kernel-headers-2.6.18 ksh-20060214 libaio-0.3.106 libaio-devel-0.3.106 libgcc-4.1.2 libgomp-4.1.2 libstdc++-4.1.2 libstdc++-devel-4.1.2 make-3.81 numactl-devel-0.9.8.i386 sysstat-7.0.2 unixODBC-2.2.11 unixODBC-devel-2.2.11 iscsi-initiator-utils-6.2.0.868-0.7.el5<-- For iscsi based SAN configuration 7) Modify the kernel parameter file Login as root and appended the following entries in /etc/sysctl.conf file.: kernel.shmmax = 2147483648 kernel.shmmni = 4096
  3. 3. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b kernel.shmall = 2097152 kernel.sem = 250 32000 100 128 fs.file-max = 6553600 net.ipv4.ip_local_port_range = 1024 65000 net.core.rmem_default = 4194304 net.core.wmem_default = 262144 net.core.wmem_max= 262144 net.core.rmem_max = 4194304 Issue the command to reload kernel parameter: $ sysctl –p8) Added the following lines to the /etc/security/limits.conf file: oracle soft nofile 131072 oracle hard nofile 131072 oracle soft nproc 131072 oracle hard nproc 131072 oracle soft core unlimited oracle hard core unlimited oracle soft memlock 3500000 oracle hard memlock 3500000 # Recommended stack hard limit 32MB for oracle installations # oracle hard stack 32768 grid soft nofile 131072 grid hard nofile 131072 grid soft nproc 131072 grid hard nproc 131072 grid soft core unlimited grid hard core unlimited grid soft memlock 3500000 grid hard memlock 3500000 # Recommended stack hard limit 32MB for grid installations # grid hard stack 327689) Install Oracleasm, oracleasmlib and oracleasm-support for ASM instance creation 1. Download Oracle ASM from (http://www.oracle.com/technetwork/server-storage/linux/downloads/rhel5- 084877.html) and installation compatible to your kernel version. 2. For my RHE Linux Kernel version: 2.6.18-8.el5 I have used following libraries oracleasm-2.6.18-8.el5-2.0.4-1.el5.x86_64.rpm oracleasm-2.6.18-8.el5xen-2.0.4-1.el5.x86_64.rpm oracleasmlib-2.0.4-1.el5.x86_64.rpm oracleasm-support-2.1.7-1.el5.x86_64.rpm [root@PTS0009 Redhat 5]# rpm -ivh oracleasm-2.6.18-8.el5-2.0.4-1.el5.x86_64.rpm oracleasm-2.6.18- 8.el5xen-2.0.4-1.el5.x86_64.rpm oracleasmlib-2.0.4-1.el5.x86_64.rpm oracleasm-support-2.1.7- 1.el5.x86_64.rpm oracleasmlib-2.0.4-1.el5.x86_64.rpm oracleasm-support-2.1.7-1.el5.x86_64.rpm warning: oracleasmlib-2.0.4-1.el5.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 1e5e0159 Preparing... ########################################### [100%] 1:oracleasm-support ########################################### [ 33%]
  4. 4. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b 2:oracleasm-2.6.18-8.el5 ########################################### [ 67%] 3:oracleasmlib ########################################### [100%] [root@PTS0009 Redhat 5]# rpm -qa | grep oracleasm oracleasm-2.6.18-8.el5-2.0.4-1.el5 oracleasm-support-2.1.7-1.el5 oracleasmlib-2.0.4-1.el510) SAN Storage setup as shown in PPT Device name not persistent after reboot of RAC nodes: I have seen that the iscsi device names are changed after reboot of RAC nodes. For e.g, device /dev/sda1 now becomes /dev/sdb1 after reboot. This behavior has caused very serious issues for the OCR and Vote disks as well as the disks formatted with ocfs2 devices. They dont get mounted automatically because they are not persistent after reboot. A utility called "devlabel" that are developed by Dell Inc and it is available to download free from Dells Official Website. This utility creates the symlink to the device names by considering physical devices UUID. So, even after the reboot, the UUID for any devices stays at it is and so the symlink that you create using devlabel always points to the UUID of the device. 1) Create Symlinks [root@PTS0006 Libs]# rpm -ivhU devlabel-0.48.03-10.x86_64.rpm warning: devlabel-0.48.03-10.x86_64.rpm: Header V3 DSA signature: NOKEY, key ID 025e513b Preparing... ########################################### [100%] 1:devlabel ########################################### [100%] [root@PTS0006 Libs]# [root@PTS0006 Libs]# ls -l /dev/sd* brw-r----- 1 root disk 8, 0 Aug 9 16:57 /dev/sda brw-r----- 1 root disk 8, 1 Aug 9 16:57 /dev/sda1 brw-r----- 1 root disk 8, 16 Aug 9 16:57 /dev/sdb brw-r----- 1 root disk 8, 17 Aug 9 16:58 /dev/sdb1 brw-r----- 1 root disk 8, 32 Aug 9 16:55 /dev/sdc brw-r----- 1 root disk 8, 33 Aug 9 16:55 /dev/sdc1 [root@PTS0006 Libs]# devlabel add -d /dev/sda1 -s /dev/ocr SYMLINK: /dev/ocr -> /dev/sda1 Added /dev/ocr to /etc/sysconfig/devlabel [root@PTS0006 Libs]# devlabel add -d /dev/sdb1 -s /dev/oradata SYMLINK: /dev/oradata -> /dev/sdb1 Added /dev/oradata to /etc/sysconfig/devlabel [root@PTS0006 Libs]# devlabel add -d /dev/sdc1 -s /dev/ocfs2 [root@PTS0006 Libs]# cat /etc/sysconfig/devlabel # devlabel configuration file # # This file should generally not be edited by hand. # Instead, use the /sbin/devlabel program to make changes. # devlabel by Gary Lerhaupt <gary_lerhaupt@dell.com> # # format: <SYMLINK><DEVICE><UUID> # or format: <RAWDEVICE><DEVICE><UUID> /dev/ocr /dev/sda1 S83.1:49455400000000006c756e30000000000000000000000000IETVIRTUAL- DISKsector32
  5. 5. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b /dev/oradata /dev/sdb1 S83.1:49455400000000006c756e31000000000000000000000000IETVIRTUAL-DISKsector32- 118425599 2) Update the /etc/rc.local files (All RAC nodes): After reboot of RAC nodes, the devlabel does not get started automatically so add the reload command in /etc/rc.local [root@PTS0006 Libs]# devlabel reload SYMLINK: /dev/ocr -> /dev/sda1 SYMLINK: /dev/oradata -> /dev/sdb1 [root@PTS0006 Libs]# vi /etc/rc.local #!/bin/sh # # This script will be executed *after* all the other init scripts. # You can put your own initialization stuff in here if you dont # want to do the full Sys V style init stuff. touch /var/lock/subsys/local service iscsi restart devlabel reload echo "Just to check if all Ethernet are up" ifup eth0 ifup eth1Steps for Oracle RAC: 1) Create group: dba, oinstall, asmadmin, asmdba, asmoper on all the nodes for Oracle software and ASM 2) Create users: Oracle (For oracle software owner) and grid (for oracle cluster owner) as follows: $ id grid uid=501(grid) gid=501(oinstall) groups=501(oinstall),502(asmadmin),503(asmdba),504(asmoper) $ id oracle uid=500(oracle) gid=501(oinstall) groups=501(oinstall),500(dba),503(asmdba) 3) Configure Oracle ASM: [root@PTS0009]# oracleasm configure ORACLEASM_ENABLED=false ORACLEASM_UID= ORACLEASM_GID= ORACLEASM_SCANBOOT=true ORACLEASM_SCANORDER="" ORACLEASM_SCANEXCLUDE="" [root@PTS0009]# oracleasm configure -i Configuring the Oracle ASM library driver. This will configure the on-boot properties of the Oracle ASM library driver. The following questions will determine whether the driver is loaded on boot and what permissions it will have. The current values will be shown in brackets ([]). Hitting <ENTER> without typing an answer will keep that current value. Ctrl-C will abort. Default user to own the driver interface []: grid Default group to own the driver interface []: asmadmin Start Oracle ASM library driver on boot (y/n) [n]: y Scan for Oracle ASM disks on boot (y/n) [y]: y Writing Oracle ASM library driver configuration: done [root@PTS0009]# oracleasm configure ORACLEASM_ENABLED=true
  6. 6. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b ORACLEASM_UID=grid ORACLEASM_GID=asmadmin ORACLEASM_SCANBOOT=true ORACLEASM_SCANORDER="" ORACLEASM_SCANEXCLUDE="" [root@PTS0009]#4) Load Oracle ASM: a. Check Current status [root@PTS0009]# oracleasm status Checking if ASM is loaded: no Checking if /dev/oracleasm is mounted: no b. Init Oracle ASM [root@PTS0009]# oracleasm init Creating /dev/oracleasm mount point: /dev/oracleasm Loading module "oracleasm": oracleasm Mounting ASMlib driver filesystem: /dev/oracleasm [root@PTS0009]# oracleasm status Checking if ASM is loaded: yes Checking if /dev/oracleasm is mounted: yes [root@PTS0009]# c.Create ASM Disks [root@PTS0006 systemfiles]# oracleasm createdisk VOTE1 /dev/sda1 Writing disk header: done Instantiating disk: done [root@PTS0006 systemfiles]# oracleasm scandisks Reloading disk partitions: done Cleaning any stale ASM disks... Scanning system for ASM disks... [root@PTS0006 systemfiles]# oracleasm listdisks VOTE1 << From Node2>> [root@PTS0009 systemfiles]# oracleasm scandisks Reloading disk partitions: done Cleaning any stale ASM disks... Scanning system for ASM disks... Instantiating disk "VOTE1" [root@PTS0009 systemfiles]# oracleasm listdisks VOTE1 [root@PTS0006 systemfiles]# oracleasm createdisk DATA1 /dev/sdb1 Writing disk header: done Instantiating disk: done [root@PTS0006 systemfiles]# oracleasm scandisks Reloading disk partitions: done Cleaning any stale ASM disks... Scanning system for ASM disks... [root@PTS0006 systemfiles]# oracleasm listdisks DATA1 VOTE1 [root@PTS0009 systemfiles]# oracleasm scandisks Reloading disk partitions: done
  7. 7. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b Cleaning any stale ASM disks... Scanning system for ASM disks... Instantiating disk "DATA1" [root@PTS0009 systemfiles]# oracleasm listdisks DATA1 VOTE1Install Oracle 11R2 Clusterware: Log in as grid user and execute runInstaller.sh script. Following are the screen dump to show the details.
  8. 8. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  9. 9. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6bAdd All the nodes and enable SSH connectivity for grid user.
  10. 10. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  11. 11. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  12. 12. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  13. 13. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  14. 14. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  15. 15. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  16. 16. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  17. 17. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6bDuring the installation you will be asked to execute orainstRoot.sh and root.sh. Execute these scripts on Localnode first and then on the other nodes.[root@PTS0009 tmp]# cd /home/systemfiles/[root@PTS0009 systemfiles]# cd /home/systemfiles/orainventory/[root@PTS0009 orainventory]# ./orainstRoot.shChanging permissions of /home/systemfiles/orainventory.Adding read,write permissions for group.Removing read,write,execute permissions for world.Changing groupname of /home/systemfiles/orainventory to oinstall.The execution of the script is complete.[root@PTS0009 orainventory]# cd ..[root@PTS0009 systemfiles]# cd grid_home/[root@PTS0009 grid_home]# ./root.shRunning Oracle 11g root.sh script...The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /home/systemfiles/grid_home
  18. 18. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6bEnter the full pathname of the local bin directory: [/usr/local/bin]:The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n)[n]: y Copying dbhome to /usr/local/bin ...The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n)[n]: y Copying oraenv to /usr/local/bin ...The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n)[n]: y Copying coraenv to /usr/local/bin ...Creating /etc/oratab file...Entries will be added to the /etc/oratab file as needed byDatabase Configuration Assistant when a database is createdFinished running generic part of root.sh script.Now product-specific root actions will be performed.2012-08-17 17:02:52: Parsing the host name2012-08-17 17:02:52: Checking for super user privileges2012-08-17 17:02:52: User has super user privilegesUsing configuration parameter file: /home/systemfiles/grid_home/crs/install/crsconfig_paramsCreating trace directoryLOCAL ADD MODECreating OCR keys for user root, privgrp root..Operation successful. root wallet root wallet cert root cert export peer wallet profile reader wallet pa wallet peer wallet keys pa wallet keys peer cert request pa cert request peer cert pa cert peer root cert TP profile reader root cert TP pa root cert TP peer pa cert TP pa peer cert TP profile reader pa cert TP profile reader peer cert TP peer user cert pa user cert
  19. 19. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6bAdding daemon to inittabCRS-4123: Oracle High Availability Services has been started.ohasd is startingADVM/ACFS is not supported on adobe-release-x86_64-1.0-1CRS-2672: Attempting to start ora.gipcd on pts0009CRS-2672: Attempting to start ora.mdnsd on pts0009CRS-2676: Start of ora.gipcd on pts0009 succeededCRS-2676: Start of ora.mdnsd on pts0009 succeededCRS-2672: Attempting to start ora.gpnpd on pts0009CRS-2676: Start of ora.gpnpd on pts0009 succeededCRS-2672: Attempting to start ora.cssdmonitor on pts0009CRS-2676: Start of ora.cssdmonitor on pts0009 succeededCRS-2672: Attempting to start ora.cssd on pts0009CRS-2672: Attempting to start ora.diskmon on pts0009CRS-2676: Start of ora.diskmon on pts0009 succeededCRS-2676: Start of ora.cssd on pts0009 succeededCRS-2672: Attempting to start ora.ctssd on pts0009CRS-2676: Start of ora.ctssd on pts0009 succeededASM created and started successfully.DiskGroup OCRVOTE created successfully.clscfg: -install mode specifiedSuccessfully accumulated necessary OCR keys.Creating OCR keys for user root, privgrp root..Operation successful.CRS-2672: Attempting to start ora.crsd on pts0009CRS-2676: Start of ora.crsd on pts0009 succeededCRS-4256: Updating the profileSuccessful addition of voting disk 82dd0db8b1f54f76bf79e0a2f1d9fccc.Successfully replaced voting disk group with +OCRVOTE.CRS-4256: Updating the profileCRS-4266: Voting file(s) successfully replaced## STATE File Universal Id File Name Disk group-- ----- ----------------- --------- --------- 1. ONLINE 82dd0db8b1f54f76bf79e0a2f1d9fccc (ORCL:VOTE1) [OCRVOTE]Located 1 voting disk(s).CRS-2673: Attempting to stop ora.crsd on pts0009CRS-2677: Stop of ora.crsd on pts0009 succeededCRS-2673: Attempting to stop ora.asm on pts0009CRS-2677: Stop of ora.asm on pts0009 succeededCRS-2673: Attempting to stop ora.ctssd on pts0009CRS-2677: Stop of ora.ctssd on pts0009 succeededCRS-2673: Attempting to stop ora.cssdmonitor on pts0009
  20. 20. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6bCRS-2677: Stop of ora.cssdmonitor on pts0009 succeededCRS-2673: Attempting to stop ora.cssd on pts0009CRS-2677: Stop of ora.cssd on pts0009 succeededCRS-2673: Attempting to stop ora.gpnpd on pts0009CRS-2677: Stop of ora.gpnpd on pts0009 succeededCRS-2673: Attempting to stop ora.gipcd on pts0009CRS-2677: Stop of ora.gipcd on pts0009 succeededCRS-2673: Attempting to stop ora.mdnsd on pts0009CRS-2677: Stop of ora.mdnsd on pts0009 succeededCRS-2672: Attempting to start ora.mdnsd on pts0009CRS-2676: Start of ora.mdnsd on pts0009 succeededCRS-2672: Attempting to start ora.gipcd on pts0009CRS-2676: Start of ora.gipcd on pts0009 succeededCRS-2672: Attempting to start ora.gpnpd on pts0009CRS-2676: Start of ora.gpnpd on pts0009 succeededCRS-2672: Attempting to start ora.cssdmonitor on pts0009CRS-2676: Start of ora.cssdmonitor on pts0009 succeededCRS-2672: Attempting to start ora.cssd on pts0009CRS-2672: Attempting to start ora.diskmon on pts0009CRS-2676: Start of ora.diskmon on pts0009 succeededCRS-2676: Start of ora.cssd on pts0009 succeededCRS-2672: Attempting to start ora.ctssd on pts0009CRS-2676: Start of ora.ctssd on pts0009 succeededCRS-2672: Attempting to start ora.asm on pts0009CRS-2676: Start of ora.asm on pts0009 succeededCRS-2672: Attempting to start ora.crsd on pts0009CRS-2676: Start of ora.crsd on pts0009 succeededCRS-2672: Attempting to start ora.evmd on pts0009CRS-2676: Start of ora.evmd on pts0009 succeededCRS-2672: Attempting to start ora.asm on pts0009CRS-2676: Start of ora.asm on pts0009 succeededCRS-2672: Attempting to start ora.OCRVOTE.dg on pts0009CRS-2676: Start of ora.OCRVOTE.dg on pts0009 succeededpts0009 2012/08/17 17:10:34 /home/systemfiles/grid_home/cdata/pts0009/backup_20120817_171034.olrPreparing packages for installation...cvuqdisk-1.0.7-1Configure Oracle Grid Infrastructure for a Cluster ... succeededUpdating inventory properties for clusterwareStarting Oracle Universal Installer...Checking swap space: must be greater than 500 MB. Actual 4996 MB PassedThe inventory pointer is located at /etc/oraInst.locThe inventory is located at /home/systemfiles/orainventoryUpdateNodeList was successful.[root@PTS0009 grid_home]#
  21. 21. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  22. 22. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6bIn the end you can verify all the resources:[grid@PTS0009 ~]$ /home/systemfiles/grid_home/bin/crsctl check cluster -all**************************************************************pts0006:CRS-4537: Cluster Ready Services is onlineCRS-4529: Cluster Synchronization Services is onlineCRS-4533: Event Manager is online**************************************************************pts0009:CRS-4537: Cluster Ready Services is onlineCRS-4529: Cluster Synchronization Services is onlineCRS-4533: Event Manager is online**************************************************************[grid@PTS0009 ~]$ /home/systemfiles/grid_home/bin/srvctl status asmASM is running on pts0006,pts0009[grid@PTS0009 ~]$ /home/systemfiles/grid_home/bin/srvctl status asmASM is running on pts0006,pts0009[grid@PTS0009 ~]$ /home/systemfiles/grid_home/bin/crs_stat -t -vName Type R/RA F/FT Target State Host----------------------------------------------------------------------ora....ER.lsnr ora....er.type 0/5 0/ ONLINE ONLINE pts0006ora....N1.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE pts0006ora....N2.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE pts0009
  23. 23. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6bora....N3.lsnr ora....er.type 0/5 0/0 ONLINE ONLINE pts0009ora.OCRVOTE.dg ora....up.type 0/5 0/ ONLINE ONLINE pts0006ora.asm ora.asm.type 0/5 0/ ONLINE ONLINE pts0006ora.eons ora.eons.type 0/3 0/ ONLINE ONLINE pts0006ora.gsd ora.gsd.type 0/5 0/ OFFLINE OFFLINEora....network ora....rk.type 0/5 0/ ONLINE ONLINE pts0006ora.oc4j ora.oc4j.type 0/5 0/0 OFFLINE OFFLINEora.ons ora.ons.type 0/3 0/ ONLINE ONLINE pts0009ora....SM2.asm application 0/5 0/0 ONLINE ONLINE pts0006ora....06.lsnr application 0/5 0/0 ONLINE ONLINE pts0006ora....006.gsd application 0/5 0/0 OFFLINE OFFLINEora....006.ons application 0/3 0/0 ONLINE UNKNOWN pts0006ora....006.vip ora....t1.type 0/0 0/0 ONLINE ONLINE pts0006ora....SM1.asm application 0/5 0/0 ONLINE ONLINE pts0009ora....09.lsnr application 0/5 0/0 ONLINE ONLINE pts0009ora....009.gsd application 0/5 0/0 OFFLINE OFFLINEora....009.ons application 0/3 0/0 ONLINE ONLINE pts0009ora....009.vip ora....t1.type 0/0 0/0 ONLINE ONLINE pts0009ora.scan1.vip ora....ip.type 0/0 0/0 ONLINE ONLINE pts0006ora.scan2.vip ora....ip.type 0/0 0/0 ONLINE ONLINE pts0009ora.scan3.vip ora....ip.type 0/0 0/0 ONLINE ONLINE pts0009[grid@PTS0009 ~]$If you notice above .gsd and ora.oc4j are offline. But that should be ok as these arerequired only for legacy support for oracle 9i.Now all VIP and SCAN IPs will respond to ping.[grid@PTS0009 ~]$ ping 10.88.33.27PING 10.88.33.27 (10.88.33.27) 56(84) bytes of data.64 bytes from 10.88.33.27: icmp_seq=1 ttl=64 time=1.07 ms64 bytes from 10.88.33.27: icmp_seq=2 ttl=64 time=0.096 ms64 bytes from 10.88.33.27: icmp_seq=3 ttl=64 time=0.096 ms--- 10.88.33.27 ping statistics ---3 packets transmitted, 3 received, 0% packet loss, time 1998msrtt min/avg/max/mdev = 0.096/0.423/1.077/0.462 ms[grid@PTS0009 ~]$ ping 10.88.33.28PING 10.88.33.28 (10.88.33.28) 56(84) bytes of data.64 bytes from 10.88.33.28: icmp_seq=1 ttl=64 time=0.028 ms64 bytes from 10.88.33.28: icmp_seq=2 ttl=64 time=0.018 ms64 bytes from 10.88.33.28: icmp_seq=3 ttl=64 time=0.013 ms--- 10.88.33.28 ping statistics ---3 packets transmitted, 3 received, 0% packet loss, time 1998msrtt min/avg/max/mdev = 0.013/0.019/0.028/0.008 ms[grid@PTS0009 ~]$ ping 10.88.33.24PING 10.88.33.24 (10.88.33.24) 56(84) bytes of data.64 bytes from 10.88.33.24: icmp_seq=1 ttl=64 time=0.025 ms
  24. 24. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b 64 bytes from 10.88.33.24: icmp_seq=2 ttl=64 time=0.015 ms 64 bytes from 10.88.33.24: icmp_seq=3 ttl=64 time=0.015 ms --- 10.88.33.24 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 1998ms rtt min/avg/max/mdev = 0.015/0.018/0.025/0.005 ms [grid@PTS0009 ~]$ ping 10.88.33.25 PING 10.88.33.25 (10.88.33.25) 56(84) bytes of data. 64 bytes from 10.88.33.25: icmp_seq=1 ttl=64 time=0.022 ms 64 bytes from 10.88.33.25: icmp_seq=2 ttl=64 time=0.017 ms --- 10.88.33.25 ping statistics --- 2 packets transmitted, 2 received, 0% packet loss, time 1000ms rtt min/avg/max/mdev = 0.017/0.019/0.022/0.005 ms [grid@PTS0009 ~]$ ping 10.88.33.26 PING 10.88.33.26 (10.88.33.26) 56(84) bytes of data. 64 bytes from 10.88.33.26: icmp_seq=1 ttl=64 time=0.770 ms 64 bytes from 10.88.33.26: icmp_seq=2 ttl=64 time=0.097 ms 64 bytes from 10.88.33.26: icmp_seq=3 ttl=64 time=0.095 ms --- 10.88.33.26 ping statistics --- 3 packets transmitted, 3 received, 0% packet loss, time 1999ms rtt min/avg/max/mdev = 0.095/0.320/0.770/0.318 ms [grid@PTS0009 ~]$Oracle 11gR2 Software installation:Login as Oracle user and execute runInstaller.sh
  25. 25. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  26. 26. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  27. 27. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  28. 28. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  29. 29. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  30. 30. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  31. 31. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  32. 32. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  33. 33. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  34. 34. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6bCreation of ASM disk group:
  35. 35. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6b Connect as grid user and Invoke the asmca utility under $GRID_HOME/bin tocreate these disk groups. The screenshots of this process are as below.
  36. 36. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  37. 37. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  38. 38. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6bCreation of Oracle Database instance: Login as user oracle and execute dbca
  39. 39. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  40. 40. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  41. 41. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  42. 42. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  43. 43. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  44. 44. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  45. 45. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  46. 46. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  47. 47. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.in www.linkedin.com/pub/santosh-kangane/1b/78b/6bTo resize the shared memory I referredhttp://www.walkernews.net/2010/05/04/how-to-resize-devshm-filesystem-in-linux/But after this ASM instance on 2nd node (PTS0006) went down. And I fought for 3Hrs and foundthat its silly simple command!$/grid_home/bin/srvctl status asm$/grid_home/bin/srvctl start asmHere it is …….You can verify all the recourses by/grid_home/bin/crsctl status resource –t
  48. 48. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  49. 49. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  50. 50. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  51. 51. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  52. 52. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  53. 53. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b
  54. 54. © Santosh Kangane – Oracle DBA santoshkangane.blogspot.inwww.linkedin.com/pub/santosh-kangane/1b/78b/6b

×