Luci, Ricci and the RAC
...or Clustering on Centos 5 using
Conga for an Oracle RAC install
Drawn up by Fauz Ghauri (@fauzg...
Introduction
• Hardware
• Installation
• Custom udev rules for iscsi
• Cluster
• Heartbeat and fencing
• RAC Other things ...
Hardware
• Network Cards
– DRAC (Dell Remote Access Card)
– ILO (Integrated Lights Out – HP kit)
– VMware Fence (Built int...
Installation
• Mainly Defaults used for centos 5 install
• A few extra packages are required outside of
the base install.
Installation
Installation
Installation
Installation
Installation
Installation
Installation
Installation – Conga Components
Installation – Conga Components
Installation – Luci
Installation – Luci
Custom udev rules for iSCSI
• If you’re using iSCSI – you’ll need to make sure
that your drives are mapped.
# iscsiadm -m ...
Custom udev rules for iSCSI
• Manually log onto targets
– # iscsiadm -m node -T iqn.2006-
01.com.openfiler:racdb.asm1 -p 1...
Custom udev rules for iSCSI
• # (cd /dev/disk/by-path; ls -l *sanname* | awk '{FS="
"; print $9 " " $10 " " $11}')
• Retur...
Custom udev rules for iSCSI
• ACTION=="add", KERNEL=="sd*",
PROGRAM=="/sbin/scsi_id -g -u -s %p",
RESULT==“<iscsi string g...
Cluster
Cluster
Cluster
Cluster
Cluster
Cluster
Cluster
Cluster
This turns
yellow as
there’s an
issue.
Cluster
Cluster
Cluster
Cluster
Heartbeat & Fencing
• Heartbeat – saying “hi! I’m here” to the cluster.
• Fencing – fencing off a dodgy node
• Fencing on ...
Heartbeat & Fencing
– vmware-vim-cmd vimsvc/auth/role_add groupX
VirtualMachine.Interact.PowerOn
– vmware-vim-cmd
vimsvc/a...
Things to consider with RAC
• Don’t reboot all nodes at the same time –
unless you feel like losing your entire
database!
...
Acknowledgements
• Thanks to:
– [redacted] for getting me going
– [redacted] for helping me figure out that nasty little i...
Bonus Slides!
Bonus Slides!
Bonus Slides!
Bonus Slides!
Bonus Slides!
Upcoming SlideShare
Loading in...5
×

Luci, ricci and the rac bc

1,428

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,428
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
38
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Luci, ricci and the rac bc

  1. 1. Luci, Ricci and the RAC ...or Clustering on Centos 5 using Conga for an Oracle RAC install Drawn up by Fauz Ghauri (@fauzg) for barcamp
  2. 2. Introduction • Hardware • Installation • Custom udev rules for iscsi • Cluster • Heartbeat and fencing • RAC Other things to consider for RAC. • Acknowledgements
  3. 3. Hardware • Network Cards – DRAC (Dell Remote Access Card) – ILO (Integrated Lights Out – HP kit) – VMware Fence (Built into ESX – maybe server?) – Etc. • SAN – Are you using iSCSI? • VMware – which version of ESX/server do you run?
  4. 4. Installation • Mainly Defaults used for centos 5 install • A few extra packages are required outside of the base install.
  5. 5. Installation
  6. 6. Installation
  7. 7. Installation
  8. 8. Installation
  9. 9. Installation
  10. 10. Installation
  11. 11. Installation
  12. 12. Installation – Conga Components
  13. 13. Installation – Conga Components
  14. 14. Installation – Luci
  15. 15. Installation – Luci
  16. 16. Custom udev rules for iSCSI • If you’re using iSCSI – you’ll need to make sure that your drives are mapped. # iscsiadm -m discovery -t sendtargets –p <sanIP.mydomain (or maybe ip address)> 192.168.2.195:3260,1 iqn.2006-01.com.openfiler:racdb.asm1 192.168.2.195:3260,1 iqn.2006-01.com.openfiler:racdb.asm2 192.168.2.195:3260,1 iqn.2006-01.com.openfiler:racdb.asm3 192.168.2.195:3260,1 iqn.2006-01.com.openfiler:racdb.asm4 192.168.2.195:3260,1 iqn.2006-01.com.openfiler:racdb.crs
  17. 17. Custom udev rules for iSCSI • Manually log onto targets – # iscsiadm -m node -T iqn.2006- 01.com.openfiler:racdb.asm1 -p 192.168.2.195 -l • Configure auto login – # iscsiadm -m node -T iqn.2006- 01.com.openfiler:racdb.asm1 -p 192.168.2.195 -- op update -n node.startup -v automatic
  18. 18. Custom udev rules for iSCSI • # (cd /dev/disk/by-path; ls -l *sanname* | awk '{FS=" "; print $9 " " $10 " " $11}') • Returns: – ip-192.168.2.195:3260-iscsi-iqn.2006- 01.com.openfiler:racdb.asm1-lun-0 -> ../../sda – Etc. – Make a note! – scsi_id –g –u –s /block/sdX – find out which letters map to which iSCSI device (where X is a, b, c, etc) – Note iSCSI strings. – Create a new rules file in /etc/udev/rules.d/22- randomnumberandname.rules
  19. 19. Custom udev rules for iSCSI • ACTION=="add", KERNEL=="sd*", PROGRAM=="/sbin/scsi_id -g -u -s %p", RESULT==“<iscsi string goes here>", RUN+="/bin/raw /dev/raw/raw1 %N“ • ACTION=="add", KERNEL=="raw1", OWNER=="root", GROUP=="dba", MODE=="0660", SYMLINK+="oracle_ocr"
  20. 20. Cluster
  21. 21. Cluster
  22. 22. Cluster
  23. 23. Cluster
  24. 24. Cluster
  25. 25. Cluster
  26. 26. Cluster
  27. 27. Cluster This turns yellow as there’s an issue.
  28. 28. Cluster
  29. 29. Cluster
  30. 30. Cluster
  31. 31. Cluster
  32. 32. Heartbeat & Fencing • Heartbeat – saying “hi! I’m here” to the cluster. • Fencing – fencing off a dodgy node • Fencing on ESX means the creation of a user for fencing. – useradd and groupadd – insufficient permissions. – Get it working on ESX before trying to fence remotely. – Adding permissions can be done by doing the following:
  33. 33. Heartbeat & Fencing – vmware-vim-cmd vimsvc/auth/role_add groupX VirtualMachine.Interact.PowerOn – vmware-vim-cmd vimsvc/auth/entity_permission_add vim.Folder:ha-folder-root userX users groupX true • Test it out with the command fence_vmware (syntax in wiki in ackowledgements section)
  34. 34. Things to consider with RAC • Don’t reboot all nodes at the same time – unless you feel like losing your entire database! • Bear in mind that the /udev rules should map to some raw disks if you’re using ASM. • SSH key equivalency (sharing keys).
  35. 35. Acknowledgements • Thanks to: – [redacted] for getting me going – [redacted] for helping me figure out that nasty little issue with GSSAPI timing out my SSH connections • Sources: – http://www.oracle.com/technology/pub/articles/hunter_r ac10gr2_iscsi.html – http://www.redhat.com/docs/en- US/Red_Hat_Enterprise_Linux/4.8/html/Cluster_Administr ation/s1-start-luci-ricci-conga-CA.html – http://sources.redhat.com/cluster/wiki/VMware_FencingC onfig – http://www.vroem.co.za/?p=7
  36. 36. Bonus Slides!
  37. 37. Bonus Slides!
  38. 38. Bonus Slides!
  39. 39. Bonus Slides!
  40. 40. Bonus Slides!
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×