More Related Content
Similar to SLES11で構築するXen仮想化+HAクラスタ入門 (20)
More from VirtualTech Japan Inc. (20)
SLES11で構築するXen仮想化+HAクラスタ入門
- 2. ‹-!
&'(•–"#Š†—,O˜™—†!
Xš!
•! Xš
–! ˜—›o+†œ—t•žAk†Ÿ—) !v¡¢
£—Œ¤s !¥¦ƒ„Xš
–! §¨©Œ•ª¡*sus«eNs¬-—)f
•! ‹-
–! &'(…¢®—Œ¤s©k£—t‰¯°
–! &'(±²eP2Vœ@Œ—-³«œ—Œ¤sf
•! ´µ¶·
–! rstuv¸¹!
–! 12˜™—†‰¯°
–! Xen…—+º—»œNO˜™—†!
´µ¶·!
3
Ns¼—u®—†*O½Ÿs+†k¡¾˜™—†Š¿¯°!
High Availability Extension7PQ!
•! SUSE Linux Enterprise 11!‰HAeHigh
Availabilityf•–"#‰„À‰Á©k
£—t
•! OpenAISŠN—+
•! DRBDyz{OCFS2Š˜™—†
•! GUI!XÃÄÅpÆÇ!
È!
- 3. ÉʉËÌ•–!
•! OS:SUSE Linux Enerprise 11eÍÎ SLES 11f
–! ÏÅÐXenÑÒ³s+†—OwÓÔ
•! ÁÂ…l†LSUSE Linux Enterprise 11 High
Availability ExtensioneÍÎ SLES 11 HAEf
–! ³?—tlÕ³OŠ~Ö+†wº×—ƒØyÙ
•! HA•–Ú¡*³-¢/ÛÜs¼¢"Ý!"#
–! ¡*³-¢/¡*³-¢ÚÞËÌ
–! ßà!á%eÚâãf
ä!
HA•–"#åæ!
1.! SLES 11 HAE‰³s+†—O
2.! /etc/hosts!‰Ö+†RXÃ
3.! NTPŠçµƒ„Ö+†è‰éêëì
4.! OpenAIS‰)*+,XÃ
5.! DRBDXÃ
6.! )*+,¢…—+í‰DRBDîïÁÂ
7.! &'-ŒseÍÎvmfðÝ
8.! )*+,¢…—+í‰vmÁÂ!
ñ!
- 4. SLES 11 HAE³s+†—O!
1.! òÀ SLES 11‰³s+†—Oóª+)ôƒÙÚ
ISO³?—tŠµõƒØyÙ
2.! [YaST]![…l†‡ˆv]![v»ös÷ø]Š)
¢k)
3.! v»ösÁ‰‡ªù—»púû$%‰!o
üýwþÿØð’Š!À%
4.! "#‰…l†‡ˆv‰ÁÂ![$Ƶ%]pÁ
Â&'Ø(%‰!¬ˆk)Š-'Ø)*
5.! ³s+†—O+#wSLES 11‰³s+†—O
óª+)ŠQ,&'%‰!oóª+)Š-'%
•ISO³?—tŠüÃØ)*
-!
R./0‰XÃ!
xen1yz{xen2!XÃ
1.! [YaST]![Ak†Ÿ—)˜—1+]![Ö+†
R]Šúû
2.! [ÁÂ]Š)¢k)
3.! IPv»œ+¾Ö+†R¾Ö+†‰r³¢v+Š
-K
–! 192.168.0.1 xen1.example.com xen1
–! 192.168.0.2 xen2.example.com xen2
2!
- 6. OpenAISÛk†vk¡e¡*³-¢f!
xen1!XÃ
1.! [YaST]![DEF—O]![)*+,]Šúû
2.! [Communication Channel]!çµ$%)*+
,M—»‰Ak†Ÿ—)v»œ+o-O¬§¨
+†v»œ+o-O¬§¨+†™—†ŠXÃ
–! Bind Network AddressL192.168.0.0
–! Multicast AddressL224.0.0.1
–! Multicast PortL5405
3.! M—»‰IDw1ŠXÃ
4.! rrp modeŠactivewXÃ!
BB!
OpenAISÛk†vk¡eÛÜs¼¢f7!
xen2!XÃ
1.! [YaST]![DEF—O]![)*+,]Šúû
2.! [Communication Channel]!çµ$%)*+
,M—»‰Ak†Ÿ—)v»œ+o-O¬§¨
+†v»œ+o-O¬§¨+†™—†ŠXÃ
–! Bind Network AddressL192.168.0.0
–! Multicast AddressL224.0.0.1
–! Multicast PortL5405
3.! M—»‰IDw2ŠXÃ
4.! rrp modeŠpassivewXÃ!
BG!
- 7. )*+,‰úû¾H)!
¡*³-¢/ÛÜs¼¢IJ!XÃ
1.! KLŠúû
2.! M—ù—haclusterw©+Ÿ—»ŠXÃ
–! xen1# passwd hacluster
–! xen2# passwd hacluster
3.! IJ‰Ö+†‰KLzNÍΉº-s»!)*+,Šúû
–! xen1# service openais start
–! xen2# service openais start
4.! ¡*³-¢Ö+†!)*+,‰GUIXÃF—OŠúû
–! xen1# crm_gui &
5.! Connection!)*+,wH)
–! Server:127.0.0.1
–! User NameLhacluster
–! PasswordLXÄ©+Ÿ—»
BO!
)*+,‰P0XÃ!
1.! )*+,XÃF—O‰QwR%[CRM
Config]Š)¢k)
2.! [No Quorum Policy]XÊ[ignore]wÓÔ
–! DRBDŠSµƒo)T—*ŽŠSµƒ½(„À
3.! [Stonith Enabled]‰¬ˆk)ŠU$
–! STONITHŠçV½(„À!
BÈ!
- 8. DRBDµîï‰W¶!
•! [YaST]!]Œ+•Ž]![óª+)‰àX]Š
úû
•! LVMµ©—•ªŒ¤sŠÁÂ
•! B¢®—ŽÄÅ!YÅB¢®—ŽŠÁÂ
–! B¢®—Ž«O—¡lv4drbdŠÁÂ
–! YÅB¢®—ŽvmconfigZvmimagesŠÁÂ
–! /dev/lv4drbd/vmconfig 3GB
–! /dev/lv4drbd/vmimages 40GB!
Bä!
DRBD‰XÃ(vmconfig)!
•! [YaST]![DEF—O]![Drbd]Šúû
•! …—+XÊ78ƒoAddŠ)¢k)
•! DRBD¢…—+vmconfigŠÁÂ
Node 1! Node 2!
[R! vmconfig!
Name! xen1! xen2!
Address:Port! 192.168.0.1:7789! 192.168.0.2:7789!
Device! /dev/drbd0! /dev/drbd0!
Disk! /dev/lv4drbd/vmconfig! /dev/lv4drbd/vmconfig!
Meta-disk! internal! internal!
Syncer Rate! 500M(Advanced Config!Xý(Z250KB)!Bñ!
- 9. DRBD‰XÃ(vmimages)!
•! DRBD¢…—+vmimagesŠÁÂ
Node 1! Node 2!
[R! vmimages!
Name! xen1! xen2!
Address:Port! 192.168.0.1:7790! 192.168.0.2:7790!
Device! /dev/drbd1! /dev/drbd1!
Disk! /dev/lv4drbd/vmimages! /dev/lv4drbd/vmimages!
Meta-disk! internal! internal!
Syncer Rate! 500M(Advanced Config!Xý(Z250KB)!
B-!
DRBD‰úû!
¡*³-¢/ÛÜs¼¢!DRBDŠúû
1.! ¡*³-¢•žÛÜs¼¢w/etc/drbd.confŠº×—
2.! KLŠúû
3.! DRBDŠúû
–! xen1# service drbd start
–! xen2# service drbd start
4.! ?,ó—,ŠðÝ
–! xen1# drbdadm create-md vmconfig
–! xen1# drbdadm create-md vmimages
–! xen2# drbdadm create-md vmconfig
–! xen2# drbdadm create-md vmimages
B2!
- 10. DRBD¢…—+‰•ì(!
1.! ¡*³-¢!DRBD¢…—+Š•ì(
–! xen1# drbdadm -- --overwrite-data-of-peer primary all
2.! DRBD‰]pUpToDatew½%‰ŠW^
–! xen1# service drbd status
–! xen2# service drbd status
3.! ¡*³-¢!/dev/drbd0yz{/dev/drbd1Š•ì(
–! xen1# mkfs –t xfs /dev/drbd0
–! xen1# mkfs –t xfs /dev/drbd1
4.! ¡*³-¢/ÛÜs¼¢IJ!DRBD‰ó—3sŠ_`
–! )*+,¢…—+ZƒØúû&a%„À
–! # service drbd stop
B?!
DRBDŠ)*+,¢…—+wÁÂ!
1.! ¡*³-¢Ö+†‰KLzNCUI)*+,X
ÃF—OŠúû
–! # crm config
2.! DRBDŠ)*+,¢…—+wÁÂ
–! º×b!cƒde
–! 1*‰f'gphi•wjõ!
GC!
- 11. vmconfigµXÃkl!
•! primitive vmconfig ocf:heartbeat:drbd params
drbd_resource=vmconfig op monitor role=Master interval=60s
timeout=30s op monitor role=Slave interval=60s timeout=30s
•! ms ms-vmconfig vmconfig meta clone-max=2 notify=true
globally-unique=false target-role=stopped
•! primitive fs-vmconfig ocf:heartbeat:Filesystem params
fstype=xfs directory=/etc/xen/vm device=/dev/drbd0 meta
target-role=stopped
•! order ms-vmconfig-before-fs-vmconfig mandatory: ms-
vmconfig:promote fs-vmconfig:start
•! colocation fs-vmconfig-on-ms-vmconfig inf: fs-vmconfig ms-
vmconfig:Master
•! commit
•! quit
GB!
vmimagesµXÃkl!
•! primitive vmimages ocf:heartbeat:drbd params
drbd_resource=vmimages op monitor role=Master interval=60s
timeout=30s op monitor role=Slave interval=60s timeout=30s
•! ms ms-vmimages vmimages meta clone-max=2 notify=true
globally-unique=false target-role=stopped
•! primitive fs-vmimages ocf:heartbeat:Filesystem params
fstype=xfs directory=/etc/xen/vm device=/dev/drbd0 meta
target-role=stopped
•! order ms-vmimages-before-fs-vmimages mandatory: ms-
vmimages:promote fs-vmimages:start
•! colocation fs-vmimages-on-ms-vmimages inf: fs-vmimages ms-
vmimages:Master
•! commit
•! quit
GG!
- 12. DRBD¢…—+úû!
1.! ¡*³-¢!)*+,‰GUIXÃF—OŠúû
–! # crm_gui
2.! Connection!)*+,wH)
3.! DRBD‰¢…—+pÁÂ&'Ø(%iZŠW^
4.! master¢…—+Š78ƒØ?u®—‰úûB,sŠ
)¢k)ƒØ¢…—+Šúû
5.! KLzNdfº-s»Šm*ƒØÍÎw-‡s†&'
Ø(%iZŠW^
–! /dev/drbd0 ! /etc/xen/vm
–! /dev/drbd0 ! /var/lib/xen/images!
GO!
&'-Œs‰ðÝ!
1.! [YaST]![&'(]![&'-Œs‰ðÝ]
Šúû
2.! &'-ŒsŠðÝ
–! &'-ŒsRLsles11-ha
–! OS:SLES11
–! n‰oÚpqXÃ
•! Windowsô)*+,¢…—+ZƒØrsÆÇ!
GÈ!
- 13. &'-ŒsŠ)*+,¢…—+wÁÂ!
•! ¡*³-¢Ö+†‰KLzNCUI)*+,X
ÃF—OŠúû
–! # crm config
•! &'-Œssles11-haŠ)*+,¢…—+w
ÁÂ
–! º×b!cƒde
–! 1*‰f'gphi•wjõ!
Gä!
&'-ŒsµXÃkl!
•! primitive sles11_ha ocf:heartbeat:Xen params name="sles11-
ha" xmfile="/etc/xen/vm/sles11-ha” op monitor interval="10s”
op start interval="0s" timeout="30s” op stop interval="0s"
timeout="300s"
•! colocation sles11_ha-with-fs-vmconfig inf: sles11_ha fs-
vmconfig
•! order sles11_ha-after-fs-vmconfig inf: fs-vmconfig:start
sles11_ha:start
•! colocation sles11_ha-with-fs-vmimages inf: sles11_ha fs-
vmimages
•! order sles11_ha-after-fs-vmimages inf: fs-vmimages:start
sles11_ha:start
•! commit
•! quit
Gñ!
- 17. TPC-B Ns¬-—)½¾!
33
<¥!
Ns¬-—)m*•–!
•! SASóª+)L2.5” 36.4GB 15krpm " 2¿
•! SSDLIntel X25-E(SLC) 32GB " 2¿
–! RAIDºs†;—*—‰§¨kŒ®ÚOff
–! óª+)ÀÁ‰§¨kŒ®ŠOn/OffƒÂÃ
•! FC SANLHP MSA1000
–! SCSI 146GB 10krpm " 14¿wz%RAID 5
–! ºs†;—*—w512MB§¨kŒ®
•! Cache OffLR50%/W50%
•! Cache OnLR0%/W100%
•! PostgreSQL 8.3.7wz%Ns¬-—)
–! pgbench -c 20 -t 3000
–! 20Êm*ƒo11ÊÃ20ʉÄÅÆŠÇs!
34
<¥!
- 18. •! ÈCPUpÉÊë%ÇeËp4%Ìyf
•! CPUºv¹Í&'CPU²š¹p+ô†(½¾Z
½ÿØ(%
•! Opteron‰8VMÚΕ«Ú´½(poÏЉ
CPUçµÑÚ68%Ìy!ÒKRNe4ºvÒNf
%ÇÓÔ!
35
Opteron 2435
(2.6GHz)!
Xeon X5570
(2.93GHz HT On)!
Xeon X5570
(2.93GHz HT Off)!
8VM! 1553.1! 68.6%! 2175.3! 96.0%! 2180.3*! 96.2%!
12VM! 2265.4*! 100%! 2207.5! 97.4%! 2171.8! 95.9%!
16VM! 2249.1! 99.3%! 2248.7*! 99.3%! 2166.8! 95.6%!
<¥!
®¯vKÓÔ!
•! Ns¬-—)é‰+|®¯vK!ÓÔ
•! OpteronÚXeonw@ƒØ16%•ž18%®¯vK
p-(
•! Hyper Threadingp%ÇÕww@$%®¯vK
‰ÖÑpR N†Ù½((3.8%:9.4%)!
36
Opteron 2435
(2.6GHz)!
Xeon X5570
(2.93GHz HT On)!
Xeon X5570
(2.93GHz HT Off)!
8VM! 200W! 87.3%! 259W! 113.1%! 253W*! 110.5%!
12VM! 229W*! 100%! 272W! 118.8%! 258W! 112.7%!
16VM! 229W! 100%! 279W*! 121.8%! 255W! 111.4%!
<¥!