SLES11!"#$%
Xen&'(+HA)*+,-.!
/0&'(123456789:;<6=>CEO
?@A*B7CDEFD
GH7I
miyahara@VirtualTech.jp
JKLMNO3456
/0&'(1234567PQ!
•! 6RL/0&'(123456
–! STRLVirtualTech Japan Inc.
–! UVL/0&'(12WVTJ
•! XYL2006Z12[
•! 0]L14,250,000^
•! 06L_`abcdbc1-1-10
•! :;<LGH7Ie89:;<6=>CEOf
•! gh7ije:;<CTOf
•! +,klL8Remno5.5Rp&'(12q.rstuv!$f
•! URLLhttp://VirtualTech.jp/
•! &'(12wx$%EFyz{|}
–! &'(12wx$%~•€•
–! &'(12wx‚ƒ„…l†‡ˆv‰|}
–! &'(12Š‹-ƒ„Œ+•މ"#!
/0•‰•Y‘
&'(12q’56
e“6€”f!
2
‹-!
&'(•–"#І—,O˜™—†!
Xš!
•! Xš
–! ˜—›o+†œ—t•žAk†Ÿ—) !v¡¢
£—Œ¤s !¥¦ƒ„Xš
–! §¨©Œ•ª¡*sus«eNs¬-—)f
•! ‹-
–! &'(…¢®—Œ¤s©k£—t‰¯°
–! &'(±²eP2Vœ@Œ—-³«œ—Œ¤sf
•! ´µ¶·
–! rstuv¸¹!
–! 12˜™—†‰¯°
–! Xen…—+º—»œNO˜™—†!
´µ¶·!
3
Ns¼—u®—†*O½Ÿs+†k¡¾˜™—†Š¿¯°!
High Availability Extension7PQ!
•! SUSE Linux Enterprise 11!‰HAeHigh
Availabilityf•–"#‰„À‰Á©k
£—t
•! OpenAISŠN—+
•! DRBDyz{OCFS2Š˜™—†
•! GUI!XÃÄÅpÆÇ!
È!
ÉʉËÌ•–!
•! OS:SUSE Linux Enerprise 11eÍÎ SLES 11f
–! ÏÅÐXenÑÒ³s+†—OwÓÔ
•! ÁÂ…l†LSUSE Linux Enterprise 11 High
Availability ExtensioneÍÎ SLES 11 HAEf
–! ³?—tlÕ³OŠ~Ö+†wº×—ƒØyÙ
•! HA•–Ú¡*³-¢/ÛÜs¼¢"Ý!"#
–! ¡*³-¢/¡*³-¢ÚÞËÌ
–! ßà!á%eÚâãf
ä!
HA•–"#åæ!
1.! SLES 11 HAE‰³s+†—O
2.! /etc/hosts!‰Ö+†RXÃ
3.! NTPŠçµƒ„Ö+†è‰éêëì
4.! OpenAIS‰)*+,XÃ
5.! DRBDXÃ
6.! )*+,¢…—+í‰DRBDîïÁÂ
7.! &'-ŒseÍÎvmfðÝ
8.! )*+,¢…—+í‰vmÁÂ!
ñ!
SLES 11 HAE³s+†—O!
1.! òÀ SLES 11‰³s+†—Oóª+)ôƒÙÚ
ISO³?—tеõƒØyÙ
2.! [YaST]![…l†‡ˆv]![v»ös÷ø]Š)
¢k)
3.! v»ösÁ‰‡ªù—»púû$%‰!o
üýwþÿØð’Š!À%
4.! "#‰…l†‡ˆv‰ÁÂ![$Ƶ%]pÁ
Â&'Ø(%‰!¬ˆk)Š-'Ø)*
5.! ³s+†—O+#wSLES 11‰³s+†—O
óª+)ŠQ,&'%‰!oóª+)Š-'%
•ISO³?—tŠüÃØ)*
-!
R./0‰XÃ!
xen1yz{xen2!XÃ
1.! [YaST]![Ak†Ÿ—)˜—1+]![Ö+†
R]Šúû
2.! [ÁÂ]Š)¢k)
3.! IPv»œ+¾Ö+†R¾Ö+†‰r³¢v+Š
-K
–! 192.168.0.1 xen1.example.com xen1
–! 192.168.0.2 xen2.example.com xen2
2!
NTP˜—›XÃ!
xen1!XÃ
1.! [YaST]![Ak†Ÿ—)˜—1+]![NTP•
–XÃ]Šúû
2.! NTPó—3sŠŒ+•Žúûéw|4$%
zmXÃ
3.! ëì,³¡56‰[Undisciplined Local
Clock(LOCAL)]Š78
4.! [9:]!;—ÜO<=);k)ŠXÃ
5.! [»*³›‰€>]![Stratum]Š5wÓÔ!
?!
NTP)*³vs†XÃ!
xen2!XÃ
1.! [YaST]![Ak†Ÿ—)˜—1+]![NTP
•–XÃ]Šúû
2.! NTPó—3sŠŒ+•Žúûéw|4$
%zmXÃ
3.! [ÁÂ]!ëì@A‰XÃw[˜—›]Š
¬ˆk)ƒoxen1‰v»œ+Š-K
BC!
OpenAISÛk†vk¡e¡*³-¢f!
xen1!XÃ
1.! [YaST]![DEF—O]![)*+,]Šúû
2.! [Communication Channel]!çµ$%)*+
,M—»‰Ak†Ÿ—)v»œ+o-O¬§¨
+†v»œ+o-O¬§¨+†™—†ŠXÃ
–! Bind Network AddressL192.168.0.0
–! Multicast AddressL224.0.0.1
–! Multicast PortL5405
3.! M—»‰IDw1ŠXÃ
4.! rrp modeŠactivewXÃ!
BB!
OpenAISÛk†vk¡eÛÜs¼¢f7!
xen2!XÃ
1.! [YaST]![DEF—O]![)*+,]Šúû
2.! [Communication Channel]!çµ$%)*+
,M—»‰Ak†Ÿ—)v»œ+o-O¬§¨
+†v»œ+o-O¬§¨+†™—†ŠXÃ
–! Bind Network AddressL192.168.0.0
–! Multicast AddressL224.0.0.1
–! Multicast PortL5405
3.! M—»‰IDw2ŠXÃ
4.! rrp modeŠpassivewXÃ!
BG!
)*+,‰úû¾H)!
¡*³-¢/ÛÜs¼¢IJ!XÃ
1.! KLŠúû
2.! M—ù—haclusterw©+Ÿ—»ŠXÃ
–! xen1# passwd hacluster
–! xen2# passwd hacluster
3.! IJ‰Ö+†‰KLzNÍΉº-s»!)*+,Šúû
–! xen1# service openais start
–! xen2# service openais start
4.! ¡*³-¢Ö+†!)*+,‰GUIXÃF—OŠúû
–! xen1# crm_gui &
5.! Connection!)*+,wH)
–! Server:127.0.0.1
–! User NameLhacluster
–! PasswordLXÄ©+Ÿ—»
BO!
)*+,‰P0XÃ!
1.! )*+,XÃF—O‰QwR%[CRM
Config]Š)¢k)
2.! [No Quorum Policy]XÊ[ignore]wÓÔ
–! DRBDŠSµƒo)T—*ŽŠSµƒ½(„À
3.! [Stonith Enabled]‰¬ˆk)ŠU$
–! STONITHŠçV½(„À!
BÈ!
DRBDµîï‰W¶!
•! [YaST]!]Œ+•Ž]![óª+)‰àX]Š
úû
•! LVMµ©—•ªŒ¤sŠÁÂ
•! B¢®—ŽÄÅ!YÅB¢®—ŽŠÁÂ
–! B¢®—Ž«O—¡lv4drbdŠÁÂ
–! YÅB¢®—ŽvmconfigZvmimagesŠÁÂ
–! /dev/lv4drbd/vmconfig 3GB
–! /dev/lv4drbd/vmimages 40GB!
Bä!
DRBD‰XÃ(vmconfig)!
•! [YaST]![DEF—O]![Drbd]Šúû
•! …—+XÊ78ƒoAddŠ)¢k)
•! DRBD¢…—+vmconfigŠÁÂ
Node 1! Node 2!
[R! vmconfig!
Name! xen1! xen2!
Address:Port! 192.168.0.1:7789! 192.168.0.2:7789!
Device! /dev/drbd0! /dev/drbd0!
Disk! /dev/lv4drbd/vmconfig! /dev/lv4drbd/vmconfig!
Meta-disk! internal! internal!
Syncer Rate! 500M(Advanced Config!Xý(Z250KB)!Bñ!
DRBD‰XÃ(vmimages)!
•! DRBD¢…—+vmimagesŠÁÂ
Node 1! Node 2!
[R! vmimages!
Name! xen1! xen2!
Address:Port! 192.168.0.1:7790! 192.168.0.2:7790!
Device! /dev/drbd1! /dev/drbd1!
Disk! /dev/lv4drbd/vmimages! /dev/lv4drbd/vmimages!
Meta-disk! internal! internal!
Syncer Rate! 500M(Advanced Config!Xý(Z250KB)!
B-!
DRBD‰úû!
¡*³-¢/ÛÜs¼¢!DRBDŠúû
1.! ¡*³-¢•žÛÜs¼¢w/etc/drbd.confŠº×—
2.! KLŠúû
3.! DRBDŠúû
–! xen1# service drbd start
–! xen2# service drbd start
4.! ?,ó—,ŠðÝ
–! xen1# drbdadm create-md vmconfig
–! xen1# drbdadm create-md vmimages
–! xen2# drbdadm create-md vmconfig
–! xen2# drbdadm create-md vmimages
B2!
DRBD¢…—+‰•ì(!
1.! ¡*³-¢!DRBD¢…—+Š•ì(
–! xen1# drbdadm -- --overwrite-data-of-peer primary all
2.! DRBD‰]pUpToDatew½%‰ŠW^
–! xen1# service drbd status
–! xen2# service drbd status
3.! ¡*³-¢!/dev/drbd0yz{/dev/drbd1Š•ì(
–! xen1# mkfs –t xfs /dev/drbd0
–! xen1# mkfs –t xfs /dev/drbd1
4.! ¡*³-¢/ÛÜs¼¢IJ!DRBD‰ó—3sŠ_`
–! )*+,¢…—+ZƒØúû&a%„À
–! # service drbd stop
B?!
DRBDŠ)*+,¢…—+wÁÂ!
1.! ¡*³-¢Ö+†‰KLzNCUI)*+,X
ÃF—OŠúû
–! # crm config
2.! DRBDŠ)*+,¢…—+wÁÂ
–! º×b!cƒde
–! 1*‰f'gphi•wjõ!
GC!
vmconfigµXÃkl!
•! primitive vmconfig ocf:heartbeat:drbd params
drbd_resource=vmconfig op monitor role=Master interval=60s
timeout=30s op monitor role=Slave interval=60s timeout=30s
•! ms ms-vmconfig vmconfig meta clone-max=2 notify=true
globally-unique=false target-role=stopped
•! primitive fs-vmconfig ocf:heartbeat:Filesystem params
fstype=xfs directory=/etc/xen/vm device=/dev/drbd0 meta
target-role=stopped
•! order ms-vmconfig-before-fs-vmconfig mandatory: ms-
vmconfig:promote fs-vmconfig:start
•! colocation fs-vmconfig-on-ms-vmconfig inf: fs-vmconfig ms-
vmconfig:Master
•! commit
•! quit
GB!
vmimagesµXÃkl!
•! primitive vmimages ocf:heartbeat:drbd params
drbd_resource=vmimages op monitor role=Master interval=60s
timeout=30s op monitor role=Slave interval=60s timeout=30s
•! ms ms-vmimages vmimages meta clone-max=2 notify=true
globally-unique=false target-role=stopped
•! primitive fs-vmimages ocf:heartbeat:Filesystem params
fstype=xfs directory=/etc/xen/vm device=/dev/drbd0 meta
target-role=stopped
•! order ms-vmimages-before-fs-vmimages mandatory: ms-
vmimages:promote fs-vmimages:start
•! colocation fs-vmimages-on-ms-vmimages inf: fs-vmimages ms-
vmimages:Master
•! commit
•! quit
GG!
DRBD¢…—+úû!
1.! ¡*³-¢!)*+,‰GUIXÃF—OŠúû
–! # crm_gui
2.! Connection!)*+,wH)
3.! DRBD‰¢…—+pÁÂ&'Ø(%iZŠW^
4.! master¢…—+Š78ƒØ?u®—‰úûB,sŠ
)¢k)ƒØ¢…—+Šúû
5.! KLzNdfº-s»Šm*ƒØÍÎw-‡s†&'
Ø(%iZŠW^
–! /dev/drbd0 ! /etc/xen/vm
–! /dev/drbd0 ! /var/lib/xen/images!
GO!
&'-Œs‰ðÝ!
1.! [YaST]![&'(]![&'-Œs‰ðÝ]
Šúû
2.! &'-ŒsŠðÝ
–! &'-ŒsRLsles11-ha
–! OS:SLES11
–! n‰oÚpqXÃ
•! Windowsô)*+,¢…—+ZƒØrsÆÇ!
GÈ!
&'-ŒsŠ)*+,¢…—+wÁÂ!
•! ¡*³-¢Ö+†‰KLzNCUI)*+,X
ÃF—OŠúû
–! # crm config
•! &'-Œssles11-haŠ)*+,¢…—+w
ÁÂ
–! º×b!cƒde
–! 1*‰f'gphi•wjõ!
Gä!
&'-ŒsµXÃkl!
•! primitive sles11_ha ocf:heartbeat:Xen params name="sles11-
ha" xmfile="/etc/xen/vm/sles11-ha” op monitor interval="10s”
op start interval="0s" timeout="30s” op stop interval="0s"
timeout="300s"
•! colocation sles11_ha-with-fs-vmconfig inf: sles11_ha fs-
vmconfig
•! order sles11_ha-after-fs-vmconfig inf: fs-vmconfig:start
sles11_ha:start
•! colocation sles11_ha-with-fs-vmimages inf: sles11_ha fs-
vmimages
•! order sles11_ha-after-fs-vmimages inf: fs-vmimages:start
sles11_ha:start
•! commit
•! quit
Gñ!
HAûðW^!
1.! &'-Œsp¡*³-¢!ûðƒØ(%i
ZŠW^
2.! ¡*³-¢/ÛÜs¼¢IJ!GUI)*+,
XÃF—OŠúûƒo)*+,‰]Št
u
3.! ¡*³-¢‰v[ŠOFFw$%
4.! ÛÜs¼¢w!&'-Œspúû$%iZ
ŠW^
G-!
ZÀ!
•! XÃ忉xÝyZƒØÚ75%zž(
•! XÃklpå{Ὁp|Ó
•! }ÿÙN:N~•ZZØô€•w½%
•! GUIXÃF—Op‚S
–! ƒÇ„wÚ100%!Ú½(p
–! GUIÚzÙ…n%‰!oCUIôçmZ†(!
G2!
&'(w‡(؈‰ƒ„(
•! Šœ—»˜—›Z~e²Va„˜—
›&'(…¢®—Œ¤s‰ó3ôÆÇ
‹Œºs˜O•ªs«m•#
yŽ•wy•(²VaÙ‘&(
29
y•(²Va’!
“&'(•–Š"#ƒ„(pohiwˆ‰$'”((‰ã•!
âÚ–—w¿ˆ‰Ù‘&(!
日本仮想化技術株式会社
˜™™š›œœ•žŸ™ ¡¢£¤¥˜¦§šœ!
¨¡¢¤¨©•žŸ™ ¡¢£¤¥˜¦§š!
CäCª-ä-BªCä2È!
30
y «!
SSDÚ¬(•ã!
A.! SSDÚ†&nm‘
–! $¬½*s¼Žv)Û+
–! -®¯vK
–! -}°
B.! SSD‹-Úéì±²ã
–! ‘m³p´½(
–! ‘ ‘»*³Šµ¶p$(
–! {᷸ʹwºí‰»¼!
32
<¥!
TPC-B Ns¬-—)½¾!
33
<¥!
Ns¬-—)m*•–!
•! SASóª+)L2.5” 36.4GB 15krpm " 2¿
•! SSDLIntel X25-E(SLC) 32GB " 2¿
–! RAIDºs†;—*—‰§¨kŒ®ÚOff
–! óª+)ÀÁ‰§¨kŒ®ŠOn/OffƒÂÃ
•! FC SANLHP MSA1000
–! SCSI 146GB 10krpm " 14¿wz%RAID 5
–! ºs†;—*—w512MB§¨kŒ®
•! Cache OffLR50%/W50%
•! Cache OnLR0%/W100%
•! PostgreSQL 8.3.7wz%Ns¬-—)
–! pgbench -c 20 -t 3000
–! 20Êm*ƒo11ÊÃ20ʉÄÅÆŠÇs!
34
<¥!
•! ÈCPUpÉÊë%ÇeËp4%Ìyf
•! CPUºv¹Í&'CPU²š¹p+ô†(½¾Z
½ÿØ(%
•! Opteron‰8VMÚΕ«Ú´½(poÏЉ
CPUçµÑÚ68%Ìy!ÒKRNe4ºvÒNf
%ÇÓÔ!
35
Opteron 2435
(2.6GHz)!
Xeon X5570
(2.93GHz HT On)!
Xeon X5570
(2.93GHz HT Off)!
8VM! 1553.1! 68.6%! 2175.3! 96.0%! 2180.3*! 96.2%!
12VM! 2265.4*! 100%! 2207.5! 97.4%! 2171.8! 95.9%!
16VM! 2249.1! 99.3%! 2248.7*! 99.3%! 2166.8! 95.6%!
<¥!
®¯vKÓÔ!
•! Ns¬-—)é‰+|®¯vK!ÓÔ
•! OpteronÚXeonw@ƒØ16%•ž18%®¯vK
p-(
•! Hyper Threadingp%ÇÕww@$%®¯vK
‰ÖÑpR N†Ù½((3.8%:9.4%)!
36
Opteron 2435
(2.6GHz)!
Xeon X5570
(2.93GHz HT On)!
Xeon X5570
(2.93GHz HT Off)!
8VM! 200W! 87.3%! 259W! 113.1%! 253W*! 110.5%!
12VM! 229W*! 100%! 272W! 118.8%! 258W! 112.7%!
16VM! 229W! 100%! 279W*! 121.8%! 255W! 111.4%!
<¥!

SLES11で構築するXen仮想化+HAクラスタ入門

  • 1.
    SLES11!"#$% Xen&'(+HA)*+,-.! /0&'(123456789:;<6=>CEO ?@A*B7CDEFD GH7I miyahara@VirtualTech.jp JKLMNO3456 /0&'(1234567PQ! •! 6RL/0&'(123456 –! STRLVirtualTechJapan Inc. –! UVL/0&'(12WVTJ •! XYL2006Z12[ •! 0]L14,250,000^ •! 06L_`abcdbc1-1-10 •! :;<LGH7Ie89:;<6=>CEOf •! gh7ije:;<CTOf •! +,klL8Remno5.5Rp&'(12q.rstuv!$f •! URLLhttp://VirtualTech.jp/ •! &'(12wx$%EFyz{|} –! &'(12wx$%~•€• –! &'(12wx‚ƒ„…l†‡ˆv‰|} –! &'(12Š‹-ƒ„Œ+•މ"#! /0•‰•Y‘ &'(12q’56 e“6€”f! 2
  • 2.
    ‹-! &'(•–"#І—,O˜™—†! Xš! •! Xš –! ˜—›o+†œ—t•žAk†Ÿ—)!v¡¢ £—Œ¤s !¥¦ƒ„Xš –! §¨©Œ•ª¡*sus«eNs¬-—)f •! ‹- –! &'(…¢®—Œ¤s©k£—t‰¯° –! &'(±²eP2Vœ@Œ—-³«œ—Œ¤sf •! ´µ¶· –! rstuv¸¹! –! 12˜™—†‰¯° –! Xen…—+º—»œNO˜™—†! ´µ¶·! 3 Ns¼—u®—†*O½Ÿs+†k¡¾˜™—†Š¿¯°! High Availability Extension7PQ! •! SUSE Linux Enterprise 11!‰HAeHigh Availabilityf•–"#‰„À‰Á©k £—t •! OpenAISŠN—+ •! DRBDyz{OCFS2Š˜™—† •! GUI!XÃÄÅpÆÇ! È!
  • 3.
    ÉʉËÌ•–! •! OS:SUSE LinuxEnerprise 11eÍÎ SLES 11f –! ÏÅÐXenÑÒ³s+†—OwÓÔ •! ÁÂ…l†LSUSE Linux Enterprise 11 High Availability ExtensioneÍÎ SLES 11 HAEf –! ³?—tlÕ³OŠ~Ö+†wº×—ƒØyÙ •! HA•–Ú¡*³-¢/ÛÜs¼¢"Ý!"# –! ¡*³-¢/¡*³-¢ÚÞËÌ –! ßà!á%eÚâãf ä! HA•–"#åæ! 1.! SLES 11 HAE‰³s+†—O 2.! /etc/hosts!‰Ö+†RXà 3.! NTPŠçµƒ„Ö+†è‰éêëì 4.! OpenAIS‰)*+,Xà 5.! DRBDXà 6.! )*+,¢…—+í‰DRBDîïÁ 7.! &'-ŒseÍÎvmfðÝ 8.! )*+,¢…—+í‰vmÁÂ! ñ!
  • 4.
    SLES 11 HAE³s+†—O! 1.!òÀ SLES 11‰³s+†—Oóª+)ôƒÙÚ ISO³?—tеõƒØyÙ 2.! [YaST]![…l†‡ˆv]![v»ös÷ø]Š) ¢k) 3.! v»ösÁ‰‡ªù—»púû$%‰!o üýwþÿØð’Š!À% 4.! "#‰…l†‡ˆv‰ÁÂ![$Ƶ%]pÁ Â&'Ø(%‰!¬ˆk)Š-'Ø)* 5.! ³s+†—O+#wSLES 11‰³s+†—O óª+)ŠQ,&'%‰!oóª+)Š-'% •ISO³?—tŠüÃØ)* -! R./0‰XÃ! xen1yz{xen2!Xà 1.! [YaST]![Ak†Ÿ—)˜—1+]![Ö+† R]Šúû 2.! [ÁÂ]Š)¢k) 3.! IPv»œ+¾Ö+†R¾Ö+†‰r³¢v+Š -K –! 192.168.0.1 xen1.example.com xen1 –! 192.168.0.2 xen2.example.com xen2 2!
  • 5.
    NTP˜—›XÃ! xen1!Xà 1.! [YaST]![Ak†Ÿ—)˜—1+]![NTP• –XÃ]Šúû 2.! NTPó—3sŠŒ+•Žúûéw|4$% zmXà 3.!ëì,³¡56‰[Undisciplined Local Clock(LOCAL)]Š78 4.! [9:]!;—ÜO<=);k)ŠXà 5.! [»*³›‰€>]![Stratum]Š5wÓÔ! ?! NTP)*³vs†XÃ! xen2!Xà 1.! [YaST]![Ak†Ÿ—)˜—1+]![NTP •–XÃ]Šúû 2.! NTPó—3sŠŒ+•Žúûéw|4$ %zmXà 3.! [ÁÂ]!ëì@A‰XÃw[˜—›]Š ¬ˆk)ƒoxen1‰v»œ+Š-K BC!
  • 6.
    OpenAISÛk†vk¡e¡*³-¢f! xen1!Xà 1.! [YaST]![DEF—O]![)*+,]Šúû 2.! [CommunicationChannel]!çµ$%)*+ ,M—»‰Ak†Ÿ—)v»œ+o-O¬§¨ +†v»œ+o-O¬§¨+†™—†ŠXà –! Bind Network AddressL192.168.0.0 –! Multicast AddressL224.0.0.1 –! Multicast PortL5405 3.! M—»‰IDw1ŠXà 4.! rrp modeŠactivewXÃ! BB! OpenAISÛk†vk¡eÛÜs¼¢f7! xen2!Xà 1.! [YaST]![DEF—O]![)*+,]Šúû 2.! [Communication Channel]!çµ$%)*+ ,M—»‰Ak†Ÿ—)v»œ+o-O¬§¨ +†v»œ+o-O¬§¨+†™—†ŠXà –! Bind Network AddressL192.168.0.0 –! Multicast AddressL224.0.0.1 –! Multicast PortL5405 3.! M—»‰IDw2ŠXà 4.! rrp modeŠpassivewXÃ! BG!
  • 7.
    )*+,‰úû¾H)! ¡*³-¢/ÛÜs¼¢IJ!Xà 1.! KLŠúû 2.! M—ù—haclusterw©+Ÿ—»ŠXà –!xen1# passwd hacluster –! xen2# passwd hacluster 3.! IJ‰Ö+†‰KLzNÍΉº-s»!)*+,Šúû –! xen1# service openais start –! xen2# service openais start 4.! ¡*³-¢Ö+†!)*+,‰GUIXÃF—OŠúû –! xen1# crm_gui & 5.! Connection!)*+,wH) –! Server:127.0.0.1 –! User NameLhacluster –! PasswordLXÄ©+Ÿ—» BO! )*+,‰P0XÃ! 1.! )*+,XÃF—O‰QwR%[CRM Config]Š)¢k) 2.! [No Quorum Policy]XÊ[ignore]wÓÔ –! DRBDŠSµƒo)T—*ŽŠSµƒ½(„À 3.! [Stonith Enabled]‰¬ˆk)ŠU$ –! STONITHŠçV½(„À! BÈ!
  • 8.
    DRBDµîï‰W¶! •! [YaST]!]Œ+•Ž]![óª+)‰àX]Š úû •! LVMµ©—•ªŒ¤sŠÁ •!B¢®—ŽÄÅ!YÅB¢®—ŽŠÁ –! B¢®—Ž«O—¡lv4drbdŠÁ –! YÅB¢®—ŽvmconfigZvmimagesŠÁ –! /dev/lv4drbd/vmconfig 3GB –! /dev/lv4drbd/vmimages 40GB! Bä! DRBD‰XÃ(vmconfig)! •! [YaST]![DEF—O]![Drbd]Šúû •! …—+XÊ78ƒoAddŠ)¢k) •! DRBD¢…—+vmconfigŠÁ Node 1! Node 2! [R! vmconfig! Name! xen1! xen2! Address:Port! 192.168.0.1:7789! 192.168.0.2:7789! Device! /dev/drbd0! /dev/drbd0! Disk! /dev/lv4drbd/vmconfig! /dev/lv4drbd/vmconfig! Meta-disk! internal! internal! Syncer Rate! 500M(Advanced Config!Xý(Z250KB)!Bñ!
  • 9.
    DRBD‰XÃ(vmimages)! •! DRBD¢…—+vmimagesŠÁ Node 1!Node 2! [R! vmimages! Name! xen1! xen2! Address:Port! 192.168.0.1:7790! 192.168.0.2:7790! Device! /dev/drbd1! /dev/drbd1! Disk! /dev/lv4drbd/vmimages! /dev/lv4drbd/vmimages! Meta-disk! internal! internal! Syncer Rate! 500M(Advanced Config!Xý(Z250KB)! B-! DRBD‰úû! ¡*³-¢/ÛÜs¼¢!DRBDŠúû 1.! ¡*³-¢•žÛÜs¼¢w/etc/drbd.confŠº×— 2.! KLŠúû 3.! DRBDŠúû –! xen1# service drbd start –! xen2# service drbd start 4.! ?,ó—,ŠðÝ –! xen1# drbdadm create-md vmconfig –! xen1# drbdadm create-md vmimages –! xen2# drbdadm create-md vmconfig –! xen2# drbdadm create-md vmimages B2!
  • 10.
    DRBD¢…—+‰•ì(! 1.! ¡*³-¢!DRBD¢…—+Š•ì( –! xen1#drbdadm -- --overwrite-data-of-peer primary all 2.! DRBD‰]pUpToDatew½%‰ŠW^ –! xen1# service drbd status –! xen2# service drbd status 3.! ¡*³-¢!/dev/drbd0yz{/dev/drbd1Š•ì( –! xen1# mkfs –t xfs /dev/drbd0 –! xen1# mkfs –t xfs /dev/drbd1 4.! ¡*³-¢/ÛÜs¼¢IJ!DRBD‰ó—3sŠ_` –! )*+,¢…—+ZƒØúû&a%„À –! # service drbd stop B?! DRBDŠ)*+,¢…—+wÁÂ! 1.! ¡*³-¢Ö+†‰KLzNCUI)*+,X ÃF—OŠúû –! # crm config 2.! DRBDŠ)*+,¢…—+wÁ –! º×b!cƒde –! 1*‰f'gphi•wjõ! GC!
  • 11.
    vmconfigµXÃkl! •! primitive vmconfigocf:heartbeat:drbd params drbd_resource=vmconfig op monitor role=Master interval=60s timeout=30s op monitor role=Slave interval=60s timeout=30s •! ms ms-vmconfig vmconfig meta clone-max=2 notify=true globally-unique=false target-role=stopped •! primitive fs-vmconfig ocf:heartbeat:Filesystem params fstype=xfs directory=/etc/xen/vm device=/dev/drbd0 meta target-role=stopped •! order ms-vmconfig-before-fs-vmconfig mandatory: ms- vmconfig:promote fs-vmconfig:start •! colocation fs-vmconfig-on-ms-vmconfig inf: fs-vmconfig ms- vmconfig:Master •! commit •! quit GB! vmimagesµXÃkl! •! primitive vmimages ocf:heartbeat:drbd params drbd_resource=vmimages op monitor role=Master interval=60s timeout=30s op monitor role=Slave interval=60s timeout=30s •! ms ms-vmimages vmimages meta clone-max=2 notify=true globally-unique=false target-role=stopped •! primitive fs-vmimages ocf:heartbeat:Filesystem params fstype=xfs directory=/etc/xen/vm device=/dev/drbd0 meta target-role=stopped •! order ms-vmimages-before-fs-vmimages mandatory: ms- vmimages:promote fs-vmimages:start •! colocation fs-vmimages-on-ms-vmimages inf: fs-vmimages ms- vmimages:Master •! commit •! quit GG!
  • 12.
    DRBD¢…—+úû! 1.! ¡*³-¢!)*+,‰GUIXÃF—OŠúû –! #crm_gui 2.! Connection!)*+,wH) 3.! DRBD‰¢…—+pÁÂ&'Ø(%iZŠW^ 4.! master¢…—+Š78ƒØ?u®—‰úûB,sŠ )¢k)ƒØ¢…—+Šúû 5.! KLzNdfº-s»Šm*ƒØÍÎw-‡s†&' Ø(%iZŠW^ –! /dev/drbd0 ! /etc/xen/vm –! /dev/drbd0 ! /var/lib/xen/images! GO! &'-Œs‰ðÝ! 1.! [YaST]![&'(]![&'-Œs‰ðÝ] Šúû 2.! &'-ŒsŠðÝ –! &'-ŒsRLsles11-ha –! OS:SLES11 –! n‰oÚpqXà •! Windowsô)*+,¢…—+ZƒØrsÆÇ! GÈ!
  • 13.
    &'-ŒsŠ)*+,¢…—+wÁÂ! •! ¡*³-¢Ö+†‰KLzNCUI)*+,X ÃF—OŠúû –! #crm config •! &'-Œssles11-haŠ)*+,¢…—+w Á –! º×b!cƒde –! 1*‰f'gphi•wjõ! Gä! &'-ŒsµXÃkl! •! primitive sles11_ha ocf:heartbeat:Xen params name="sles11- ha" xmfile="/etc/xen/vm/sles11-ha” op monitor interval="10s” op start interval="0s" timeout="30s” op stop interval="0s" timeout="300s" •! colocation sles11_ha-with-fs-vmconfig inf: sles11_ha fs- vmconfig •! order sles11_ha-after-fs-vmconfig inf: fs-vmconfig:start sles11_ha:start •! colocation sles11_ha-with-fs-vmimages inf: sles11_ha fs- vmimages •! order sles11_ha-after-fs-vmimages inf: fs-vmimages:start sles11_ha:start •! commit •! quit Gñ!
  • 14.
    HAûðW^! 1.! &'-Œsp¡*³-¢!ûðƒØ(%i ZŠW^ 2.! ¡*³-¢/ÛÜs¼¢IJ!GUI)*+, XÃF—OŠúûƒo)*+,‰]Št u 3.!¡*³-¢‰v[ŠOFFw$% 4.! ÛÜs¼¢w!&'-Œspúû$%iZ ŠW^ G-! ZÀ! •! XÃ忉xÝyZƒØÚ75%zž( •! XÃklpå{Ὁp|Ó •! }ÿÙN:N~•ZZØô€•w½% •! GUIXÃF—Op‚S –! ƒÇ„wÚ100%!Ú½(p –! GUIÚzÙ…n%‰!oCUIôçmZ†(! G2!
  • 15.
  • 16.
    y «! SSDÚ¬(•ã! A.! SSDÚ†&nm‘ –!$¬½*s¼Žv)Û+ –! -®¯vK –! -}° B.! SSD‹-Úé챲㠖! ‘m³p´½( –! ‘ ‘»*³Šµ¶p$( –! {᷸ʹwºí‰»¼! 32 <¥!
  • 17.
    TPC-B Ns¬-—)½¾! 33 <¥! Ns¬-—)m*•–! •! SASóª+)L2.5”36.4GB 15krpm " 2¿ •! SSDLIntel X25-E(SLC) 32GB " 2¿ –! RAIDºs†;—*—‰§¨kŒ®ÚOff –! óª+)ÀÁ‰§¨kŒ®ŠOn/OffƒÂà •! FC SANLHP MSA1000 –! SCSI 146GB 10krpm " 14¿wz%RAID 5 –! ºs†;—*—w512MB§¨kŒ® •! Cache OffLR50%/W50% •! Cache OnLR0%/W100% •! PostgreSQL 8.3.7wz%Ns¬-—) –! pgbench -c 20 -t 3000 –! 20Êm*ƒo11ÊÃ20ʉÄÅÆŠÇs! 34 <¥!
  • 18.
    •! ÈCPUpÉÊë%ÇeËp4%Ìyf •! CPUºv¹Í&'CPU²š¹p+ô†(½¾Z ½ÿØ(% •!Opteron‰8VMÚΕ«Ú´½(poÏЉ CPUçµÑÚ68%Ìy!ÒKRNe4ºvÒNf %ÇÓÔ! 35 Opteron 2435 (2.6GHz)! Xeon X5570 (2.93GHz HT On)! Xeon X5570 (2.93GHz HT Off)! 8VM! 1553.1! 68.6%! 2175.3! 96.0%! 2180.3*! 96.2%! 12VM! 2265.4*! 100%! 2207.5! 97.4%! 2171.8! 95.9%! 16VM! 2249.1! 99.3%! 2248.7*! 99.3%! 2166.8! 95.6%! <¥! ®¯vKÓÔ! •! Ns¬-—)é‰+|®¯vK!ÓÔ •! OpteronÚXeonw@ƒØ16%•ž18%®¯vK p-( •! Hyper Threadingp%ÇÕww@$%®¯vK ‰ÖÑpR N†Ù½((3.8%:9.4%)! 36 Opteron 2435 (2.6GHz)! Xeon X5570 (2.93GHz HT On)! Xeon X5570 (2.93GHz HT Off)! 8VM! 200W! 87.3%! 259W! 113.1%! 253W*! 110.5%! 12VM! 229W*! 100%! 272W! 118.8%! 258W! 112.7%! 16VM! 229W! 100%! 279W*! 121.8%! 255W! 111.4%! <¥!