The document provides an overview of Sun Cluster 3.0 including its main components, architecture, application support, basic concepts, installation process, and administration commands. It describes the global and userland components, differentiates Sun Cluster 3.0 from other cluster software, and outlines the steps for installing and configuring a Sun Cluster 3.0 system.

1. Sun Cluster 3.0 Introduce
Yong Yan
Sun Support Engineer
Sun Services North China

2. Pre-introduce
•
How long do you support Sun ?
•
Do you have SunCluster
experience ?
•
Install cluster (2.2 or 3.0 or
others)?
•
What do you expect this session ?
Sun Proprietary/Confidential: Internal Use Only

3. Sun Cluster 3.0
•
Sun Cluster 3.0 Overview
•
Sun Cluster 3.0 Basic Concept
•
Sun Cluster 3.0 Install
•
Sun Cluster 3.0 Admin command
•
Difference between 3.0 & 3.1
Sun Proprietary/Confidential: Internal Use Only

4. Sun Cluster 3.0 Overview
SunCluster 3.0 Main
Component
SunCluster 3.0 Architecture
Sun Cluster Application
Support
Sun Proprietary/Confidential: Internal Use Only

5. SunCluster Main Component
Solaris 8
OE
HA Framework
Global
Components
Userland
Components
Sun Proprietary/Confidential: Internal Use Only

6. HA Framework Components
Communication between domains
Heartbeat / Data / Application level
mesg
Persistence of cluster state
Consistent view of cluster
configuration
Cluster membership
Quorum / Fencing of faulted
Sun Proprietary/Confidential: Internal Use Only

7. Cluster Global Components
Global Devices
Cluster-wide namespace
•
Global File Service
Cluster-wide file service
•
Global Network Service
Single IP address for cluster
Scalable service
Load balancing
Sun Proprietary/Confidential: Internal Use Only

8. Cluster Userland Components
●
Command line interfaces
●
SunPlex Manager – Adminstration tool
●
Sun Management Center module – Monitoring
tool
●
Agents
●
Development libraries API
●
SunPlex Agent Builder – Development tool
●
Utilities – scvxinstall, diagnostic toolkit
Sun Proprietary/Confidential: Internal Use Only

9. Different with Other Cluster
●
SunCluster 3.0 is tightly coupled cluster .
●
It is different other cluster software over
solaris ,
such as VCS , SunCluster2.2
VCS & SunCluster2.2 is userland software
SunCluster3.0 is integrated with Solaris , is
extendent of Solaris
Sun Proprietary/Confidential: Internal Use Only

10. Different with Other Cluster
●
Interconnects – low latency , high-bandwidth
links
Type of Interconnects technology
Fast Ethernet, Gigabit Ethernet , SCI
Number of interconnects between nodes
Sun Cluster 3.0 : (min 2 , max 6)
Sun Cluster 2.2 : (min and max 2)
VCS 1.x : (min 1 and max 2)
Sun Proprietary/Confidential: Internal Use Only

11. SunCluster3.0 Architecture
Agents
API
Public Network
Resource Group Mgr
Monitor
User
Kernel
Global Network TCP/IP
Service N/W
stack
Cluster Membership Cluster
Monitor Transport
Other
Nodes
Cluster Configuration
Repository Global Device
Global File Service
Access
Volume Mgt
HA
Storag Framework
e
Sun Proprietary/Confidential: Internal Use Only

12. Cluster H/W Components
Redundant Servers / Domain
Redundant Storage
Redundant Public network access
Redundant Private communications
Sun Proprietary/Confidential: Internal Use Only

13. Cluster H/W Components
Public Network
Heart Beat
host-A host-B
Channel
SW-A SW-B
Channel
Storage-A Storage-B
mirror
RAID RAID
Sun Proprietary/Confidential: Internal Use Only

14. Sun Cluster Application Support
Highly Available Data Service Support
Oracle, Informix, and Sybase databases
NFS
SAP
SunONE Proxy Server
SunONE Directory Server
SunONE Web Server
Apache Web Server
….
Sun Proprietary/Confidential: Internal Use Only

15. Sun Cluster Application Support
Scalable Data Service Support
SunONE Web Server
Apache Web Server
SAP
Broadvision
…
Parallel Database Support
●
Oracle OPS/RAC , Sybase
General Data Service
Sun Proprietary/Confidential: Internal Use Only

16. Sun Cluster3.0 Basic Concepts
Resource Type C++ Class
(RT)
Resource
•
C++ Object
(Instance of RT)
Resource Group
•
C++ Structure
(collection of Resources)
Application Services C++ Program
•
(collection of Resource Group: RG)
Sun Proprietary/Confidential: Internal Use Only

17. Sun Cluster3.0 Basic Concepts
Data Service Agent
(collection of Resource Type)
•
GFS/PxFS/CFS
global file system ,
one new feature of sc3.0,
mount with global option
•
Global Device
unique name of one device in the cluster server
Sun Proprietary/Confidential: Internal Use Only

18. Sun Cluster3.0 Basic Concepts
Device Group
(Management for Disks , are independent of
Resource group )
Sun Proprietary/Confidential: Internal Use Only

19. SunCluster 3.0 Install
●
SunCluster Server/Storage Matrix
Server & Storage Matrix
●
Network(interconnect , public network)
Network Matrix
●
SunCluster3.x S/W Matrix
SunCluster 3.x S/W Matrix
Sun Proprietary/Confidential: Internal Use Only

20. SunCluster 3.0 Install
●
SunCluster 3.x Install step
1. Install admin station
2. Install TC
3. Install Cluster node
4. Install Cluster Framework on the nodes
Sun Proprietary/Confidential: Internal Use Only

21. SunCluster 3.x Install (cont)
●
SunCluster 3.x Install step
5. Install Vxvm
6. Install SDS or SVM
7. Install Data Service Agent
8. Config Data Service
9. encapsulate the root disk and mirror the root
disk
SunClusterSun Proprietary/Confidential: Internal Use Only
3.x Install cookbook

22. SunCluster 3.x Admin Command
Scinstall
Scrgadm
Scswitch
Scsetup
Scconf
Scstat
Pnmset
scshutdown
Sun Proprietary/Confidential: Internal Use Only

23. SunCluster3.x Admin command
Scinstall.
# scinstall -- Install Software
# scinstall –pv -- display the release and
package versioning information for the
SunCluster software installed on the node
•
Scrgadm
Config and Manager the Resource and
Resource Group
Sun Proprietary/Confidential: Internal Use Only

24. SunCluster3.x Admin command
Scsetup
interactive cluster configuration tool
Scconf
Update the SunCluster software
configuration
# scconf –pvv
# scconf –c –q reset
# scconf –a –T .
Sun Proprietary/Confidential: Internal Use Only

25. SunCluster3.x Admin command
scswitch
# scswitch –n –j <resource-name>
# scswitch –e –j <resource-name>
# scswitch –n –M –j <resource-name>
# scswitch –e –M –j <resource-name>
Sun Proprietary/Confidential: Internal Use Only

26. SunCluster3.x Admin command
scswitch
# scswitch –F –g <resource-group name>
# scswitch –Z –g <resource-group name>
# scswitch –z –g <resource-group name> -h
<nodename>
# scswitch –S –h <nodename>
Sun Proprietary/Confidential: Internal Use Only

27. SunCluster3.x Admin command
Scstat
Check the cluster status , run on any node
# scinstall
-- Cluster Nodes -- 目前 cluster 中各节点状态
Node name Status
--------- ------
Cluster node: erp-db1 Online
Cluster node: erp-db2 Online
•
online 状态为节点已加入集群
• offline 的节点不在集群软件控制之下
Sun Proprietary/Confidential: Internal Use Only

28. SunCluster3.x Admin command
Scstat (cont)
-- Cluster Transport Paths -- 心跳连接的状态
Endpoint Endpoint Status
-------- -------- ------
Transport path: erp-db1:hme1 erp-db2:hme1 Path online
Transport path: erp-db1:hme0 erp-db2:hme0 Path online
Sun Proprietary/Confidential: Internal Use Only

29. SunCluster3.x Admin command
Scstat (cont)
-- Quorum Summary --  仲裁设备的状态
Quorum votes possible: 3
Quorum votes needed: 2
Quorum votes present: 3
-- Quorum Votes by Node --
Node Name Present Possible Status
--------- ------- -------- ------
Node votes: erp-db1 1 1 Online
Node votes: erp-db2 1 1 Online
-- Quorum Votes by Device --  已设置的仲裁设备信息
Device Name Present Possible Status
----------- ------- -------- ------
Device votes: /dev/did/rdsk/d9s2 1 1 Online
------------------------------------------------------------------
Sun Proprietary/Confidential: Internal Use Only

30. SunCluster3.x Admin command
Scstat (cont)
--- Device Group Servers --  磁盘组的状态
Device Group Primary Secondary
------------ ------- ---------
Device group servers: rmt/1 - -
Device group servers: rmt/2 - -
Device group servers: rmt/3 - -
Device group servers: erpora erp-db1 erp-db2
Device group servers: erpapp erp-db2 erp-db1
• erpora 目前在 erp-db1 激活；
• erpapp 目前在 erp-db2 激活；
Sun Proprietary/Confidential: Internal Use Only

31. SunCluster3.x Admin command
Scstat (cont)
-- Device Group Status --
Device Group Status
------------ ------
Device group status: rmt/1 Offline
Device group status: rmt/2 Offline
Device group status: rmt/3 Offline
Device group status: erpora Online
Device group status: erpapp Online
------------------------------------------------------------------
Sun Proprietary/Confidential: Internal Use Only

32. SunCluster3.x Admin command
Scstat (cont)
-- Resource Groups and Resources --  资源和资源组设置信息
Group Name Resources
---------- ---------
Resources: nfs-rg erp-db nfs-res oracle-listener oracle-prod
hastorage applprod
Resources: app-rg erp-app app-res hastorage-app
每个资源组包含的资源列表。
-- Resource Groups --  资源组状态
Group Name Node Name State
---------- --------- -----
Group: nfs-rg erp-db1 Online
Group: nfs-rg erp-db2 Offline
Group: app-rg erp-db2 Online
Group: app-rg erp-db1 Offline
------------------------------------------------------------------ Use Only
Sun Proprietary/Confidential: Internal

33. SunCluster3.x Admin command
Scstat (cont)
--- Resources --
Resource Name Node Name State Status Message
------------- --------- ----- --------------
Resource: erp-db erp-db1 Online Online - LogicalH.
Resource: erp-db erp-db2 Offline Offline - Logical.
Resource: nfs-res erp-db1 Online Online - Service .
Resource: nfs-res erp-db2 Offline Offline-Complete
Sun Proprietary/Confidential: Internal Use Only

34. SunCluster3.x Admin command
Scstat (cont)
Resource: oracle-listener erp-db1 Online Online
Resource: oracle-listener erp-db2 Offline Offline
Resource: oracle-prod erp-db1 Online Online
Resource: oracle-prod erp-db2 Offline Offline
Resource: hastorage erp-db1 Online Online
Resource: hastorage erp-db2 Offline Offline
Resource: applprod erp-db1 Online Online
Resource: applprod erp-db2 Offline Offline
Sun Proprietary/Confidential: Internal Use Only

35. SunCluster3.x Admin command
Scstat (cont)
Resource: erp-app erp-db2 Online Online - LogicalHost
Resource: erp-app erp-db1 Offline Offline - LogicalHost.
Resource: app-res erp-db2 Online Online
Resource: app-res erp-db1 Offline Offline
Resource: hastorage-app erp-db2 Online Online
Resource: hastorage-app erp-db1 Offline Offline
------------------------------------------------------------------
Sun Proprietary/Confidential: Internal Use Only

36. SunCluster3.x Admin command
Pnmset / pnmstat.
# pnmset –c nafo0 –o switch ..
# pnmset –c nafo0 –o add ..
# pnmset –c nafo0 –o remove ..
# pnmset –c nafo0 –o create ..
# pnmset –c nafo0 –o delete ..
# pnmstat -l
Sun Proprietary/Confidential: Internal Use Only

37. Sun Cluster 3.0 Admin Command
scshutdown
# scshutdown (run only on one node)
shutdown all the nodes in the cluster
Shutdown one node steps
# scswitch –S –h <nodename>
# shutdown –i0 –g0 -y
Sun Proprietary/Confidential: Internal Use Only

38. Sun Cluster 3.0 Admin Command
SunCluster Boot
SunCluster will auto run with OS boot
up
Boot Node to Non-Cluster mode
ok> boot -x
Sun Proprietary/Confidential: Internal Use Only

39. Difference Between 3.0 & 3.1
public network
SC3.0 : nafo ( local-mac-address?
=false)
SC3.1 : ipmp ( local-mac-address?
=true)
●
More Data Service Agent
●
Expand Fuction of Scsetup
●
More Feature of Agent
Sun Proprietary/Confidential: Internal Use Only

40. Related directory, file
/opt/SUNWcluster (client)
/etc/cluster/conf
/usr/lib/sc
/var/opt/cluster
…
Sun Proprietary/Confidential: Internal Use Only

41. References URL
For more information …
●
SunCluster 3.0 Concepts Guide at :
●
http://docs.sun.com
●
Architecture and API Whitepapers :
●
http://www.sun.com/clusters
●
Solaris software information :
●
http://www.sun.com/Solaris
●
BluePrint : Desiging Enterprise
Solutions with Sun [tm] Cluster 3.0
ISBN
●
http://www.sun.com/blueprints
Sun Proprietary/Confidential: Internal Use Only

42. Q&A
Q&A
Sun Proprietary/Confidential: Internal Use Only

43. Thank You!
Yong Yan
Yong.yan.@Sun.COM