1. © 2009 IBM Corporation
CMG 2014
Fernando Ferreira IBM ATS System z - zChampion – IBM Academy
15 Maio 2014
Conceitos e desafios de
Planejamento de capacidade em
ambiente Parallel Sysplex

2. ©2013IBMCorporation
CMG 2014
Index
• Introdução
• z/OS
• Coupling Facility
• Conectividade
• Referencias
2

3. ©2013IBMCorporation
CMG 2014
Introdução
3

4. ©2013IBMCorporation
CMG 2014
Fatores de Performance
4
CF
CEC
Velocidade de processador
Tipo de request (sinc/assinc)
Conectividade (CHPID,Subcanal )
Coupling facility
Velocidade de processador
Configuraçào (ded/shared)
Carga
Memória
Link
Tipo deCF link
Banda
PATH Busy
Miscelaneous
Duplexing
Estruturas
Distancia

5. ©2013IBMCorporation
CMG 2014
Coupling Facility
5
CF
Componentes
Quantidade de CFs
Tipo/Modelo CEC
Numero/tipo de processadores
Configuração (ded/shared)
Memória
Canais
FlashExpress
CBU
Fatores
Numero de requests
Tipos de estrutura
Tipo de workload
Configuração do CEC (CF)
Nivel CFCC
Configuração do CEC (z/OS)
Topologia
Duplexing
Necessidade de recursos “spare”

6. ©2013IBMCorporation
CMG 2014
z/OS CEC
6
CF
Distancia
Componentes
Capacidade
Numero/tipo de processadores
Memória
Canais
Fatores
Numero de requests
Tipos de estrutura
Tipo de workload
Performance CF
Distancia
Topologia
Tipo de lInks
Duplexing

7. ©2013IBMCorporation
CMG 2014
Coupling Facility
7

8. ©2013IBMCorporation
CMG 2014
Topologia
CF 1
CF 2
Sys B
Site A
Site B
Sys 2
5k m
0k m
Sys 1
CF 3

9. ©2013IBMCorporation
CMG 2014
CF Duplexing
9
CF 1
CF 2
Sys B
Site A
Site B
Sys A
5k m
0k m

10. ©2013IBMCorporation
CMG 2014
Configuracão

11. ©2013IBMCorporation
CMG 2014
Arquitetura

12. ©2013IBMCorporation
CMG 2014
z/OS
12

13. ©2013IBMCorporation
CMG 2014
CPU x Service Time
0
5
10
15
20
25
30
35
40
45
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39
Service Time
CPUTime
Async
Sync
Sincrono x Assincrono - z/OS Heuristic Algoritm
13
Note 1 ; Escale used is only a comparison example
+10µ +33µX +21µX +??µ

14. ©2013IBMCorporation
CMG 2014
Sincrono x Assincrono – Nova opção (SYNCASYNC)
14
z/OS V2.1, V1.13, V1.12
PARMLIB COPLEXX
SYNCASYNC SIMPLEX(DEFAULT) DUPLEX(32)
SYNCASYNC LOCKSIMPLEX (DEFAULT) LOCKDUPLEX(38)
or
SETXCF MODIFY,SYNCASYNC,LOCKSIMPLEX=38
CPU x Service Time - Sync/Async Threshold
0
10
20
30
40
50
60
70
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Service Time
CPUTime
Async
Sync
CPU x Service Time - Sync/Async Threshold
0
10
20
30
40
50
60
70
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Service Time
CPUTime
Async
Sync
Threshold
D XCF,C
IXC357I 10.26.53 DISPLAY XCF 470
SYSTEM FERNAFE DATA
INTERVAL OPNOTIFY MAXMSG CLEANUP RETRY CLASSLEN
370 200 1000 10 10 835
SSUM ACTION SSUM INTERVAL SSUM LIMIT WEIGHT MEMSTALLTIME
ISOLATE 0 500 70 300
CFSTRHANGTIME
900
...
SYNC/ASYNC CONVERSION THRESHOLD -SOURCE- DEFAULT
SIMPLEX 26 PARMLIB IN USE
DUPLEX 30 PARMLIB 26
LOCK SIMPLEX 38 SETXCF IN USE
LOCK DUPLEX 26 SYSTEM IN USE

15. ©2013IBMCorporation
CMG 2014
Sincrono x Assincrono - RMF
STRUCTURE NAME = FNFLOCK TYPE = LOCK STATUS = ACTIVE
# REQ -------------- REQUESTS ------------- -------------- DELAYED REQUESTS -------------
SYSTEM TOTAL # % OF -SERV TIME(MIC)- REASON # % OF ---- AVG TIME(MIC) ----- EXTERNAL REQUEST
NAME AVG/SEC REQ ALL AVG STD_DEV REQ REQ /DEL STD_DEV /ALL CONTENTIONS
------------------------------------------------------------------------------------------------------------------------------
TOTAL 900M SYNC 5500K 100 5.0 5.0 NO SCH 250K 0.0 333.9 73.4 0.0 REQ TOTAL 43M
11349 ASYNC 0 0.0 85.0 11.2 PR WT 0 0.0 0.0 0.0 0.0 REQ DEFERRED 90K
CHNGD 250K 0.0 PR CMP 0 0.0 0.0 0.0 0.0 -CONT 90K
-FALSE CONT 39K
15
STRUCTURE NAME = FNFLOCK TYPE = LOCK STATUS = ACTIVE
# REQ -------------- REQUESTS ------------- -------------- DELAYED REQUESTS -------------
SYSTEM TOTAL # % OF -SERV TIME(MIC)- REASON # % OF ---- AVG TIME(MIC) ----- EXTERNAL REQUEST
NAME AVG/SEC REQ ALL AVG STD_DEV REQ REQ /DEL STD_DEV /ALL CONTENTIONS
------------------------------------------------------------------------------------------------------------------------------
TOTAL 900M SYNC 5500K 100 15.0 15.0 NO SCH 250K 0.0 333.9 73.4 0.0 REQ TOTAL 43M
11349 ASYNC 0 0.0 85.0 11.2 PR WT 0 0.0 0.0 0.0 0.0 REQ DEFERRED 90K
CHNGD 250K 0.0 PR CMP 0 0.0 0.0 0.0 0.0 -CONT 90K
-FALSE CONT 39K
Overhead (rough) = (Num Req * # service time / Interval RMF) * MIPS GCP (individual)

16. ©2013IBMCorporation
CMG 2014
16
12x InfiniBand
HCA2-O**
HCA2-C
I/O Drawer
ISC-3
ISC-3
ISC-3
ISC-3
zEC12, zBC12,
z196, z114, z10
EC, z10 BC
IFB-MP
zBC12
ISC-3**
HCA2-O LR**
Up to 150 meters
Up to
10/100 km
.... ....
1x InfiniBand
Up to 10/100KM
Fanouts
HCA3-O* HCA3-O LR*
.... ....
12x InfiniBand
Up to 150 meters
1x InfiniBand
Up to 10/100KM
* Not supported on z10
**Carry forward only on zEC12/zBC12
zBC12/zEC12 Coupling Links
Fanout, not I/O slot, used for
InfiniBand
ICB-4 – No longer supported
ETR – No longer supported
All coupling links support STP
Sysplex Coexistence – zEC12,
z196, z114, z10 EC and BC only
zEC12

17. ©2013IBMCorporation
CMG 2014
Type Throughput Distance Fanout Cabling
12x InfiniBand 6 GBps 150 meters
HCA2-O
HCA3-O
50µ MM (OM3) fiber
1x InfiniBand 5 or 2.5 Gbps 10 km
HCA2-O LR*
HCA3-O LR
9µ SM fiber
InfiniBand coupling links
HCA3-O LR fanout for 1x InfiniBand coupling links
CHPID type – CIB
– Four ports per feature
– Fiber optic cabling
– Link sharing between multiple Sysplexes
– Up to 10 km without repeaters, RPQ 8P2263 or
8P2340 is required for 20 km support
– Up to 100 km are also possible using Dense
Wavelength Division Multiplexors (DWDMs), going
over 100 km requires RPQ 8P2263 or 8P2340
– Supports connectivity to HCA2-O LR
– Link data rate server-to-server 5 Gbps
– Link data rate with DWDM; 2.5 or 5 Gbps
CHPID / Subchannel Options
– 7 subchannels per CHPID (default)
– Option to define 32 or 7 subchannels
– Default changed from 32 to 7 for zEC12
HCA3-O fanout for 12x InfiniBand coupling links
• CHPID type – CIB
– Two ports per feature
– Fiber optic cabling – 150 meters
– Supports connectivity to HCA2-O
– Link data rate of 6 GBps
Two protocols (IFB & IFB3)
1. 12x IFB = HCA3-O to HCA2-O
2. 12x IFB3 = HCA3-O to HCA3-O (see below)
• 12x IFB3 service times designed to be 40% faster than 12x IFB
12x IFB3 protocol activation requirements
– Maximum of four CHPIDs per HCA3-O port
• If more than four CHIPDs are defined per port, links will
run at normal 12x IFB service times
• IFB3 protocol activated as long as 4 CHPIDs or less are
defined. No configuration settings required.

18. ©2013IBMCorporation
CMG 2014
Coupling Links Subchannel
Best practice CFSU < 30%
( #Requests Sync x Service TimeSync) + (#Requests Sync x Service TimeSync)
CFSU = --------------------------------------------------------------------------------------------------------------
#Subcanais
CF 1
Sys A
12x InfiniBand
10µ
CFSU = (0,1 * 10) / 7 14,3%
100k req/s
CF 1
Sys A
10µ + 60µ (6 km)
CFSU = (0,1 * 70) / 7 100%
100k req/s
1x InfiniBand
CFSU = (0,1 * 70) / 32 21,9%

19. ©2013IBMCorporation
CMG 2014
Relatório RMF subcanais e PATH Busy
19
1 C O U P L I N G F A C I L I T Y A C T I V I T Y
PAGE 41
z/OS V1R12 SYSPLEX SYSPLEXF START 08/03/2014-13.00.00 INTERVAL 001.00.00
RPT VERSION V1R12 RMF END 08/03/2014-14.00.00 CYCLE 05.000 SECONDS
------------------------------------------------------------------------------------------------------------------------------
COUPLING FACILITY NAME = CF01
------------------------------------------------------------------------------------------------------------------------------
SUBCHANNEL ACTIVITY
------------------------------------------------------------------------------------------------------------------------------
# REQ ----------- REQUESTS ----------- ------------------ DELAYED REQUESTS --------------
SYSTEM TOTAL -- CF LINKS -- PTH # -SERVICE TIME(MIC)- # % OF ------ AVG TIME(MIC) ------
NAME AVG/SEC TYPE GEN USE BUSY REQ AVG STD_DEV REQ REQ /DEL STD_DEV /ALL
MVSA 3247K CIB 8 8 310K SYNC 2689K 12.6 2.2 LIST/CACHE 0 0.0 0.0 0.0 0.0
963.7 SUBCH 56 56 ASYNC 527803 175.8 1463 LOCK 0 0.0 0.0 0.0 0.0
CHANGED 0 INCLUDED IN ASYNC TOTAL 0 0.0
UNSUCC 0 0.0 0.0
MVSY 160030K CIB 6 6 30M SYNC 138591K 15.4 4.4 LIST/CACHE 0 0.0 0.0 0.0 0.0
46442 SUBCH 42 32 ASYNC 6462K 38.2 90.0 LOCK 0 0.0 0.0 0.0 0.0
CHANGED 0 INCLUDED IN ASYNC TOTAL 0 0.0
UNSUCC 0 0.0 0.0
MVSW 8070K CIB 6 6 16M SYNC 5447K 11.6 2.4 LIST/CACHE 0 0.0 0.0 0.0 0.0
1848.6 SUBCH 42 12 ASYNC 1171K 78.0 1163 LOCK 0 0.0 0.0 0.0 0.0
CHANGED 0 INCLUDED IN ASYNC TOTAL 0 0.0
UNSUCC 0 0.0 0.0

20. ©2013IBMCorporation
CMG 2014
Coupling Links and zEC12
20

21. ©2013IBMCorporation
CMG 2014
CF overhead relationship to hardware configuration
21

22. ©2013IBMCorporation
CMG 2014
CF Duplexing – System Managed
22
CF 1
CF 2
Sys B
Site A
Site B
Sys A
5k m
0k m

23. ©2013IBMCorporation
CMG 2014
CF Duplexing – User Managed
23
CF 1
CF 2
Sys B
Site A
Site B
Sys A
5k m
0k m

24. ©2013IBMCorporation
CMG 2014
References
• ITSO Redbooks
http://www.redbooks.ibm.com/
– SG24-8047 zEnterprise End-to-End Extended Distance Connectivity Guide
– SG24-7263 Considerations for Multisite Sysplex Data Sharing
– SG24-7539 Implementing and Managing InfiniBand Coupling Links on System z
– SG24-8049 zEC12 IBM zEnterprise EC12 Technical Guide
– ITSO Workshops “Parallel Sysplex and High Availability” – Frank Kyne
• 2009, 2010, 2011, 2012, 2013
• Other manuals
– SA22-7625 MVS Setting Up a Sysplex
24
Atualizar referencias

25. ©2013IBMCorporation
CMG 2014
Questions
????
25