IBM Power Systems provide virtualization capabilities through PowerVM. PowerVM allows customers to run multiple logical partitions (LPARs) on a single physical server. This improves resource utilization and reduces costs compared to a traditional one partition per server model. Key PowerVM technologies include the hypervisor, dynamic logical partitioning, shared processor pools, virtual I/O server, and live partition mobility. The virtual I/O server (VIOS) allows client partitions like IBM i to leverage virtualized storage, network, and other I/O resources rather than each requiring physical adapters.

1. IBM Power Systems
IBM i PowerVM Virtualization with VIOS and Partition Mobility for IBM i
Gottfried Schimunek
3605 Highway 52 North
Senior Architect Rochester, MN 55901
Application Design
IBM STG Software Tel 507-253-2367
Development Fax 845-491-2347
Lab Services
Gottfried@us.ibm.com
IBM ISV Enablement
© 2012 IBM Corporation
IBM Power Systems
Acknowledgements
Thanks to Kris Whitney for providing this comprehensive and detailed presentation
2 © 2012 IBM Corporation
1

2. IBM Power Systems
PowerVM: Virtualization Without Limits
Sold with more than 70% of Power Systems
Improves IT resource utilization
Reduces IT infrastructure costs
Simplifies management
3 © 2012 IBM Corporation
IBM Power Systems
PowerVM Technologies
The leading virtualization platform for UNIX, i and Linux enables a
more agile and responsive infrastructure
Hypervisor
Support for multiple operating environments
Dynamic Logical Partitioning VIOS
Micro-partitioning, resource movement
Multiple Shared Processor Pools Power Hypervisor
Cap processor resources for a group of partitions
Virtual I/O Server
Virtualizes resources for client partitions
Integrated Virtualization Manager
Simplifies partition management for entry systems
Lx86
Supports x86 Linux applications
Live Partition Mobility
Move running AIX and Linux partitions
System Planning Tool
Simplifies the planning for and installation of Power servers with
PowerVM
4 © 2012 IBM Corporation
2

3. IBM Power Systems
PowerVM Editions: Built to Meet Client Virtualization Needs
PowerVM Editions Express Standard Enterprise
Maximum LPARs 1+2 / Server 10 / Core 10 / Core
PowerVM Express Edition
– Evaluations, pilots, PoCs VMControl VMControl VMControl
Management
– Single-server projects IVM IVM, HMC IVM, HMC
PowerVM Standard Edition Virtual I/O Server
– Production deployments PowerVM Lx86
– Server consolidation
Multiple Shared
PowerVM Enterprise Edition Processor Pools
– Multi-server deployments
– Cloud infrastructure Suspend/Resume
Live Partition Mobility
Active Memory Sharing
PowerVM Editions
offer a unified
virtualization
solution for any
Power workloads
5 © 2012 IBM Corporation
IBM Power Systems
Evolution towards: Fully Virtualized, Simplified, Lower cost
+ Mobility of Virtual Machines
+Mobility of workloads with automated and
+ Manually intensive server/storage/network mobility
integrated server, network & storage
management
provisioning
+ VM-based Availability/Resilience Mgmt
+ Workload-based Availability/Resilience
+ Storage Pools Mgmt
+ IO virtualization and virtual switching + Converged Datacenter Network fabric
+ Hypervisor clustered fs access to virtual storage + Storage Pools with advanced capabilities
• Physical resource discovery / configuration / (cloning, snapshot, thin provisioning, …)
provisioning / update / system health
SW SW + Managing to QoS Policies (intelligent
• OS provisioning OS OS Virtl NW placement)
• Virtual IO + VM Security Appliance
Virt Storage
• Virtual Machine lifecycle mgmt
VM/LPAR VM/LPAR Virtual IO Svr
• Dynamic resource optimization within a Image Library
Virtualization Virtual Appliance Image
physical system Deployment App
Image
vSwitch App
Image
Storage AppOS
Image
• VLAN Network App
OS
Compute Memory OS
OS
• External virtualized storage
• External virtualized switches
Shared Network
Workload Mobility
SW SW Shared Storage
OS OS Virtl NW
Virt Storage SW
OS Virtl NW
Virtual Server Virtual Server Virtual IO Svr
Virtualization Virt Storage
VM/LPAR Virtual IO Svr Optimized for ….
Virtualization • Availability
Compute Memory • Performance
vSwitch
• Energy
Storage Network
Compute Memory
Emerging: Virtual Appliances
Storage Network
Maturing: Multi-system & Workload mobility within
Established: Physical systems with virtualization managed across scalable and centrally managed
local virtualization Physical Servers System Pools (Ensembles)
6 © 2012 IBM Corporation
6/12/2012
3

4. IBM Power Systems
Two I/O Server Options
IBM i IBM i
VIOS IBM i
Hypervisor
Hypervisor
POWER6
POWER6
• Built into IBM i •VIOS Server
•Host Disk, Optical, Tape
•Host Disk, Optical, Tape
•Consolidate Ethernet Traffic •Bridge Ethernet Traffic
•Same technology as hosting AIX, •Attach external storage
Linux, and iSCSI
•Advance Virtualization Functions
7 © 2012 IBM Corporation
IBM Power Systems
IBM i Hosting IBM i
IBM i-based Virtualization
– IBM i partition uses I/O resources from another IBM i
partition
– Eliminates requirement to buy adapters and disk drives IBM i IBM i
for each IBM i partition
– Supports simple creation of additional partitions …. e.g.,
for test and development Hypervisor
– Requires POWER6 server with IBM i 6.1 POWER6
– Can mix virtual and direct I/O in client
Platform support
– Most IBM Power6 servers (except blade)
Storage support
– Determined by host IBM i partition ( EXP24, 12S, other
integrated disk and native attached external storage)
LPAR management
– HMC
* All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
8 © 2012 IBM Corporation
4

5. IBM Power Systems
IBM i 6.1 Host and Client Partitions: Overview
Requirements
– POWER6 hardware
IBM i Host IBM i Client – IBM i 6.1 on host and client
– PowerVM not required
– HMC
DDxx DDxx DASD
– Hardware assigned to host LPAR in
HMC
FC 5294 – DASD can be integrated or SAN
– DASD virtualized as NWSSTG objects
NWSSTGs
Optical
– DVD drive in host LPAR virtualized
Virtual SCSI
directly (OPTxx)
EXP24/12S connection
– Optical IMGCLG in host LPAR may be
virtualized
OPTxx
Networking
DVD – Network adapter (such as HEA) and
OPTxx Virtual Ethernet adapter in host LPAR
DVD – Virtual Ethernet adapter in client LPAR
CMNxx
Virtual LAN Tape
IVE – New support as of 7.1 TR2
connection
DS8000
9 © 2012 IBM Corporation
IBM Power Systems
Virtualizing disk storage with IBM i or VIOS
Redundant IBM i or VIOS hosts provide access SAN or
internal storage
– AIX, IBM i, and Linux client partitions
– Client LPAR protects data via mirroring
– Two sets of disk and adapters
Single IBM i or VIOS host provides access to
SAN or internal storage
– AIX, IBM i, or Linux client partitions
– Protect data via RAID-5, RAID-6, or
RAID-10
Redundant VIOS hosts multiple paths to attached SAN
storage with MPIO
– AIX, IBM i, and Linux client partitions
– One set of disk
10 © 2012 IBM Corporation
5

6. IBM Power Systems
IBM i Host VSCSI Virtual Optical
-Load images into the IMGCLG on -Utilize them to install or save to in the
the Server. Client.
- Share the physical DVD/CD in the -Automatic switching of images
Server
11 © 2012 IBM Corporation
IBM Power Systems
IBM i Hosting IBM i Positioning
Same technology as IBM i hosting AIX, LINUX, and
iSCSI x86 servers
Leverage existing hardware investment
– Create new IBM i 6.1 LPARs using only virtual IBM i IBM i
hardware (No IOAs, IOPs, disk units, I/O slots
necessary for client partitions), but may also use
Hypervisor
physical I/O.
POWER6
Rapidly deploy new workloads
– Virtual disk created with 1 command or several
clicks in System i Navigator
– New LPAR, virtual resources deployed
dynamically
Create test environments without hardware
provisioning
– Virtual resources allow new test environments of exact
size to be created, deleted without moving hardware
– Test new applications, tools, fixes in virtual test LPAR
– Test the next release in the client partition
* All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
12 © 2012 IBM Corporation
6

7. IBM Power Systems
VIOS-based Virtualization
– IBM i partition uses I/O resources from Virtual I/O
Server (VIOS)
– VIOS is included with all PowerVM Editions.
– Requires POWER6 systems with IBM i 6.1
VIOS IBM i
Platform support Hypervisor
– IBM Power servers
– IBM BladeCenter JS12 , JS22, JS23, JS43, PS701, POWER6
PS702
Storage support
– Enables attachment to DS3000, DS4000, DS5000,
Storewize V7000, SVC, XIV, DS8000
– Direct Attach Storage (Internal Storage)
• SSD
LPAR management
– HMC or IVM
Integrated Virtualization Manager
– Software for creating and managing
partitions, part of VIOS
– Requires IBM i to use only virtual I/O
resources
13 © 2012 IBM Corporation
IBM Power Systems
What is the VIOS?
A special purpose appliance partition
– Provide I/O virtualization
– Advanced Partition Virtualization enabler
First GAed 2004
Built on top of AIX, but not an AIX partition
IBM i first attached to VIOS in 2008 with the IBM i 6.1
VIOS is licensed with PowerVM
14 © 2012 IBM Corporation
7

8. IBM Power Systems
Why use the VIOS?
I/O Capacity Utilization
Storage Allocation Flexibility
Ethernet Flexibility
Memory Sharing
Suspend/Resume
Mobility
15 © 2012 IBM Corporation
IBM Power Systems
I/O Virtualization on POWER
I/O Bus Virtualization I/O Adapter Virtualization
with Dedicated Adapters with VIO Server
VIOS LPAR
LPAR A LPAR B
LPAR A LPAR B
Physical Physical
Adapter Adapter Physical
DevDrv DevDrv Adapter Virtual Virtual Virtual Virtual
Increasing Adapter Adapter Adapter Adapter
Adapter BW
DevDrv Server Server DevDrv DevDrv
& LPAR
Hypervisor Density
per Slot Virtual Fabric
Hypervisor
Func Func
PCI adapter
PCI adapter Func
Port Port PCI adapter
Port
Fabric
Fabric
16 © 2012 IBM Corporation
8

9. IBM Power Systems
IBM i + VSCSI (Classic)
Source
System 1
VIOS IBM i Client IBM i Client IBM i Client
(System 1) (System 2) (System 3)
System 2
FC HBA
System 3
6B22 6B22 6B22
Device Device Device
•Assign storage to the physical HBA Type Type Type
in the VIOS
•Hostconnect is created as an open
storage or AIX hosttype,
•Requires 512 byte per sector LUNs
to be assigned to the hostconnect
•Cannot Migrate existing direct
connect LUNs Hypervisor
•Many Storage options supported
POWER6 with IBM i 6.1.1
17 © 2012 IBM Corporation
IBM Power Systems
IBM i + VSCSI (Classic) Storage Virtualizer
VIOS IBM i Client
•Storage is assigned to
the VIOS partition
•Within the VIOS you FC HBA
map the hdisk (lun) to
the vhost corresponding
to the client partition
6B22
•Storage management Device
allocation is done from Type
vhostXXX hdisk1
both the external storage
hdisk2
box and the VIOS VSCSI VSCSI
SERVER Client
•Flexible disk sizes up to
2Tb -512
•16 disks per vscsi Hypervisor
adapter
POWER6 with IBM i 6.1.1
18 © 2012 IBM Corporation
9

10. IBM Power Systems
IBM i + VSCSI File Backed Disks
VIOS IBM i Client
•Storage is assigned to
the VIOS partition
FC HBA
•Within the VIOS you fbDisk1
map the logical volume fbDisk2
fbDisk3
backed or file backed
virtual disks to the vhost 6B22
corresponding to the
vhostXXX fbDisk1 Device
client partition fbDisk2 Type
fbDisk3
•Allows more granular
use of the virtual disk VSCSI VSCSI
SERVER Client
•Flexible disk sizes up to
2Tb -512
•Not supported for Hypervisor
suspend/resume or
mobility
POWER6 with IBM i 6.1.1
19 © 2012 IBM Corporation
IBM Power Systems
IBM i + VSCSI Tape and optical
VIOS IBM i Client
•Storage is assigned to
the VIOS partition CD1
OPT01
•Within the VIOS you
map physical tape or
optical or file backed RMT1
TAP01
virtual optical to the
vhost corresponding to
vhostXXX cd1
the client partition rmt1
•No tape library support
with vscsi adpaters. VSCSI VSCSI
Must use VFC adapers. SERVER Client
Hypervisor
POWER6 with IBM i 6.1.1
20 © 2012 IBM Corporation
10

11. IBM Power Systems
IBM i + NPIV ( Virtual Fiber Chanel )
Source
System 1
VIOS IBM i Client IBM i Client IBM i Client
(System 1) (System 1) (System 1)
System 2
8Gbs HBA
System 3
•Hypervisor assigns 2 unique
WWPNs to each Virtual fiber
Virtual address example C001234567890001
•Hostconnect is created as an
iSeries hosttype, Hypervisor
•Requires 520 byte per sector LUNs POWER6 with IBM i 6.1.1
to be assigned to the iSeries
hostconnect on DS8K
•Can Migrate existing direct connect
LUNS
•DS8100, DS8300, DS8700,
Note: an NPIV ( N_port ) capable switch is required to connect the
DS8800, DS5100 and DS5300
VIOS to the DS8000 to use virtual fiber.
supported
21 © 2012 IBM Corporation
IBM Power Systems
NPIV Concepts Multiple VFC server adapters may map to
the same physical adapter port.
Each VFC server adapter connects to one
VFC client adapter; each VFC client
adapter gets a unique WWPN.
Client WWPN stays the same regardless of
physical port it is connected to.
Support for dynamically changing the
physical port to virtual port mapping.
Clients can discover and manage physical
devices on the SAN.
VIOS can’t access or emulate storage, just
provides clients access to the SAN.
Support for concurrent microcode download
to the physical FC adapter
22 © 2012 IBM Corporation
11

12. IBM Power Systems
NPIV Configuration - Server Adapter Mappings
23 © 2012 IBM Corporation
IBM Power Systems
NPIV Configuration - Limitations
Single client adapter per physical port per partition
– Intended to avoid single point of failure
– Documentation only – not enforced
Maximum of 64 active client connections per physical port
– It is possible to map more than 64 clients to a single adapter port
– May be less due to other VIOS resource constraints
32K unique WWPN pairs per system platform
– Removing adapter does not reclaim WWPNs
• Can be manually reclaimed through CLI (mksyscfg, chhwres…)
• “virtual_fc_adapters” attribute
– If exhausted, need to purchase activation code for more
Device Limitations
– Maximum of 128 visible target ports
• Not all visible target ports will necessarily be active
• Redundant paths to a single DS8000 node
• Device level port configuration
• Inactive target ports still require client adapter resources
– Maximum of 64 target devices
Any combination of disk and tape
24 Tape libraries and tape drives are counted separately © 2012 IBM Corporation
12

13. IBM Power Systems
NPIV Performance
N P IV vs D irect Attach (D S 8300)
0.01
0.009
0.008
Application Response Time
0.007
0.006
0.005
0.004
0.003
0.002
0.001
0
0 20 40 60 80 100 120
CP W Use rs
npiv run2 direc t attac h
25 © 2012 IBM Corporation
IBM Power Systems
IBM i + NPIV ( Virtual Fiber ) with PowerHA
Source
SYSBAS
VIOS 1 IBM i Client 1 IBM i Client 2
IASP VIOS
8Gbs HBA
SYSBAS
IASP
Each port is assigned separate
WWPNs by the Hypervisor Hypervisor
Each port is seen as a separate
POWER6 with IBM i 6.1.1
adapter by IBM i – so PowerHA reset it
individually.
Reduces the hardware for a single
partition from 4 to 2 adapters for
•Note, This configuration can support up to 64 IBM i partitions without adding
PowerHA
any more adapters
26 © 2012 IBM Corporation
13

14. IBM Power Systems
PowerHA in the Virtual I/O Environment
With VSCSI
– All Logical replication solutions supported including iCluster
– PowerHA for i - Geographic mirroring
– PowerHA for i – Storwize V7000 Metro and Global Mirror support
(4Q2011)
With NPIV
– All Logical replication solutions supported including iCluster
– PowerHA for i - Geographic mirroring
– PowerHA for i – Storwize V7000 Metro and Global Mirror support
(4Q2011)
Plus:
– DS8000 Metro Mirroring
– DS8000 Global Mirroring
– DS8000 Lun level switching
27 © 2012 IBM Corporation
IBM Power Systems
Fibre Channel Tape library support with NPIV
+
•10/2009 with 6.1.1 •2/2010 with 6.1.1
•3584 (TS3500) with LTO drives •3577 (TS3400) with (TS1120/TS1130 ) drives
•3573 (TS3100 TS3200) with LTO •3584 (TS3500) with (TS1120/TS1130 ) drives
drives •3576 (TS3310) with LTO drives
•TS7650, TS7610
28 © 2012 IBM Corporation
14

15. IBM Power Systems
Redundant VIOS with NPIV
POWER6
Step 1: configure virtual and physical FC adapters
– Best Practice to make VIOS redundant or
separate individual VIOS partitions where a
IBM i single hardware failure would not take down
IASP SYSBAS both VIOS partitions.
Client
VFC
adapters
Server
VFC Step 2: configure SAN fabric and storage
adapters – Zone Luns to the virtual WWPNs.
– Each DASD sees a path through 2 VIOS
partitions
1
VIOS VIOS
•Notes: Support up to 8 paths per LUN
•Not all paths have to go through
separate VIOS partitions.
•New multi-path algorithm in 7.1 TR2
2
Physical FC
connections
29 © 2012 IBM Corporation
IBM Power Systems
VIOS – Storage attach
Three categories of storage attachment to IBM i through VIOS
1) Supported (IBM storage)
- tested by IBM; IBM supports the solution and owns resolution -
IBM will deliver the fix
2) Tested / Recognized (3rd party storage including EMC and Hitachi)
- IBM / storage vendor collaboration, solution was tested (by vendor, IBM, or both);
- CSA in place, states that IBM and storage vendor will work together to resolve the issue
- IBM or storage vendor will deliver the fix
3) Other
- not tested by IBM, maybe not have been tested at all
No commitment / obligation to provide fix
Category #3 (Other) was introduced in the last few years, “other” storage used to
invalidate the VIOS warranty. IBM Service has committed to provide some limited level of
problem determination for service requests / issues involving "other” storage. To the
extent that they will try to isolate it to being a problem within VIOS or IBM i, or external to
VIOS or IBM i (ie. a storage problem). No guarantee that a fix will be provided, even if the
problem was identified as a VIOS or IBM i issue
30 © 2012 IBM Corporation
15

16. IBM Power Systems
Support for IBM Storage Systems with IBM i
DS3200
DS4700
Table as of N Series DS3400 Storwize DS5100 DS8100 DS8700
DS4800 DS6800 SVC XIV
April 5, 2011 @@ DS3500 V7000 DS5300 DS8300 DS8800
DS5020
DS3950
6.1 / 7.1 5.4 / 6.1
IBM i POWER6/7 POWER5/6/7
5.4 / 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 5.4 / 6.1 / 7.1 5.4 / 6.1 / 7.1
Version
Rack / Hardware
POWER5/6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER5/6/7 POWER5/6/7
Not DS3200#, Not 7.1 ###
Tower
Yes DS3500## POWER5/6/7
Systems
Direct* or VIOS Direct or VIOS – Direct or VIOS –
IBM i IFS / NFS
VIOS VIOS VIOS –VSCSI and Direct VIOS VIOS VSCSI and VSCSI and
Attach (NAS) NPIV% NPIV** NPIV**
6.1 / 7.1 6.1 / 7.1
IBM i 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1
POWER6/7 POWER6/7 @, Not
Version POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7
IFS / NFS #, ## supported
Power Hardware (BCH) (BCH) (BCH) (BCH) (BCH) (BCH) (BCH)
Blades (NAS)
IBM i IFS VIOS VIOS
VIOS VIOS VIOS VIOS n/a VIOS VIOS
Attach (NAS) NPIV** NPIV**
Notes
- This table does not list more detailed considerations, for example required levels of firmware or PTFs required or configuration performance considerations
- POWER7 servers require IBM i 6.1 or later
- This table can change over time as addition hardware/software capabilities/options are added
# DS3200 only supports SAS connection, not supported on Rack/Tower servers which use only Fibre Channel connections, supported on Blades with SAS
## DS3500 has either SAS or Fibre Channel connection. Ractk/Tower only uses Fibre Channel. Blades support either SAS or Fibre Channel (either BCS or BCH)
### Not supported on IBM i 7.1. But see SCORE System RPQ 846-15284 for exception support
* Supported with Smart Fibre Channel adapters – NOT supported with IOP-based Fibre Channel adapters
** NPIV requires Machine Code Level of 6.1.1 or later and requires NPIV capable HBAs (FC adapters) and switches
@ BCH supports DS3400, DS3500, DS3950 & BCS supports DS3200, DS3500
@@ N Series can only be used as file server. No load source/boot support. Support only through IFS. No IBM i data base support
% NPIV support for DS5100/DS5300 requires IBM i 7.1 TR2 and must have POWER7 firmware: Ax730_xxx or the POWER6 firmware Service Pack that will be
released 2Q2011
For more details, use the System Storage Interoperability Center: www.ibm.com/systems/support/storage/config/ssic/
Note there are currently some differences between the above table and the SSIC. The SSIC should be updated to reflect the above information
31 © 2012 IBM Corporation
IBM Power Systems
IBM PowerVM Virtual Ethernet
Virtual I/O Server Client 1 Client 2
PowerVM Ethernet switch
Shared
– Part of PowerVM Hypervisor Ethernet
Adapter
– Moves data between LPARs
CMN CMN CMN CMN
(Phy) (Vir) (Vir) (Vir)
Shared Ethernet Adapter
– Part of the VIO server
VLAN-Aware Ethernet Switch
– Logical device
PowerVM Hypervisor
– Bridges traffic to and from
external networks
Ethernet
Switch
Additional capabilities
– VLAN aware
– Link aggregation for external networks
– SEA Failover for redundancy
32 © 2012 IBM Corporation
16

17. IBM Power Systems
SEA Failover Configuration
VIOS VIOS Partition Partition
SEA
SEA
VETH
VETH
VETH
VETH
VETH
VETH
VETH
ETH
ETH
Hypervisor
Client
Network
network
33 © 2012 IBM Corporation
IBM Power Systems
Virtual Ethernet Limits
Description Limit
Maximum virtual Ethernet adapters per LPAR 256
Maximum number of VLANs per virtual adapter 21 VLAN (20 VID, 1
PVID)
Number of virtual adapter per single SEA sharing a 16
single physical network adapter
Maximum number of VLAN IDs 4094
Maximum number of physical adapters in a link 8 primary, 1 backup
aggregation
34 © 2012 IBM Corporation
17

18. IBM Power Systems
PowerVM Active Memory Sharing
Reduce memory costs by improving memory utilization on Power Servers
Supports over-commitment of logical memory
with overflow going to a paging device
POWER Server
Intelligently flow memory from one partition to Virtual
another for increased utilization and flexibility I/O
Dedicated Server
Memory
Shared Memory
Memory from a shared physical memory pool is
dynamically allocated among logical partitions
as needed to optimize overall memory usage
CPU Shared CPU
Paging
Designed for partitions with variable memory
requirements
PowerVM Hypervisor AMS
PowerVM Enterprise Edition on POWER6 and
Power7 processor-based systems
– Partitions must use VIOS for I/O virtualization
* All statements regarding IBM's future direction and intent are subject to change or
35 withdrawal without notice, and represent goals and objectives only. © 2012 IBM Corporation
IBM Power Systems
AMS Geographic Mirroring Environment
SAS
JS12 in BladeCenter
DS3200
VIOS IBM i IBM i
DS3200
DS3K
Paging
Devices
BCS3B2P1 BCS3B2P2 BCS3B2P3
MEMORY
5 drive 5 drive
sysbas sysbas
16 GB Total IBM i 1 10 drives 10 drives
IBM i 2
Physical
12 GB 12 GB IASP Geographic IASP
Mem
Mirroring
36 © 2012 IBM Corporation
18

19. IBM Power Systems
LPAR Suspend/Resume – Customer Value
Resource balancing for long-running batch jobs
– e.g. suspend lower priority and/or long running workloads to free resources.
Planned CEC outages for maintenance/upgrades
– Suspend/resume may be used in place of or in conjunction with partition
mobility.
– Suspend/resume may require less time and effort than manual database
shutdown and restart, for example
Requirements:
• All I/O is virtualized
• HMC version 7 releases 7.3
• FW: Ax730_xxx
• IBM i 7.1 TR2
• VIOS 2.2.1.0 FP24 SP2
37 © 2012 IBM Corporation
IBM Power Systems
Partition Suspend/Resume Partition Suspend/Resume supported on POWER7
IBM i 7.1 TR2
Power7 System #1
Storage
Suspended Partition
IBM i Client 1 Subsystem
Validate environment
for appropriate
resources
A
en0 Ask partiton if it’s
(if)
ready for suspend
vscsi0 ent1
Suspend Partition ReservedStorage Pool
CPU and I/O LUN
M M M M M M Move Memory and CPU
VLAN to Storage Pool
C C C
Hypervisor
Partition Suspended
VASI vhost0 ent1
A
Mover ent2 en2
Service vtscsi0
SEA (if)
fcs0 ent0 VIOS
38 © 2012 IBM Corporation
19

20. IBM Power Systems
Live Partition Mobility
Move a running partition from one Power7 server to
another with no application downtime
Movement to a
different server
with no loss of
service
Virtualized SAN and N etwork Infrastructure
Virtualized SAN and N etwork Infrastructure
Reduce planned downtime by moving Rebalance processing power
workloads to another server during across servers when and
system maintenance where you need it
Live Partition Mobility requires the purchase of the optional PowerVM Enterprise Edition
39 © 2012 IBM Corporation
IBM Power Systems
PowerVM Live Partition Mobility R4
1T
i 7.
IBM
• Move running partition from one system to Live Partition Mobility
another with almost no impact to end users
• Requires POWER7 systems or later, PowerVM
Enterprise, and all I/O must be through the Movement of the
OS and
Virtual I/O Server applications to a
different server
with no loss of
service
• Will require IBM i 7.1 with TR4
Virtualized storage and Network Infrastructure
Virtualized storage and Network Infrastructure
Potential Benefits
• Eliminate planned outages
• Balance workloads across systems
• Energy Savings
40 © 2012 IBM Corporation
20

21. IBM Power Systems
Requirements & Planning
Source and destination must be mobility capable and
compatible.
– Enhanced hardware virtualization capabilities.
– Identical or compatible processors. HMC
– Compatible firmware levels.
Source and destination must be LAN connected – same
subnet. LAN
LPAR
All resources (CPU, Memory, IO adapters) must be
virtualized prior to migration.
– Hypervisor will handle CPU and Memory
automatically, as required. Virtual IO adapters SAN
are pre-configured, and SAN-attached disks
accessed through Virtual IO Server (VIOS)
Boot
Paging
Source and destination VIOS must have symmetrical access Application Data
to the partition’s disks.
– e.g. no internal or VIOS LVM-based disks.
OS is migration enabled/aware.
– Certain tools/middleware can benefit from being
migration aware also.
41 © 2012 IBM Corporation
IBM Power Systems
Partition Mobility: Active and Inactive LPARs
Active Partition Mobility
Active Partition Mobility
Active Partition Migration is the actual movement of a running LPAR from one
Active Partition Migration is the actual movement of a running LPAR from one
physical machine to another without disrupting the operation of the OS and
physical machine to another without disrupting the operation of the OS and
applications running in that LPAR.
applications running in that LPAR.
Applicability
Applicability
Workload consolidation (e.g. many to one)
Workload consolidation (e.g. many to one)
Workload balancing (e.g. move to larger system)
Workload balancing (e.g. move to larger system)
Planned CEC outages for maintenance/upgrades
Planned CEC outages for maintenance/upgrades
Impending CEC outages (e.g. hardware warning received)
Impending CEC outages (e.g. hardware warning received)
Ability to move from Power7 servers to Power8 servers (when available)
Ability to move from Power7 servers to Power8 servers (when available)
without an outage
without an outage
Inactive Partition Mobility
Inactive Partition Mobility
Inactive Partition Migration transfers a partition that is logically ‘powered off’ (not
Inactive Partition Migration transfers a partition that is logically ‘powered off’ (not
running) from one system to another.
running) from one system to another.
Suspended Partition Mobility
Suspended Partition Mobility
Suspended Partition Migration transfers a partition that is suspended from one
Suspended Partition Migration transfers a partition that is suspended from one
system to another.
system to another.
42 © 2012 IBM Corporation
21

22. IBM Power Systems Requirements
Software
SDMC/HMC/Firmware
version 7 releases 7.5
FW: 7.3.X SP, 7.4.X
PowerVM Enterprise Edition
VIOS 2.2.1.4
Supported client operating systems I/O
IBM i 7.1 TR4 All I/O through the VIOS
VSCSI, NPIV, VE
External Storage
Same storage to both source and
destination
Power7 Hardware
Both source and destination on same
Ethernet network
43 © 2012 IBM Corporation
IBM Power Systems
Live Partition Mobility Partition Mobility supported on POWER7
IBM i 7.1 TR4
Power7 System #1 Power7 System #2
Suspended Partition
IBM i Client 1 Shelli Partition
IBM Client 1
Once enough memory
Finish the migration
M M M M M M M Validate environment M M M M M M M
Create remove SCSI
Create virtualbeen
pages migrating
and shell partition
Start have the
for appropriate
moved, suspend the
on target system
memory LPAR
original pages
devices
resources
source system
definitions
A LIN1 LIN1 A
DC01 CMN01 CMN01 DC01
HMC
VLAN VLAN
Hypervisor Hypervisor
VASI vhost0 ent1 ent1 vhost0 VASI
Mover ent2 en2 en2 ent2 Mover
Service vtscsi0 vtscsi0 Service
SEA (if) (if) SEA
fcs0 ent0 VIOS VIOS ent0 fcs0
Storage
Subsystem
A
44 © 2012 IBM Corporation
22

23. IBM Power Systems
If using 5250 interactive support, ensure both the source and target systems
have the "5250 application capable" set to “True”.
45 © 2012 IBM Corporation
IBM Power Systems
Configuration
46 © 2012 IBM Corporation
23

24. IBM Power Systems
VIOS - Mover service partition (MSP)
Required for ACTIVE Partition Mobility only
Maximum of four (4) concurrent migrations per control point
Provides VIOS functions:
– Asynchronously extracts, transports, installs partition state during
migrations
47 © 2012 IBM Corporation
IBM Power Systems
48 © 2012 IBM Corporation
24

25. IBM Power Systems
49 © 2012 IBM Corporation
IBM Power Systems
IBM i Restrictions
The logical partition must have all disks backed by physical volumes.
The logical partition must not be assigned a virtual SCSI optical or tape device or an
NPIV attached tape device.
The logical partition cannot be activated with a partition profile which has a virtual
SCSI server adapter: can not be hosting another partition.
The logical partition cannot be activated with a partition profile which has a virtual
SCSI client adapter that is hosted by another IBM i logical partition: can not be a
hosted partition.
No virtual SCSI server adapters can be dynamically added to the logical partition.
No virtual SCSI client adapters that are hosted by another IBM i logical partition can
be dynamically added to the logical partition being moved.
The logical partition must not be an alternative error logging partition.
– An alternative error logging partition is a target from the HMC for error logs.
The logical partition cannot collect physical I/O statistics.
The logical partition must not be a time reference partition.
– Used to synchronize time between partitions
• The VIOS partitions will do this automatically as part of the migration
50 © 2012 IBM Corporation
25

26. IBM Power Systems
IBM i + VSCSI Zoning Source
VIOS IBM i Client
System 1 (System 1)
FC HBA
Hypervisor
POWER7 with IBM i 7.1 TR4
Destination
VIOS
All zoning is done to the
FC HBA physical HBA in the VIOS
Assign storage to the physical
HBAs in both the VIOS lpars
Make sure to set no_reserve on
the hdisks (chdev -dev hdiskX -
attr reserve_policy=no_reserve)
Hypervisor
POWER7 with IBM i 7.1 TR4
51 © 2012 IBM Corporation
IBM Power Systems
IBM i + NPIV Zoning for Mobility
Source
System 1
VIOS IBM i Client
(System 1)
8Gbs HBA
Hypervisor 1. Zone your storage
POWER7 with IBM i 7.1 TR 4
ports to both WWPNs
VIOS
on the Virtual Fibre
Destination
Channel Adapter.
8Gbs HBA
2. Zone both source and
target VIOSes to see the
same FC targets
Hypervisor 3. Only assign storage to
POWER7 with IBM i 7.1 TR 4
the virtual WWPNs
52 © 2012 IBM Corporation
26

27. IBM Power Systems
Processor Pool assignment upon Migration?
53 © 2012 IBM Corporation
IBM Power Systems
Questions
54 © 2012 IBM Corporation
27

28. IBM Power Systems
Requirements
If you have items your
business requires,
Submit a
requirement!
Help IBM understand
how we can help you.
55 © 2012 IBM Corporation
IBM Power Systems
56 © 2012 IBM Corporation
28

29. IBM Power Systems
57 © 2012 IBM Corporation
IBM Power Systems
Migration Process
58 © 2012 IBM Corporation
29

30. IBM Power Systems
Source Managed System – Migrating From
Destination Managed System – Migrating To
59 © 2012 IBM Corporation
IBM Power Systems
Logical Partition Mobility - Processes
Validate - Live Partition Mobility and Mobility
Readiness Check
Migrate - Live Partition Mobility via Wizard
Recover – Process implemented after Failed
Migration
60 © 2012 IBM Corporation
30

31. IBM Power Systems
Logical Partition Mobility - Process
Validate - Live Partition Mobility and Mobility
Readiness Check
Select the IBM i partition to be validated
Operations – Mobility - Validate
61 © 2012 IBM Corporation
IBM Power Systems
62 © 2012 IBM Corporation
31

32. IBM Power Systems
Migration Validation
63 © 2012 IBM Corporation
IBM Power Systems
HMC validation
Checks the source and destination systems, POWER Hypervisor, Virtual I/O
Servers, and mover service partitions for active partition migration capability and compatibility
Checks that the RMC connections to the mobile partition, the source and destination Virtual
I/O Servers, and the connection between the source and destination mover service partitions
are established
Checks that there are no required physical adapters in the mobile partition and that there are
no required virtual serial slots higher than slot 2
Checks that no client virtual SCSI disks on the mobile partition are backed by logical volumes
and that no disks map to internal disks
Checks the mobile partition, its OS, and its applications for active migration capability.
Checks that the logical memory block size is the same on the source and destination systems
Checks that the mobile partition is not configured with barrier synchronization registers
Checks that the mobile partition is not configured with huge pages
Checks that the partition state is active or running
Checks that the mobile partition is not in a partition workload group
Checks the uniqueness of the mobile partition’s virtual MAC addresses
Checks that the mobile partition’s name is not already in use on the destination server
Checks the number of current active migrations against the number of supported active
migrations
64 © 2012 IBM Corporation
32

33. IBM Power Systems
IBM i Validation
During validation HMC sends a command to the partition to prepare for
hibernation.
Work Management has 3 exit points for suspend/resume or mobility
– The first one exit program to ask if it’s ok to proceed.
– The exit program is called again for any action required before the
operation.
– The exit for resume is called after the partition is resumed or moved
and it allows for any necessary cleanup.
Current functions that will prevent suspend/resume
– The partition is a member of an active cluster
– A tape resource varied on.*
Current functions that will prevent a migration
– A tape resource varied on
65 © 2012 IBM Corporation
IBM Power Systems
No Network Connection – RMC won’t function
Internal Storage would cause another failure on
Validation - must be shared external storage
66 © 2012 IBM Corporation
33

34. IBM Power Systems
67 © 2012 IBM Corporation
IBM Power Systems
68 © 2012 IBM Corporation
34

35. IBM Power Systems
Migrated partition “y0112p6” to destination server
69 © 2012 IBM Corporation
IBM Power Systems
Migrate
70 © 2012 IBM Corporation
35

36. IBM Power Systems
Migration wizard
71 © 2012 IBM Corporation
IBM Power Systems
Migration wizard continued…
72 © 2012 IBM Corporation
36

37. IBM Power Systems
Migration wizard continued…
73 © 2012 IBM Corporation
IBM Power Systems
Migration wizard continued…
74 © 2012 IBM Corporation
37

38. IBM Power Systems
Migration wizard continued…
75 © 2012 IBM Corporation
IBM Power Systems
Migration wizard continued…
76 © 2012 IBM Corporation
38

39. IBM Power Systems
Migration wizard continued…
77 © 2012 IBM Corporation
IBM Power Systems
Performance Considerations
Active partition migration involves moving the state of a partition
from one system to another while the partition is still running.
– Partition memory state is tracked while transferring memory state to
the destination system
– Multiple memory transfers are done until a sufficient amount of
clean pages have been moved.
Memory updates on the source system affect transfer time
– Reduce the partition’s memory update activity prior to the migration
Network speed affects the transfer time
– Use a dedicated network, if possible
– At least 1Gb speed
– Possibly use link aggregated ports for more bandwidth
78 © 2012 IBM Corporation
39

40. IBM Power Systems
Application impacts during migration
In general, applications and the operating system are
unaware that the partition is moved from one system to
another.
There are some exceptions to this:
– Collection Services; when the partition is starting to run
on the target system, the Collection Services collector
job will cycle the collection so correct hardware
information is recorded on the target system.
79 © 2012 IBM Corporation
IBM Power Systems
Workload (Virtual Server) Resilience within a System Pool
Relocate Virtual Servers between Hosts within the Pool
- Determine best host placement within the pool
- Supports single virtual servers and host evacuation
Move virtual servers away from a failing host system.
- Automate relocation and placement of virtual servers in response to
predicted host system failures with no disruption.
Restart virtual servers when a host system fails.
- Automate remote restart and placement of virtual servers in response
to host system failures with minimal disruption.
- From a checkpoint in the future.
Resilience policy associated with the workload
- Provide workload resilience – yes/no
- Enables host system monitoring for failures and predictive failures
- Automates recovery action based on desire level of automation
System Pool (Ensemble)
Automation policy associated with the workload
- Automate = Advise / Automate
- Advise – VMControl recommends actions and requires confirmation
- Automate – VMControl automates actions
View In Animation Mode
80
80 © 2012 IBM Corporation
6/12/2012
40

41. IBM Power Systems
Resources and references
Techdocs – http://www.ibm.com/support/techdocs
(presentations, tips & techniques, white papers, etc.)
IBM PowerVM Virtualization Introduction and Configuration - SG24-7940
http://www.redbooks.ibm.com/abstracts/sg247940.html?Open
IBM PowerVM Virtualization Managing and Monitoring - SG24-7590
http://www.redbooks.ibm.com/abstracts/sg247590.html?Open
IBM PowerVM Virtualization Active Memory Sharing – REDP4470
http://www.redbooks.ibm.com/abstracts/redp4470.html?Open
IBM System p Advanced POWER Virtualization (PowerVM) Best Practices - REDP4194
http://www.redbooks.ibm.com/abstracts/redp4194.html?Open
Power Systems: Virtual I/O Server and Integrated Virtualization Manager commands
(iphcg.pdf)
http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/iphcg/iphcg.pdf
81 © 2012 IBM Corporation
IBM Power Systems
IBM Systems Lab Services and Training Mainframe Systems
Our Mission and Profile
Support the IBM Systems Agenda and accelerate the adoption of new Power Systems
products and solutions
Maximize performance of our clients’ existing IBM systems
System x & Bladecenter
Deliver technical training, conferences, and other services tailored to meet
client needs
Team with IBM Service Providers to optimize the deployment of IBM
solutions (GTS, GBS, SWG Lab Services and our IBM Business Partners) System Storage
Our Competitive Advantage
Leverage relationships with the IBM development labs to build deep IT Infrastructure Optimization
technical skills and exploit the expertise of our developers
Combined expertise of Lab Services and the Training for Systems team
Skills can be deployed worldwide to assure all client needs can be met Data Center Services
Training Services
Successful worldwide history:
17 years in Americas, 9 years in Europe/Middle East/Africa,
5 years in Asia Pacific
www.ibm.com/systems/services/labservices stgls@us.ibm.com
82 © 2012 IBM Corporation
41

42. IBM Power Systems
Performance and Scalability Services
The IBM i Performance & Scalability Services Center in Rochester can provide facilities, hardware and technical expertise
to assist you in testing hardware or software changes
“Traditional” benchmarks
Proofs of Concept (e.g. HA alternatives, SSD analysis, external storage, etc.)
Stress test your system
Evaluate application scalability
Performance optimization and tuning
Assess application performance when migrating to a new release of IBM i
Determine impact of application changes
Virtualization, consolidation, migration services
Release-to-release upgrades
Capacity planning
.… all with the availability of Lab Services IBM i experts and development personnel
To request any of these services, submit at:
• http://www.ibm.com/systems/services/labservices/psscontact.html
• Or email Cindy Mestad at cindysm@us.ibm.com
83 © 2012 IBM Corporation
IBM Power Systems
Trademarks
The following are trademarks of the International Business Machines Corporation in the United States, other countries, or both.
Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not actively marketed or is not
significant within its relevant market.
Those trademarks followed by ® are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States.
For a complete list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml:
*, AS/400®, e business(logo)®, DBE, ESCO, eServer, FICON, IBM®, IBM (logo)®, iSeries®, MVS, OS/390®, pSeries®, RS/6000®, S/30, VM/ESA®, VSE/ESA, WebSphere®, xSeries®,
z/OS®, zSeries®, z/VM®, System i, System i5, System p, System p5, System x, System z, System z9®, BladeCenter®
The following are trademarks or registered trademarks of other companies.
Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.
Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom.
Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both.
Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries
in the United States and other countries.
UNIX is a registered trademark of The Open Group in the United States and other countries.
Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both.
ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office.
IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce.
* All other products may be trademarks or registered trademarks of their respective companies.
Notes:
Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will
experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed.
Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here.
IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual
environmental costs and performance characteristics will vary depending on individual customer configurations and conditions.
This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without
notice. Consult your local IBM business contact for information on the product or services available in your area.
All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.
Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance,
compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.
Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.
84
84 © 2012 IBM Corporation
42