Your SlideShare is downloading. ×
POWER VM with IBM i and live partition mobility
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

POWER VM with IBM i and live partition mobility

520
views

Published on

COMMON Europe Congress 2012 - Vienna

COMMON Europe Congress 2012 - Vienna

Published in: Technology

1 Comment
0 Likes
Statistics
Notes
  • LPM in our VIO environment is workinf perfect, as far you meet all the requirements before migrate a system. Resources, VLAN, connectivity, VIO Server version, LPAR OS version, check the virtural FC mapping after the LPM.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Be the first to like this

No Downloads
Views
Total Views
520
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
58
Comments
1
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. IBM Power Systems IBM i PowerVM Virtualization with VIOS and Partition Mobility for IBM i Gottfried Schimunek 3605 Highway 52 North Senior Architect Rochester, MN 55901 Application Design IBM STG Software Tel 507-253-2367 Development Fax 845-491-2347 Lab Services Gottfried@us.ibm.com IBM ISV Enablement © 2012 IBM Corporation IBM Power SystemsAcknowledgements Thanks to Kris Whitney for providing this comprehensive and detailed presentation2 © 2012 IBM Corporation 1
  • 2. IBM Power Systems PowerVM: Virtualization Without Limits Sold with more than 70% of Power Systems Improves IT resource utilization Reduces IT infrastructure costs Simplifies management3 © 2012 IBM Corporation IBM Power Systems PowerVM Technologies The leading virtualization platform for UNIX, i and Linux enables a more agile and responsive infrastructure Hypervisor Support for multiple operating environments Dynamic Logical Partitioning VIOS Micro-partitioning, resource movement Multiple Shared Processor Pools Power Hypervisor Cap processor resources for a group of partitions Virtual I/O Server Virtualizes resources for client partitions Integrated Virtualization Manager Simplifies partition management for entry systems Lx86 Supports x86 Linux applications Live Partition Mobility Move running AIX and Linux partitions System Planning Tool Simplifies the planning for and installation of Power servers with PowerVM4 © 2012 IBM Corporation 2
  • 3. IBM Power Systems PowerVM Editions: Built to Meet Client Virtualization Needs PowerVM Editions Express Standard Enterprise Maximum LPARs 1+2 / Server 10 / Core 10 / Core PowerVM Express Edition – Evaluations, pilots, PoCs VMControl VMControl VMControl Management – Single-server projects IVM IVM, HMC IVM, HMC PowerVM Standard Edition Virtual I/O Server – Production deployments PowerVM Lx86 – Server consolidation Multiple Shared PowerVM Enterprise Edition Processor Pools – Multi-server deployments – Cloud infrastructure Suspend/Resume Live Partition Mobility Active Memory Sharing PowerVM Editions offer a unified virtualization solution for any Power workloads 5 © 2012 IBM Corporation IBM Power Systems Evolution towards: Fully Virtualized, Simplified, Lower cost + Mobility of Virtual Machines +Mobility of workloads with automated and + Manually intensive server/storage/network mobility integrated server, network & storage management provisioning + VM-based Availability/Resilience Mgmt + Workload-based Availability/Resilience + Storage Pools Mgmt + IO virtualization and virtual switching + Converged Datacenter Network fabric + Hypervisor clustered fs access to virtual storage + Storage Pools with advanced capabilities • Physical resource discovery / configuration / (cloning, snapshot, thin provisioning, …) provisioning / update / system health SW SW + Managing to QoS Policies (intelligent • OS provisioning OS OS Virtl NW placement) • Virtual IO + VM Security Appliance Virt Storage • Virtual Machine lifecycle mgmt VM/LPAR VM/LPAR Virtual IO Svr • Dynamic resource optimization within a Image Library Virtualization Virtual Appliance Image physical system Deployment App Image vSwitch App Image Storage AppOS Image • VLAN Network App OS Compute Memory OS OS • External virtualized storage • External virtualized switches Shared Network Workload Mobility SW SW Shared Storage OS OS Virtl NW Virt Storage SW OS Virtl NW Virtual Server Virtual Server Virtual IO Svr Virtualization Virt Storage VM/LPAR Virtual IO Svr Optimized for …. Virtualization • Availability Compute Memory • Performance vSwitch • Energy Storage Network Compute Memory Emerging: Virtual Appliances Storage Network Maturing: Multi-system & Workload mobility withinEstablished: Physical systems with virtualization managed across scalable and centrally managed local virtualization Physical Servers System Pools (Ensembles) 6 © 2012 IBM Corporation 6/12/2012 3
  • 4. IBM Power Systems Two I/O Server Options IBM i IBM i VIOS IBM i Hypervisor Hypervisor POWER6 POWER6 • Built into IBM i •VIOS Server •Host Disk, Optical, Tape •Host Disk, Optical, Tape •Consolidate Ethernet Traffic •Bridge Ethernet Traffic •Same technology as hosting AIX, •Attach external storage Linux, and iSCSI •Advance Virtualization Functions 7 © 2012 IBM Corporation IBM Power Systems IBM i Hosting IBM i IBM i-based Virtualization – IBM i partition uses I/O resources from another IBM i partition – Eliminates requirement to buy adapters and disk drives IBM i IBM i for each IBM i partition – Supports simple creation of additional partitions …. e.g., for test and development Hypervisor – Requires POWER6 server with IBM i 6.1 POWER6 – Can mix virtual and direct I/O in client Platform support – Most IBM Power6 servers (except blade) Storage support – Determined by host IBM i partition ( EXP24, 12S, other integrated disk and native attached external storage) LPAR management – HMC* All statements regarding IBMs future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. 8 © 2012 IBM Corporation 4
  • 5. IBM Power Systems IBM i 6.1 Host and Client Partitions: Overview Requirements – POWER6 hardware IBM i Host IBM i Client – IBM i 6.1 on host and client – PowerVM not required – HMC DDxx DDxx DASD – Hardware assigned to host LPAR in HMC FC 5294 – DASD can be integrated or SAN – DASD virtualized as NWSSTG objects NWSSTGs Optical – DVD drive in host LPAR virtualized Virtual SCSI directly (OPTxx)EXP24/12S connection – Optical IMGCLG in host LPAR may be virtualized OPTxx Networking DVD – Network adapter (such as HEA) and OPTxx Virtual Ethernet adapter in host LPAR DVD – Virtual Ethernet adapter in client LPAR CMNxx Virtual LAN Tape IVE – New support as of 7.1 TR2 connection DS8000 9 © 2012 IBM Corporation IBM Power Systems Virtualizing disk storage with IBM i or VIOS Redundant IBM i or VIOS hosts provide access SAN or internal storage – AIX, IBM i, and Linux client partitions – Client LPAR protects data via mirroring – Two sets of disk and adapters Single IBM i or VIOS host provides access to SAN or internal storage – AIX, IBM i, or Linux client partitions – Protect data via RAID-5, RAID-6, or RAID-10 Redundant VIOS hosts multiple paths to attached SAN storage with MPIO – AIX, IBM i, and Linux client partitions – One set of disk 10 © 2012 IBM Corporation 5
  • 6. IBM Power Systems IBM i Host VSCSI Virtual Optical -Load images into the IMGCLG on -Utilize them to install or save to in the the Server. Client. - Share the physical DVD/CD in the -Automatic switching of images Server 11 © 2012 IBM Corporation IBM Power Systems IBM i Hosting IBM i Positioning Same technology as IBM i hosting AIX, LINUX, and iSCSI x86 servers Leverage existing hardware investment – Create new IBM i 6.1 LPARs using only virtual IBM i IBM i hardware (No IOAs, IOPs, disk units, I/O slots necessary for client partitions), but may also use Hypervisor physical I/O. POWER6 Rapidly deploy new workloads – Virtual disk created with 1 command or several clicks in System i Navigator – New LPAR, virtual resources deployed dynamically Create test environments without hardware provisioning – Virtual resources allow new test environments of exact size to be created, deleted without moving hardware – Test new applications, tools, fixes in virtual test LPAR – Test the next release in the client partition* All statements regarding IBMs future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. 12 © 2012 IBM Corporation 6
  • 7. IBM Power SystemsVIOS-based Virtualization – IBM i partition uses I/O resources from Virtual I/O Server (VIOS) – VIOS is included with all PowerVM Editions. – Requires POWER6 systems with IBM i 6.1 VIOS IBM i Platform support Hypervisor – IBM Power servers – IBM BladeCenter JS12 , JS22, JS23, JS43, PS701, POWER6 PS702 Storage support – Enables attachment to DS3000, DS4000, DS5000, Storewize V7000, SVC, XIV, DS8000 – Direct Attach Storage (Internal Storage) • SSD LPAR management – HMC or IVM Integrated Virtualization Manager – Software for creating and managing partitions, part of VIOS – Requires IBM i to use only virtual I/O resources13 © 2012 IBM Corporation IBM Power SystemsWhat is the VIOS? A special purpose appliance partition – Provide I/O virtualization – Advanced Partition Virtualization enabler First GAed 2004 Built on top of AIX, but not an AIX partition IBM i first attached to VIOS in 2008 with the IBM i 6.1 VIOS is licensed with PowerVM14 © 2012 IBM Corporation 7
  • 8. IBM Power SystemsWhy use the VIOS? I/O Capacity Utilization Storage Allocation Flexibility Ethernet Flexibility Memory Sharing Suspend/Resume Mobility15 © 2012 IBM Corporation IBM Power Systems I/O Virtualization on POWER I/O Bus Virtualization I/O Adapter Virtualization with Dedicated Adapters with VIO Server VIOS LPAR LPAR A LPAR B LPAR A LPAR B Physical Physical Adapter Adapter Physical DevDrv DevDrv Adapter Virtual Virtual Virtual Virtual Increasing Adapter Adapter Adapter Adapter Adapter BW DevDrv Server Server DevDrv DevDrv & LPAR Hypervisor Density per Slot Virtual Fabric Hypervisor Func Func PCI adapter PCI adapter Func Port Port PCI adapter Port Fabric Fabric16 © 2012 IBM Corporation 8
  • 9. IBM Power SystemsIBM i + VSCSI (Classic) Source System 1 VIOS IBM i Client IBM i Client IBM i Client (System 1) (System 2) (System 3) System 2 FC HBA System 3 6B22 6B22 6B22 Device Device Device •Assign storage to the physical HBA Type Type Type in the VIOS •Hostconnect is created as an open storage or AIX hosttype, •Requires 512 byte per sector LUNs to be assigned to the hostconnect •Cannot Migrate existing direct connect LUNs Hypervisor •Many Storage options supported POWER6 with IBM i 6.1.117 © 2012 IBM Corporation IBM Power SystemsIBM i + VSCSI (Classic) Storage Virtualizer VIOS IBM i Client •Storage is assigned to the VIOS partition •Within the VIOS you FC HBA map the hdisk (lun) to the vhost corresponding to the client partition 6B22 •Storage management Device allocation is done from Type vhostXXX hdisk1 both the external storage hdisk2 box and the VIOS VSCSI VSCSI SERVER Client •Flexible disk sizes up to 2Tb -512 •16 disks per vscsi Hypervisor adapter POWER6 with IBM i 6.1.118 © 2012 IBM Corporation 9
  • 10. IBM Power SystemsIBM i + VSCSI File Backed Disks VIOS IBM i Client •Storage is assigned to the VIOS partition FC HBA •Within the VIOS you fbDisk1 map the logical volume fbDisk2 fbDisk3 backed or file backed virtual disks to the vhost 6B22 corresponding to the vhostXXX fbDisk1 Device client partition fbDisk2 Type fbDisk3 •Allows more granular use of the virtual disk VSCSI VSCSI SERVER Client •Flexible disk sizes up to 2Tb -512 •Not supported for Hypervisor suspend/resume or mobility POWER6 with IBM i 6.1.119 © 2012 IBM Corporation IBM Power SystemsIBM i + VSCSI Tape and optical VIOS IBM i Client •Storage is assigned to the VIOS partition CD1 OPT01 •Within the VIOS you map physical tape or optical or file backed RMT1 TAP01 virtual optical to the vhost corresponding to vhostXXX cd1 the client partition rmt1 •No tape library support with vscsi adpaters. VSCSI VSCSI Must use VFC adapers. SERVER Client Hypervisor POWER6 with IBM i 6.1.120 © 2012 IBM Corporation 10
  • 11. IBM Power SystemsIBM i + NPIV ( Virtual Fiber Chanel ) Source System 1 VIOS IBM i Client IBM i Client IBM i Client (System 1) (System 1) (System 1) System 2 8Gbs HBA System 3 •Hypervisor assigns 2 unique WWPNs to each Virtual fiber Virtual address example C001234567890001 •Hostconnect is created as an iSeries hosttype, Hypervisor •Requires 520 byte per sector LUNs POWER6 with IBM i 6.1.1 to be assigned to the iSeries hostconnect on DS8K •Can Migrate existing direct connect LUNS •DS8100, DS8300, DS8700, Note: an NPIV ( N_port ) capable switch is required to connect the DS8800, DS5100 and DS5300 VIOS to the DS8000 to use virtual fiber. supported21 © 2012 IBM Corporation IBM Power SystemsNPIV Concepts Multiple VFC server adapters may map to the same physical adapter port. Each VFC server adapter connects to one VFC client adapter; each VFC client adapter gets a unique WWPN. Client WWPN stays the same regardless of physical port it is connected to. Support for dynamically changing the physical port to virtual port mapping. Clients can discover and manage physical devices on the SAN. VIOS can’t access or emulate storage, just provides clients access to the SAN. Support for concurrent microcode download to the physical FC adapter22 © 2012 IBM Corporation 11
  • 12. IBM Power SystemsNPIV Configuration - Server Adapter Mappings23 © 2012 IBM Corporation IBM Power SystemsNPIV Configuration - Limitations Single client adapter per physical port per partition – Intended to avoid single point of failure – Documentation only – not enforced Maximum of 64 active client connections per physical port – It is possible to map more than 64 clients to a single adapter port – May be less due to other VIOS resource constraints 32K unique WWPN pairs per system platform – Removing adapter does not reclaim WWPNs • Can be manually reclaimed through CLI (mksyscfg, chhwres…) • “virtual_fc_adapters” attribute – If exhausted, need to purchase activation code for more Device Limitations – Maximum of 128 visible target ports • Not all visible target ports will necessarily be active • Redundant paths to a single DS8000 node • Device level port configuration • Inactive target ports still require client adapter resources – Maximum of 64 target devices Any combination of disk and tape24 Tape libraries and tape drives are counted separately © 2012 IBM Corporation 12
  • 13. IBM Power SystemsNPIV Performance N P IV vs D irect Attach (D S 8300) 0.01 0.009 0.008 Application Response Time 0.007 0.006 0.005 0.004 0.003 0.002 0.001 0 0 20 40 60 80 100 120 CP W Use rs npiv run2 direc t attac h25 © 2012 IBM Corporation IBM Power SystemsIBM i + NPIV ( Virtual Fiber ) with PowerHA Source SYSBAS VIOS 1 IBM i Client 1 IBM i Client 2 IASP VIOS 8Gbs HBA SYSBAS IASPEach port is assigned separateWWPNs by the Hypervisor HypervisorEach port is seen as a separate POWER6 with IBM i 6.1.1adapter by IBM i – so PowerHA reset itindividually.Reduces the hardware for a singlepartition from 4 to 2 adapters for •Note, This configuration can support up to 64 IBM i partitions without addingPowerHA any more adapters26 © 2012 IBM Corporation 13
  • 14. IBM Power SystemsPowerHA in the Virtual I/O Environment With VSCSI – All Logical replication solutions supported including iCluster – PowerHA for i - Geographic mirroring – PowerHA for i – Storwize V7000 Metro and Global Mirror support (4Q2011) With NPIV – All Logical replication solutions supported including iCluster – PowerHA for i - Geographic mirroring – PowerHA for i – Storwize V7000 Metro and Global Mirror support (4Q2011) Plus: – DS8000 Metro Mirroring – DS8000 Global Mirroring – DS8000 Lun level switching27 © 2012 IBM Corporation IBM Power SystemsFibre Channel Tape library support with NPIV + •10/2009 with 6.1.1 •2/2010 with 6.1.1 •3584 (TS3500) with LTO drives •3577 (TS3400) with (TS1120/TS1130 ) drives •3573 (TS3100 TS3200) with LTO •3584 (TS3500) with (TS1120/TS1130 ) drives drives •3576 (TS3310) with LTO drives •TS7650, TS761028 © 2012 IBM Corporation 14
  • 15. IBM Power Systems Redundant VIOS with NPIV POWER6 Step 1: configure virtual and physical FC adapters – Best Practice to make VIOS redundant or separate individual VIOS partitions where a IBM i single hardware failure would not take down IASP SYSBAS both VIOS partitions. Client VFC adapters Server VFC Step 2: configure SAN fabric and storage adapters – Zone Luns to the virtual WWPNs. – Each DASD sees a path through 2 VIOS partitions 1 VIOS VIOS •Notes: Support up to 8 paths per LUN •Not all paths have to go through separate VIOS partitions. •New multi-path algorithm in 7.1 TR2 2 Physical FC connections 29 © 2012 IBM Corporation IBM Power Systems VIOS – Storage attachThree categories of storage attachment to IBM i through VIOS 1) Supported (IBM storage) - tested by IBM; IBM supports the solution and owns resolution - IBM will deliver the fix 2) Tested / Recognized (3rd party storage including EMC and Hitachi) - IBM / storage vendor collaboration, solution was tested (by vendor, IBM, or both); - CSA in place, states that IBM and storage vendor will work together to resolve the issue - IBM or storage vendor will deliver the fix 3) Other - not tested by IBM, maybe not have been tested at all No commitment / obligation to provide fix Category #3 (Other) was introduced in the last few years, “other” storage used to invalidate the VIOS warranty. IBM Service has committed to provide some limited level of problem determination for service requests / issues involving "other” storage. To the extent that they will try to isolate it to being a problem within VIOS or IBM i, or external to VIOS or IBM i (ie. a storage problem). No guarantee that a fix will be provided, even if the problem was identified as a VIOS or IBM i issue 30 © 2012 IBM Corporation 15
  • 16. IBM Power Systems Support for IBM Storage Systems with IBM i DS3200 DS4700 Table as of N Series DS3400 Storwize DS5100 DS8100 DS8700 DS4800 DS6800 SVC XIV April 5, 2011 @@ DS3500 V7000 DS5300 DS8300 DS8800 DS5020 DS3950 6.1 / 7.1 5.4 / 6.1 IBM i POWER6/7 POWER5/6/7 5.4 / 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 5.4 / 6.1 / 7.1 5.4 / 6.1 / 7.1 Version Rack / Hardware POWER5/6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER5/6/7 POWER5/6/7 Not DS3200#, Not 7.1 ### Tower Yes DS3500## POWER5/6/7Systems Direct* or VIOS Direct or VIOS – Direct or VIOS – IBM i IFS / NFS VIOS VIOS VIOS –VSCSI and Direct VIOS VIOS VSCSI and VSCSI and Attach (NAS) NPIV% NPIV** NPIV** 6.1 / 7.1 6.1 / 7.1 IBM i 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 6.1 / 7.1 POWER6/7 POWER6/7 @, Not Version POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7 POWER6/7 IFS / NFS #, ## supportedPower Hardware (BCH) (BCH) (BCH) (BCH) (BCH) (BCH) (BCH)Blades (NAS) IBM i IFS VIOS VIOS VIOS VIOS VIOS VIOS n/a VIOS VIOS Attach (NAS) NPIV** NPIV** Notes - This table does not list more detailed considerations, for example required levels of firmware or PTFs required or configuration performance considerations - POWER7 servers require IBM i 6.1 or later - This table can change over time as addition hardware/software capabilities/options are added # DS3200 only supports SAS connection, not supported on Rack/Tower servers which use only Fibre Channel connections, supported on Blades with SAS ## DS3500 has either SAS or Fibre Channel connection. Ractk/Tower only uses Fibre Channel. Blades support either SAS or Fibre Channel (either BCS or BCH) ### Not supported on IBM i 7.1. But see SCORE System RPQ 846-15284 for exception support * Supported with Smart Fibre Channel adapters – NOT supported with IOP-based Fibre Channel adapters ** NPIV requires Machine Code Level of 6.1.1 or later and requires NPIV capable HBAs (FC adapters) and switches @ BCH supports DS3400, DS3500, DS3950 & BCS supports DS3200, DS3500 @@ N Series can only be used as file server. No load source/boot support. Support only through IFS. No IBM i data base support % NPIV support for DS5100/DS5300 requires IBM i 7.1 TR2 and must have POWER7 firmware: Ax730_xxx or the POWER6 firmware Service Pack that will be released 2Q2011 For more details, use the System Storage Interoperability Center: www.ibm.com/systems/support/storage/config/ssic/ Note there are currently some differences between the above table and the SSIC. The SSIC should be updated to reflect the above information31 © 2012 IBM Corporation IBM Power Systems IBM PowerVM Virtual Ethernet Virtual I/O Server Client 1 Client 2 PowerVM Ethernet switch Shared – Part of PowerVM Hypervisor Ethernet Adapter – Moves data between LPARs CMN CMN CMN CMN (Phy) (Vir) (Vir) (Vir) Shared Ethernet Adapter – Part of the VIO server VLAN-Aware Ethernet Switch – Logical device PowerVM Hypervisor – Bridges traffic to and from external networks Ethernet Switch Additional capabilities – VLAN aware – Link aggregation for external networks – SEA Failover for redundancy32 © 2012 IBM Corporation 16
  • 17. IBM Power SystemsSEA Failover Configuration VIOS VIOS Partition Partition SEA SEA VETH VETH VETH VETH VETH VETH VETH ETH ETH Hypervisor Client Network network33 © 2012 IBM Corporation IBM Power SystemsVirtual Ethernet LimitsDescription LimitMaximum virtual Ethernet adapters per LPAR 256Maximum number of VLANs per virtual adapter 21 VLAN (20 VID, 1 PVID)Number of virtual adapter per single SEA sharing a 16single physical network adapterMaximum number of VLAN IDs 4094Maximum number of physical adapters in a link 8 primary, 1 backupaggregation34 © 2012 IBM Corporation 17
  • 18. IBM Power SystemsPowerVM Active Memory Sharing Reduce memory costs by improving memory utilization on Power Servers Supports over-commitment of logical memory with overflow going to a paging device POWER Server Intelligently flow memory from one partition to Virtual another for increased utilization and flexibility I/O Dedicated Server Memory Shared Memory Memory from a shared physical memory pool is dynamically allocated among logical partitions as needed to optimize overall memory usage CPU Shared CPU Paging Designed for partitions with variable memory requirements PowerVM Hypervisor AMS PowerVM Enterprise Edition on POWER6 and Power7 processor-based systems – Partitions must use VIOS for I/O virtualization * All statements regarding IBMs future direction and intent are subject to change or35 withdrawal without notice, and represent goals and objectives only. © 2012 IBM Corporation IBM Power Systems AMS Geographic Mirroring Environment SAS JS12 in BladeCenter DS3200 VIOS IBM i IBM i DS3200 DS3K Paging Devices BCS3B2P1 BCS3B2P2 BCS3B2P3 MEMORY 5 drive 5 drive sysbas sysbas 16 GB Total IBM i 1 10 drives 10 drives IBM i 2 Physical 12 GB 12 GB IASP Geographic IASP Mem Mirroring36 © 2012 IBM Corporation 18
  • 19. IBM Power SystemsLPAR Suspend/Resume – Customer Value Resource balancing for long-running batch jobs – e.g. suspend lower priority and/or long running workloads to free resources. Planned CEC outages for maintenance/upgrades – Suspend/resume may be used in place of or in conjunction with partition mobility. – Suspend/resume may require less time and effort than manual database shutdown and restart, for example Requirements: • All I/O is virtualized • HMC version 7 releases 7.3 • FW: Ax730_xxx • IBM i 7.1 TR2 • VIOS 2.2.1.0 FP24 SP237 © 2012 IBM Corporation IBM Power SystemsPartition Suspend/Resume Partition Suspend/Resume supported on POWER7 IBM i 7.1 TR2 Power7 System #1 Storage Suspended Partition IBM i Client 1 Subsystem Validate environment for appropriate resources A en0 Ask partiton if it’s (if) ready for suspend vscsi0 ent1 Suspend Partition ReservedStorage Pool CPU and I/O LUN M M M M M M Move Memory and CPU VLAN to Storage Pool C C C Hypervisor Partition Suspended VASI vhost0 ent1 A Mover ent2 en2 Service vtscsi0 SEA (if) fcs0 ent0 VIOS38 © 2012 IBM Corporation 19
  • 20. IBM Power Systems Live Partition Mobility Move a running partition from one Power7 server to another with no application downtime Movement to a different server with no loss of service Virtualized SAN and N etwork Infrastructure Virtualized SAN and N etwork Infrastructure Reduce planned downtime by moving Rebalance processing power workloads to another server during across servers when and system maintenance where you need itLive Partition Mobility requires the purchase of the optional PowerVM Enterprise Edition 39 © 2012 IBM Corporation IBM Power Systems PowerVM Live Partition Mobility R4 1T i 7. IBM • Move running partition from one system to Live Partition Mobility another with almost no impact to end users • Requires POWER7 systems or later, PowerVM Enterprise, and all I/O must be through the Movement of the OS and Virtual I/O Server applications to a different server with no loss of service • Will require IBM i 7.1 with TR4 Virtualized storage and Network Infrastructure Virtualized storage and Network Infrastructure Potential Benefits • Eliminate planned outages • Balance workloads across systems • Energy Savings 40 © 2012 IBM Corporation 20
  • 21. IBM Power SystemsRequirements & Planning Source and destination must be mobility capable and compatible. – Enhanced hardware virtualization capabilities. – Identical or compatible processors. HMC – Compatible firmware levels. Source and destination must be LAN connected – same subnet. LAN LPAR All resources (CPU, Memory, IO adapters) must be virtualized prior to migration. – Hypervisor will handle CPU and Memory automatically, as required. Virtual IO adapters SAN are pre-configured, and SAN-attached disks accessed through Virtual IO Server (VIOS) Boot Paging Source and destination VIOS must have symmetrical access Application Data to the partition’s disks. – e.g. no internal or VIOS LVM-based disks. OS is migration enabled/aware. – Certain tools/middleware can benefit from being migration aware also.41 © 2012 IBM Corporation IBM Power SystemsPartition Mobility: Active and Inactive LPARs Active Partition Mobility Active Partition Mobility Active Partition Migration is the actual movement of a running LPAR from one Active Partition Migration is the actual movement of a running LPAR from one physical machine to another without disrupting the operation of the OS and physical machine to another without disrupting the operation of the OS and applications running in that LPAR. applications running in that LPAR. Applicability Applicability Workload consolidation (e.g. many to one) Workload consolidation (e.g. many to one) Workload balancing (e.g. move to larger system) Workload balancing (e.g. move to larger system) Planned CEC outages for maintenance/upgrades Planned CEC outages for maintenance/upgrades Impending CEC outages (e.g. hardware warning received) Impending CEC outages (e.g. hardware warning received) Ability to move from Power7 servers to Power8 servers (when available) Ability to move from Power7 servers to Power8 servers (when available) without an outage without an outage Inactive Partition Mobility Inactive Partition Mobility Inactive Partition Migration transfers a partition that is logically ‘powered off’ (not Inactive Partition Migration transfers a partition that is logically ‘powered off’ (not running) from one system to another. running) from one system to another. Suspended Partition Mobility Suspended Partition Mobility Suspended Partition Migration transfers a partition that is suspended from one Suspended Partition Migration transfers a partition that is suspended from one system to another. system to another.42 © 2012 IBM Corporation 21
  • 22. IBM Power Systems Requirements Software SDMC/HMC/Firmware version 7 releases 7.5 FW: 7.3.X SP, 7.4.X PowerVM Enterprise Edition VIOS 2.2.1.4 Supported client operating systems I/O IBM i 7.1 TR4 All I/O through the VIOS VSCSI, NPIV, VE External Storage Same storage to both source and destination Power7 Hardware Both source and destination on same Ethernet network43 © 2012 IBM Corporation IBM Power SystemsLive Partition Mobility Partition Mobility supported on POWER7 IBM i 7.1 TR4 Power7 System #1 Power7 System #2 Suspended Partition IBM i Client 1 Shelli Partition IBM Client 1 Once enough memory Finish the migration M M M M M M M Validate environment M M M M M M M Create remove SCSI Create virtualbeen pages migrating and shell partition Start have the for appropriate moved, suspend the on target system memory LPAR original pages devices resources source system definitions A LIN1 LIN1 A DC01 CMN01 CMN01 DC01 HMC VLAN VLAN Hypervisor Hypervisor VASI vhost0 ent1 ent1 vhost0 VASI Mover ent2 en2 en2 ent2 Mover Service vtscsi0 vtscsi0 Service SEA (if) (if) SEA fcs0 ent0 VIOS VIOS ent0 fcs0 Storage Subsystem A44 © 2012 IBM Corporation 22
  • 23. IBM Power Systems If using 5250 interactive support, ensure both the source and target systems have the "5250 application capable" set to “True”.45 © 2012 IBM Corporation IBM Power Systems Configuration46 © 2012 IBM Corporation 23
  • 24. IBM Power Systems VIOS - Mover service partition (MSP) Required for ACTIVE Partition Mobility only Maximum of four (4) concurrent migrations per control point Provides VIOS functions: – Asynchronously extracts, transports, installs partition state during migrations47 © 2012 IBM Corporation IBM Power Systems48 © 2012 IBM Corporation 24
  • 25. IBM Power Systems49 © 2012 IBM Corporation IBM Power SystemsIBM i Restrictions The logical partition must have all disks backed by physical volumes. The logical partition must not be assigned a virtual SCSI optical or tape device or an NPIV attached tape device. The logical partition cannot be activated with a partition profile which has a virtual SCSI server adapter: can not be hosting another partition. The logical partition cannot be activated with a partition profile which has a virtual SCSI client adapter that is hosted by another IBM i logical partition: can not be a hosted partition. No virtual SCSI server adapters can be dynamically added to the logical partition. No virtual SCSI client adapters that are hosted by another IBM i logical partition can be dynamically added to the logical partition being moved. The logical partition must not be an alternative error logging partition. – An alternative error logging partition is a target from the HMC for error logs. The logical partition cannot collect physical I/O statistics. The logical partition must not be a time reference partition. – Used to synchronize time between partitions • The VIOS partitions will do this automatically as part of the migration50 © 2012 IBM Corporation 25
  • 26. IBM Power SystemsIBM i + VSCSI Zoning Source VIOS IBM i Client System 1 (System 1) FC HBA Hypervisor POWER7 with IBM i 7.1 TR4 Destination VIOS All zoning is done to the FC HBA physical HBA in the VIOS Assign storage to the physical HBAs in both the VIOS lpars Make sure to set no_reserve on the hdisks (chdev -dev hdiskX - attr reserve_policy=no_reserve) Hypervisor POWER7 with IBM i 7.1 TR451 © 2012 IBM Corporation IBM Power SystemsIBM i + NPIV Zoning for Mobility Source System 1 VIOS IBM i Client (System 1) 8Gbs HBA Hypervisor 1. Zone your storage POWER7 with IBM i 7.1 TR 4 ports to both WWPNs VIOS on the Virtual Fibre Destination Channel Adapter. 8Gbs HBA 2. Zone both source and target VIOSes to see the same FC targets Hypervisor 3. Only assign storage to POWER7 with IBM i 7.1 TR 4 the virtual WWPNs52 © 2012 IBM Corporation 26
  • 27. IBM Power SystemsProcessor Pool assignment upon Migration?53 © 2012 IBM Corporation IBM Power Systems Questions54 © 2012 IBM Corporation 27
  • 28. IBM Power SystemsRequirementsIf you have items yourbusiness requires,Submit arequirement!Help IBM understandhow we can help you.55 © 2012 IBM Corporation IBM Power Systems56 © 2012 IBM Corporation 28
  • 29. IBM Power Systems57 © 2012 IBM Corporation IBM Power Systems Migration Process58 © 2012 IBM Corporation 29
  • 30. IBM Power Systems Source Managed System – Migrating From Destination Managed System – Migrating To59 © 2012 IBM Corporation IBM Power Systems Logical Partition Mobility - Processes Validate - Live Partition Mobility and Mobility Readiness Check Migrate - Live Partition Mobility via Wizard Recover – Process implemented after Failed Migration60 © 2012 IBM Corporation 30
  • 31. IBM Power Systems Logical Partition Mobility - Process Validate - Live Partition Mobility and Mobility Readiness Check Select the IBM i partition to be validated Operations – Mobility - Validate61 © 2012 IBM Corporation IBM Power Systems62 © 2012 IBM Corporation 31
  • 32. IBM Power SystemsMigration Validation63 © 2012 IBM Corporation IBM Power SystemsHMC validation Checks the source and destination systems, POWER Hypervisor, Virtual I/O Servers, and mover service partitions for active partition migration capability and compatibility Checks that the RMC connections to the mobile partition, the source and destination Virtual I/O Servers, and the connection between the source and destination mover service partitions are established Checks that there are no required physical adapters in the mobile partition and that there are no required virtual serial slots higher than slot 2 Checks that no client virtual SCSI disks on the mobile partition are backed by logical volumes and that no disks map to internal disks Checks the mobile partition, its OS, and its applications for active migration capability. Checks that the logical memory block size is the same on the source and destination systems Checks that the mobile partition is not configured with barrier synchronization registers Checks that the mobile partition is not configured with huge pages Checks that the partition state is active or running Checks that the mobile partition is not in a partition workload group Checks the uniqueness of the mobile partition’s virtual MAC addresses Checks that the mobile partition’s name is not already in use on the destination server Checks the number of current active migrations against the number of supported active migrations64 © 2012 IBM Corporation 32
  • 33. IBM Power SystemsIBM i Validation During validation HMC sends a command to the partition to prepare for hibernation. Work Management has 3 exit points for suspend/resume or mobility – The first one exit program to ask if it’s ok to proceed. – The exit program is called again for any action required before the operation. – The exit for resume is called after the partition is resumed or moved and it allows for any necessary cleanup. Current functions that will prevent suspend/resume – The partition is a member of an active cluster – A tape resource varied on.* Current functions that will prevent a migration – A tape resource varied on65 © 2012 IBM Corporation IBM Power Systems No Network Connection – RMC won’t function Internal Storage would cause another failure on Validation - must be shared external storage66 © 2012 IBM Corporation 33
  • 34. IBM Power Systems67 © 2012 IBM Corporation IBM Power Systems68 © 2012 IBM Corporation 34
  • 35. IBM Power Systems Migrated partition “y0112p6” to destination server69 © 2012 IBM Corporation IBM Power Systems Migrate70 © 2012 IBM Corporation 35
  • 36. IBM Power SystemsMigration wizard71 © 2012 IBM Corporation IBM Power SystemsMigration wizard continued…72 © 2012 IBM Corporation 36
  • 37. IBM Power SystemsMigration wizard continued…73 © 2012 IBM Corporation IBM Power SystemsMigration wizard continued…74 © 2012 IBM Corporation 37
  • 38. IBM Power SystemsMigration wizard continued…75 © 2012 IBM Corporation IBM Power SystemsMigration wizard continued…76 © 2012 IBM Corporation 38
  • 39. IBM Power SystemsMigration wizard continued…77 © 2012 IBM Corporation IBM Power SystemsPerformance Considerations Active partition migration involves moving the state of a partition from one system to another while the partition is still running. – Partition memory state is tracked while transferring memory state to the destination system – Multiple memory transfers are done until a sufficient amount of clean pages have been moved. Memory updates on the source system affect transfer time – Reduce the partition’s memory update activity prior to the migration Network speed affects the transfer time – Use a dedicated network, if possible – At least 1Gb speed – Possibly use link aggregated ports for more bandwidth78 © 2012 IBM Corporation 39
  • 40. IBM Power Systems Application impacts during migration In general, applications and the operating system are unaware that the partition is moved from one system to another. There are some exceptions to this: – Collection Services; when the partition is starting to run on the target system, the Collection Services collector job will cycle the collection so correct hardware information is recorded on the target system. 79 © 2012 IBM Corporation IBM Power SystemsWorkload (Virtual Server) Resilience within a System Pool Relocate Virtual Servers between Hosts within the Pool - Determine best host placement within the pool - Supports single virtual servers and host evacuation Move virtual servers away from a failing host system. - Automate relocation and placement of virtual servers in response to predicted host system failures with no disruption. Restart virtual servers when a host system fails. - Automate remote restart and placement of virtual servers in response to host system failures with minimal disruption. - From a checkpoint in the future. Resilience policy associated with the workload - Provide workload resilience – yes/no - Enables host system monitoring for failures and predictive failures - Automates recovery action based on desire level of automation System Pool (Ensemble) Automation policy associated with the workload - Automate = Advise / Automate - Advise – VMControl recommends actions and requires confirmation - Automate – VMControl automates actions View In Animation Mode 8080 © 2012 IBM Corporation 6/12/2012 40
  • 41. IBM Power SystemsResources and references Techdocs – http://www.ibm.com/support/techdocs (presentations, tips & techniques, white papers, etc.) IBM PowerVM Virtualization Introduction and Configuration - SG24-7940 http://www.redbooks.ibm.com/abstracts/sg247940.html?Open IBM PowerVM Virtualization Managing and Monitoring - SG24-7590 http://www.redbooks.ibm.com/abstracts/sg247590.html?Open IBM PowerVM Virtualization Active Memory Sharing – REDP4470 http://www.redbooks.ibm.com/abstracts/redp4470.html?Open IBM System p Advanced POWER Virtualization (PowerVM) Best Practices - REDP4194 http://www.redbooks.ibm.com/abstracts/redp4194.html?Open Power Systems: Virtual I/O Server and Integrated Virtualization Manager commands (iphcg.pdf) http://publib.boulder.ibm.com/infocenter/systems/scope/hw/topic/iphcg/iphcg.pdf81 © 2012 IBM Corporation IBM Power SystemsIBM Systems Lab Services and Training Mainframe Systems Our Mission and Profile Support the IBM Systems Agenda and accelerate the adoption of new Power Systems products and solutions Maximize performance of our clients’ existing IBM systems System x & Bladecenter Deliver technical training, conferences, and other services tailored to meet client needs Team with IBM Service Providers to optimize the deployment of IBM solutions (GTS, GBS, SWG Lab Services and our IBM Business Partners) System Storage Our Competitive Advantage Leverage relationships with the IBM development labs to build deep IT Infrastructure Optimization technical skills and exploit the expertise of our developers Combined expertise of Lab Services and the Training for Systems team Skills can be deployed worldwide to assure all client needs can be met Data Center Services Training Services Successful worldwide history: 17 years in Americas, 9 years in Europe/Middle East/Africa, 5 years in Asia Pacific www.ibm.com/systems/services/labservices stgls@us.ibm.com82 © 2012 IBM Corporation 41
  • 42. IBM Power SystemsPerformance and Scalability Services The IBM i Performance & Scalability Services Center in Rochester can provide facilities, hardware and technical expertise to assist you in testing hardware or software changes “Traditional” benchmarks Proofs of Concept (e.g. HA alternatives, SSD analysis, external storage, etc.) Stress test your system Evaluate application scalability Performance optimization and tuning Assess application performance when migrating to a new release of IBM i Determine impact of application changes Virtualization, consolidation, migration services Release-to-release upgrades Capacity planning .… all with the availability of Lab Services IBM i experts and development personnel To request any of these services, submit at: • http://www.ibm.com/systems/services/labservices/psscontact.html • Or email Cindy Mestad at cindysm@us.ibm.com83 © 2012 IBM Corporation IBM Power SystemsTrademarks The following are trademarks of the International Business Machines Corporation in the United States, other countries, or both. Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not actively marketed or is not significant within its relevant market. Those trademarks followed by ® are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States. For a complete list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml: *, AS/400®, e business(logo)®, DBE, ESCO, eServer, FICON, IBM®, IBM (logo)®, iSeries®, MVS, OS/390®, pSeries®, RS/6000®, S/30, VM/ESA®, VSE/ESA, WebSphere®, xSeries®, z/OS®, zSeries®, z/VM®, System i, System i5, System p, System p5, System x, System z, System z9®, BladeCenter® The following are trademarks or registered trademarks of other companies. Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce. * All other products may be trademarks or registered trademarks of their respective companies. Notes: Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the users job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here. IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply. All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions. This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area. All statements regarding IBMs future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography.8484 © 2012 IBM Corporation 42