• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
IBM BladeCenter Foundation for Cloud: Integration Guide
 

IBM BladeCenter Foundation for Cloud: Integration Guide

on

  • 501 views

 

Statistics

Views

Total Views
501
Views on SlideShare
501
Embed Views
0

Actions

Likes
0
Downloads
71
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    IBM BladeCenter Foundation for Cloud: Integration Guide IBM BladeCenter Foundation for Cloud: Integration Guide Document Transcript

    • Redpaper Stephen SmithIBM BladeCenter Foundation for Cloud:Integration GuideSolution Overview IBM® BladeCenter® Foundation for Cloud delivers an ideal platform to expedite virtualized computing through a pre-integrated, pre-tested system that helps you to deploy new workloads quickly. BladeCenter Foundation for Cloud offers the following benefits: Reduced complexity and accelerated implementation of your virtualized data center, using pre-integrated and pre-tested systems with management software, servers and converged networking Pre-installed VMware ESXi Easy connection to external storage, such as IP-based Small Computer System Interface (iSCSI), network-attached storage (NAS), Fibre Channel (FC), or Fibre Channel over Ethernet (FCoE) Reduced infrastructure administration cost with single point of management for virtual and physical resources Extendable to a cloud environment without rip-and-replace IBM BladeCenter Foundation for Cloud is an optimized, integrated system consisting of servers, converged networking, storage, and software that can enable IBM Business Partners to quickly deploy a sophisticated IT solution that is ready for virtualization ready to use. This configuration requires obtaining a VMware vSphere license (Enterprise 4.1 at a minimum). This document has been developed by IBM to help IBM Business Partners to deploy BladeCenter Foundation for Cloud using the solution elements contained in this document. While this solution is available fully integrated from IBM, this document helps you customize the solution for your clients.© Copyright IBM Corp. 2011. All rights reserved. ibm.com/redbooks 1
    • In this paper, we present sample BladeCenter Foundation for Cloud configurations in small, medium, and large sizes. For each of these configurations, we show you what to order and how to integrate, based on IBM-tested solutions. We provide additional resources you can contact and easy information for ordering all of the parts required for each configuration. This paper contains the following sections: “Overview of small, medium, and large configurations” on page 2 “Installing hardware components” on page 8 “Populating the rack enclosures” on page 14 “Cabling the BladeCenter Foundation for Cloud” on page 19 “Updating the hardware and firmware drivers” on page 20 “Additional References” on page 22 “Appendix A. Small configuration parts catalog” on page 23 “Appendix B. Medium configuration parts catalog” on page 24 “Appendix C. Large configuration parts catalog” on page 25Overview of small, medium, and large configurations There are three tested reference configurations for the IBM BladeCenter Foundation for Cloud: Small: Designed for departmental, pilot, and budget-conscious data centers Medium: Intended for most data centers looking for rapid migration and scale-up of resources Large: Designed to provide scale to new or existing virtualized data centers Each configuration represents the number of workloads (including virtual machines) that can be supported and can be expanded to meet specific customer requirements.These configurations are shown in the following sections.2 IBM BladeCenter Foundation for Cloud: Integration Guide
    • Small configuration with optional storage Figure 1 shows the BladeCenter Foundation for Cloud small configuration. 1 x 42U Rack (shown as an example) 1 x DS3524 Dual Controller with 8 Gbps FC (opt.) 1 x Management Server x3550 M3 preloaded with: * Systems Director 6.2 * Active Energy Manager 4.3 * vSphere Client 4.1 * DS Storage 10.7 1 x BladeCenter Foundation for Cloud chassis preloaded with: * 2 x Virtual Fabric 10 Gb Switch * 2 x Virtual Fabric Extension Module * 2 x Server Connectivity Module BladeCenter H 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * IBM BladeCenter Open Fabric Manager Basic 4 x BladeCenter Foundation for Cloud HS22V preloaded with: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * E5649 6C 2.53 GHz, 12 x 8 GB DIMM * Virtual Fabric Adapter with FCoE & VMware ESXi Figure 1 Small BladeCenter Foundation for Cloud configuration IBM BladeCenter Foundation for Cloud: Integration Guide 3
    • Table 1 shows the part ordering information for the main components of a small configuration. Note that storage is optional depending on the requirements of the solution. “Appendix A. Small configuration parts catalog” on page 23 provides a complete list of parts for a small configuration.Table 1 Small configuration parts list Components MTM Quantity Description Management Server 7944-DDx 1 Director 6.2 Active Energy Manager (AEM) 4.3 vSphere Client 4.1 DS Storage Manager 10.7 Windows 2008 R2 Standard Edition 64-bit Foundation for Cloud HS22V 7871-91x 4 E5649 6C 2.53 GHz 12 x 8 GB DIMM Emulex Virtual Fabric Adapter II with FCoE VMware ESXi Foundation for Cloud Chassis 8852-93x 1 Ethernet & Fibre Channel Switching BladeCenter Open Fabric Manager (BOFM) Basic (opt.) System Storage® DS3524 1746A4D 1 8 Gb Fibre Channel Interface Dual redundant controllers4 IBM BladeCenter Foundation for Cloud: Integration Guide
    • Medium configuration with optional storage Figure 2 shows the BladeCenter Foundation for Cloud medium configuration. 1 x 42U Rack (shown as an example) 1 2 x DS3524 Dual Controller with 8Gbps FC (opt.) 8 Gbps FC (opt.) * 6 x System Storage EXP3524 3 1 x Management Server x3550 M3 preloaded with: * Systems Director 6.2 * Active Energy Manager 4.3 * vSphere Client 4.1 * DS Storage 10.7 1 x BladeCenter Foundation for Cloud chassis preloaded with: * 2 x Virtual Fabric 10 Gb Switch * 2 x Virtual Fabric Extension Module * 2 x Server Connectivity Module BladeCenter H 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * IBM BladeCenter Open Fabric Manager Basic 14 x BladeCenter Foundation for Cloud HS22V preloaded with: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * E5649 6C 2.53 GHz, 12 x 8 GB DIMM * Virtual Fabric Adapter with FCoE & VMware ESXi Figure 2 Medium BladeCenter Foundation for Cloud configuration IBM BladeCenter Foundation for Cloud: Integration Guide 5
    • Table 2 shows the part ordering information for the main components of a medium configuration. Note that storage is optional, depending on the requirements of the solution. “Appendix B. Medium configuration parts catalog” on page 24 provides a complete list of parts for a medium configuration.Table 2 Medium configuration parts list Components MTM Quantity Description Management Server 7944-DDx 1 Director 6.2 AEM 4.3 vSphere Client 4.1 DS Storage Manager 10.7 Windows 2008 R2 Standard Edition 64-bit Foundation for Cloud HS22V 7871-91x 14 E5649 6C 2.53 GHz 12 x 8 GB DIMM VFA2 with FCoE VMware ESXi Foundation for Cloud Chassis 8852-93x 1 Ethernet & Fibre Channel Switching BOFM Basic (opt.) System Storage DS3524 1746A4D 1 8 Gb Fibre Channel Interface Dual redundant controllers (opt.) System Storage EXP3524 1746A4E 3 6 Gb SAS disk enclosure6 IBM BladeCenter Foundation for Cloud: Integration Guide
    • Large configuration with optional storage Figure 3 shows the BladeCenter Foundation for Cloud large configuration. 1 x 42U Rack (shown as an example) 2 x DS3524 Dual Controller with 8Gbps FC (opt.) 8 Gbps FC (opt.) * 6 x System Storage EXP3524 1 x Management Server x3550 M3 preloaded with: * Systems Director 6.2 * Active Energy Manager 4.3 * vSphere Client 4.1 BladeCenter H 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * DS Storage 10.7 2 x BladeCenter Foundation for Cloud chassis preloaded with: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * 2 x Virtual Fabric 10 Gb Switch * 2 x Virtual Fabric Extension Module * 2 x Server Connectivity Module BladeCenter H 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * IBM BladeCenter Open Fabric Manager Basic 28 x BladeCenter Foundation for Cloud HS22V preloaded with: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * E5649 6C 2.53 GHz, 12 x 8 GB DIMM * Virtual Fabric Adapter with FCoE & VMware ESXi Figure 3 Large BladeCenter Foundation for Cloud configuration IBM BladeCenter Foundation for Cloud: Integration Guide 7
    • Table 3 shows the part ordering information for the main components of a large configuration. Note that storage is optional, depending on the requirements of the solution. “Appendix C. Large configuration parts catalog” on page 25 provides a complete list of parts for a large configuration.Table 3 Large configuration parts list Components MTM Quantity Description Management Server 7944-DDx 1 Director 6.2 AEM 4.3 vSphere Client 4.1 DS Storage Manager 10.7 Windows 2008 R2 Standard Edition 64-bit Foundation for Cloud HS22V 7871-91x 28 E5649 6C 2.53 GHz 12 x 8 GB DIMM VFA2 with FCoE VMware ESXi Foundation for Cloud Chassis 8852-93x 1 Ethernet & Fibre Channel Switching BOFM Basic (opt.) System Storage DS3524 1746A4D 2 8 Gb Fibre Channel Interface Dual redundant controllers (opt) System Storage EXP3524 1746A4E 6 6 Gb SAS disk enclosureInstalling hardware components Each BladeCenter Foundation for Cloud configuration has these common hardware elements: Management server Host servers with converged networking Chassis with converged networking Storage components This section discusses these elements in detail.8 IBM BladeCenter Foundation for Cloud: Integration Guide
    • System x3550 M3 management server The specially configured management server is an IBM System x3550 M3, preloaded with a customizable systems management tools you need to manage critical hardware components of IBM BladeCenter for Cloud. This management server can also easily scale to manage other components in your data center. The management server comes preloaded with the following components: Windows Server 2008 R2 Standard 64 bit Systems Management Software – IBM Systems Director 6.2 – Active Energy Manager v4.3 – ToolsCenter • Bootable Media Creator 2.0 • Advanced Setup Utility 3.5 • Dynamic Systems Analysis 3.0 • UpdateXpress System Pack Installer 4.0 – IBM DS Storage Manager v10.7 – VMware vSphere Client 4.1 64 bit The management server is an IBM System x3550 M3 model 7944-DDx, which has the following specifications: Two 2.40 GHz Intel Xeon E5620s (4 cores, 2.40 GHz, 12 MB cache, 1066 MHz, 80 W) 24 GB memory (6x 4 GB) IBM ServeRAID M5015 RAID adapter with battery Four 300 GB SAS hard disk drives (HDDs) (2.5") Four 1 Gb Ethernet ports with onboard dual-port Ethernet controller and one dual-port 1 Gb Ethernet daughter card installed in a dedicated slot Two 675 W redundant power supplies IBM UltraSlim Enhanced Serial Advanced Technology Attachment (SATA) multi-burner optical drive Two available Peripheral Component Interconnect Express (PCIe) 2.0 x16 slots Rack slide kit and cable management arm Details about this model can be found in the announcement letter: http://ibm.com/common/ssi/cgi-bin/ssialias?infotype=dd&subtype=ca&&htmlfid=897/ENU S111-091 We suggest that clients load and run their virtualization management software (for example, VMware vCenter) from the same server for optimal utilization of resources. For more information about the IBM x3550 M3 server, see the IBM Installation and User’s Guide for the x3550 M3, which can be found at the following address: http://ibm.com/support/entry/portal/docdisplay?lndocid=MIGR-5083597 IBM BladeCenter Foundation for Cloud: Integration Guide 9
    • The management server has four onboard 1 Gb Ethernet controllers. For redundancy and failover, they are configured as a NIC team. By using Broadcom Advanced Control Suite (BACS) software, two NICs will connect to the customer network, and two NICs will connect to the management network. Figure 4, Figure 5, and Figure 6 on page 11 show the front, top, and side views of the System x3550 M3, respectively. Light path diagnostics panel eject Four hot-swap button Four hot-swap Two USB 2.5 in. bays Video 2.5 in. bays 2.0 ports Pop-out light path or one DVD bay port diagnostics panel with power button and status LEDs Figure 4 System x3550 M3 front view Six hot- USB socket for RAID controller in Processor Hot-swap power swap fans hypervisor dedicated slot sockets supply bays Hot-swap HDD 18 DIMM PCIe slots Ethernet daughter card bays sockets (standard in model DDx) Figure 5 System x3550 M3 top view10 IBM BladeCenter Foundation for Cloud: Integration Guide
    • Ethernet port PCIe slot Video PCIe slot Power supply for IMM port socket Ports for Ethernet Standard Gb Serial USB Hot-swap power daughter card Ethernet ports port ports supply bays (standard in model DDx) Figure 6 System x3550 M3 back viewBladeCenter Foundation for Cloud chassis with converged networking The small, medium and large offerings include one or two configured IBM BladeCenter H chassis at the core. Figure 7 shows a view of the front and rear of a BladeCenter H, which is composed of the following components: Between 4 and 28x HS22V blades, depending on the configuration (small, medium or large) selected 2 x IBM BNT® Virtual Fabric 10 Gb Switch Modules in Bays 7 and 9 (per chassis) 2 x QLogic Virtual Fabric Extension Modules in Bays 3 and 5 (per chassis) 2 x Server Connectivity Modules in bays 1 and 2 (per chassis) 4 x 2980 W high efficiency power supplies 2 x Advanced Management Modules Figure 7 BladeCenter H front and rear views IBM BladeCenter Foundation for Cloud: Integration Guide 11
    • IBM BNT Virtual Fabric 10 Gb Switch Modules and QLogic Virtual Fabric Extension Modules enable converged networking that can easily connect to the clients current LAN and SAN environment without the need of additional top-of-rack hardware. Simply connect LAN infrastructure to the 10 Gb BNT Virtual Fabric Switch Module’s Ethernet ports and SAN infrastructure to the Fibre Channel ports of the Virtual Fabric Extension Module for an optimized solution without rip-and-replace. Server Connectivity Module has been included in the configuration to provide additional 1 Gb ports.BladeCenter Foundation for Cloud HS22V host servers The BladeCenter Foundation for Cloud HS22V has been designed specifically for use in virtualized environments. With 18 DIMM slots supporting up to 288 Gb of DDR3 memory, the HS22V allows you to provision up to 50% more virtual machines, enabling up to three virtual NICs per adapter or larger virtual machines per blade compared to mainstream two-socket blade servers. An embedded hypervisor USB key enables easy deployment of the vSphere Hypervisor virtualization solution. The server will be implemented with a 10 Gb Virtual Fabric Adapter on each blade, enabling up to eight virtual NICs per adapter. All of the management virtual machines and All of the management VMs and compute VMs will be hosted on either the DS3524 storage subsystem or an external SAN attached storage if BladeCenter Foundation for Cloud is being deployed with an existing SAN. Figure 8 shows the location of key components in the BladeCenter Foundation for Cloud HS22V server. More details can be found at the following address: http://ibm.com/systems/bladecenter/hardware/servers/hs22v/ Memory for Processor 2 USB CIOv processor 2 connector connector Two 1.8 inch Processor 1 Memory for CFFh SSDs processor 1 connector Figure 8 Internals of the HS22V blade server12 IBM BladeCenter Foundation for Cloud: Integration Guide
    • This process will be the same for each of the BladeCenter Foundation for Cloud HS22V servers in the small, medium, and large IBM BladeCenter configurations. Each of the HS22V servers will ship in its own packaging and will come pre-installed with processor, memory, and the Virtual Fabric Adapter. For a list of the supported optional modules for each blade or chassis, see the HS22V (7871) Configurations and Options Guide (COG) at the following address: http://ibm.com/systems/xbc/cog/bc_hs22v_7871/bc_hs22v_7871aag.html The BladeCenter Foundation for Cloud HS22V server comes pre-installed with the following components: 2 x E5649 CPUs (six physical cores per processor) 12 x 8 Gb DIMMs 1 x 10 Gb Virtual Fabric Adapter (in CFFh connector) 1 x VMware ESXi 4.1 Update 1 Hypervisor USBIBM System Storage DS3524 IBM has combined best-of-breed development with leading host interface and drive technology in the DS3524, providing a seamless path to consolidated and efficient storage while improving performance, flexibility, scalability, data security, and energy efficiency. The DS3524 is a member of the DS3500 family of storage subsystems. See the DS3500 home page for more information about these products: http://ibm.com/systems/storage/disk/ds3500/ Figure 9 shows the front view of the DS3524 unit. Figure 9 DS3524 storage subsystem The DS3524 has two management Ethernet ports per controller. Use one Ethernet port for daily management of your DS3524 storage subsystem. Reserve the other port for use by service personnel or for subsystem monitoring hardware that might be available in the future. Default IP addresses are provided in initial configuration. The IP addresses must be changed on both controllers A and B. The values are the default IP addresses of the first management Ethernet ports are as follows: Controller A: 192.168.128.101/16 (subnet mask should be specified) Controller B: 192.168.128.102/16 (subnet mask) IBM BladeCenter Foundation for Cloud: Integration Guide 13
    • The default IP addresses of the second management Ethernet ports are as follows: Controller A: 192.168.129.101/16 (subnet mask) Controller B: 192.168.129.102/16 (subnet mask)IBM Power Distribution Units The IBM Power Distribution Unit must be configured to work with power supplies of different countries because it varies by country (such as 110V as opposed to 220V and 50 Hz as opposed to 60Hz). We suggest that you use the IBM rack power configurator for each country where the unit is configured. We also suggest that you use IBM 7176 Ultra Density Enterprise Power Distribution Units for this solution. These units can be tightly integrated with IBM Systems Director Active Energy Manager™, a power management and monitoring component of the IBM Systems Director 6.2 platform. Information on the rack power configurator can be found at the following address: http://ibm.com/systems/xbc/cog/rackpwr/7176ultra_density_enterprise_pdu_us_ca.html Power cables to connect to the PDU will vary depending upon your geography or country-specific needs. Design your solution for redundancy with separate PDU and power sources for each redundant power supply on each particular device.Populating the rack enclosures This section describes the rack requirements for the small, medium, and large configurations and shows where to install each device in the cabinet. There are a number of locations common to all three solutions: The BladeCenter chassis are always mounted at or near the bottom of the cabinet for small and medium configurations and are stacked starting from the bottom of the rack for the large configuration. The Management server is always mounted in location U19. The first System Storage DS3524 is always mounted in U23 and U24. The suggested PDUs and necessary redundant power distribution are mounted elsewhere in the rack (not shown).14 IBM BladeCenter Foundation for Cloud: Integration Guide
    • Racking the small configuration The components required for small configuration are the same as and limited to those listed in “Populating the rack enclosures” on page 14. Observe the following guidelines when installing these components for the small configuration: Always mount the BladeCenter Foundation for Cloud chassis at the bottom of the rack. Always mount the Management server in location U19. Always mount he first System Storage DS3524 in U23 and U24. Install the suggested PDUs and necessary redundant power distribution units elsewhere in the rack (not shown). Figure 10 shows an example of the small configuration. 1 x 42U Rack (shown as an example) 1 x DS3524 Dual Controller with 8 Gbps FC (opt.) 1 x Management Server x3550 M3 preloaded with: * Systems Director 6.2 * Active Energy Manager 4.3 * vSphere Client 4.1 * DS Storage 10.7 1 x BladeCenter Foundation for Cloud chassis preloaded with: * 2 x Virtual Fabric 10 Gb Switch * 2 x Virtual Fabric Extension Module * 2 x Server Connectivity Module BladeCenter H 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * IBM BladeCenter Open Fabric Manager Basic 4 x BladeCenter Foundation for Cloud HS22V preloaded with: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * E5649 6C 2.53 GHz, 12 x 8 GB DIMM * Virtual Fabric Adapter with FCoE & VMware ESXi Figure 10 Small configuration racking IBM BladeCenter Foundation for Cloud: Integration Guide 15
    • Racking the medium configuration Observe the following guidelines when installing these components for the medium configuration: Always mount the BladeCenter Foundation for Cloud chassis at the bottom of the rack. Always mount the Management server in location U19. Always mount he first System Storage DS3524 in U23 and U24. Mount the first System Storage EXP3524 in U25 and 26. Mount the second System Storage EXP3524 in U27 and U28. Mount the third System Storage EXP3524 in U29 and U30. Install the suggested PDUs and necessary redundant power distribution units elsewhere in the rack (not shown). Figure 11 shows an example of the medium configuration. 1 x 42U Rack (shown as an example) 1 2 x DS3524 Dual Controller with 8Gbps FC (opt.) 8 Gbps FC (opt.) * 6 x System Storage EXP3524 3 1 x Management Server x3550 M3 preloaded with: * Systems Director 6.2 * Active Energy Manager 4.3 * vSphere Client 4.1 * DS Storage 10.7 1 x BladeCenter Foundation for Cloud chassis preloaded with: * 2 x Virtual Fabric 10 Gb Switch * 2 x Virtual Fabric Extension Module * 2 x Server Connectivity Module BladeCenter H 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * IBM BladeCenter Open Fabric Manager Basic 14 x BladeCenter Foundation for Cloud HS22V preloaded with: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * E5649 6C 2.53 GHz, 12 x 8 GB DIMM * Virtual Fabric Adapter with FCoE & VMware ESXi Figure 11 Medium configuration racking16 IBM BladeCenter Foundation for Cloud: Integration Guide
    • Racking the large configuration Observe the following guidelines when installing these components for the large configuration: Mount the first BladeCenter Foundation for Cloud chassis in locations U1 and U9. Mount the second BladeCenter Foundation for Cloud chassis in U10 and U18. Mount the Management server in U19. Mount thee System Storage DS3524 in U23 and U24. Mount the second System Storage DS3524 in U31 and U32 Mount the first System Storage EXP3524 in U25 and U26. Mount the second System Storage EXP3524 in U27 and U28. Mount the third System Storage EXP3524 is in U29 and U30. Mount the fourth System Storage EXP3524 in U33 and U34. Mount the fifth System Storage EXP3524 in U35 and U36. Mount the sixth System Storage EXP3524 in U37 and U38. Install the suggested PDUs and necessary redundant power distribution units elsewhere in the rack (not shown). IBM BladeCenter Foundation for Cloud: Integration Guide 17
    • Figure 12 shows an example of a large configuration. 1 x 42U Rack (shown as an example) 2 x DS3524 Dual Controller with 8Gbps FC (opt.) 8 Gbps FC (opt.) * 6 x System Storage EXP3524 1 x Management Server x3550 M3 preloaded with: * Systems Director 6.2 * Active Energy Manager 4.3 * vSphere Client 4.1 BladeCenter H 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * DS Storage 10.7 2 x BladeCenter Foundation for Cloud chassis preloaded with: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * 2 x Virtual Fabric 10 Gb Switch * 2 x Virtual Fabric Extension Module * 2 x Server Connectivity Module BladeCenter H 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * IBM BladeCenter Open Fabric Manager Basic 28 x BladeCenter Foundation for Cloud HS22V preloaded with: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 * E5649 6C 2.53 GHz, 12 x 8 GB DIMM * Virtual Fabric Adapter with FCoE & VMware ESXi Figure 12 Large configuration racking18 IBM BladeCenter Foundation for Cloud: Integration Guide
    • Cabling the BladeCenter Foundation for Cloud This section shows you how to cable the small, medium, and large BladeCenter Foundation for Cloud configurations.Cabling the small and medium configurations Because the number of servers is the only difference between the small and medium configurations, the cabling shown in Figure 13 applies to both. Customer Customer Network Switch Network (10 Gbps Switch Compute) (1 Gbps Mgmt) 10 Gbps Compute Network x3550 M3 Mgmt BNT Virtual Fabric 10 GbE Switch BladeCenter H Module 10 Gbps / FCoE Traffic 7 PS PS 2 1 8 3 4 OK Link 1 Gbps Mgmt TX/RX QLogic Virtual Network HS22V with Emulex IP Fabric 1 5 3 MM 1 1 2-port 10 Gb CNA 2 2 6 4 MM 2 Extension Module 9 10 8 Gbps FC Network 1 2 LNK LNK LNK 4 2 4 2 4 2 4 2 8 8 8 8 1 2 FC FC FC 4 ID/Diag 3 5 6 OK DC AC DC AC OK OK DS3524Figure 13 Small and medium configuration cabling IBM BladeCenter Foundation for Cloud: Integration Guide 19
    • Cabling the large configuration Figure 14 shows the cabling for a large configuration. Customer Customer Network Switches Network (10 Gbps Switch Compute) Patch (1 Gbps Mgmt) Panel x3550 M3 Mgmt 10 Gbps Compute Network BladeCenter H AMM 7 PS PS 2 1 8 3 4 OK BNT Virtual Fabric Link TX /RX 10 GbE Switch 10 Gbps/ Module IP 1 5 3 MM 1 1 FCoE Traffic 2 2 6 4 MM 2 1 Gbps Mgmt Network 9 HS22V with Emulex 10 2-port 10 Gb CNA 7 PS PS 2 1 8 3 4 QLogic Virtual OK L ink TX/RX Fabric Extension Module 1 5 1 3 MM 1 IP 8 Gbps FC 2 2 6 4 MM 2 Network 9 10 1 2 LNK LNK 1 2 LNK LNK LNK LNK 4 2 4 2 4 2 4 4 2 4 2 4 2 4 2 8 8 8 8 2 8 8 8 8 1 2 1 2 FC FC FC FC FC FC 4 4 ID/Diag 3 5 6 ID/Diag 3 5 6 OK OK DS3524 DC OK AC DC OK ACFigure 14 Large configuration cablingUpdating the hardware and firmware drivers Hardware and firmware drivers for the BladeCenter Foundation for Cloud solution should be updated prior to taking any other action. In order to update the device drivers, an FTP or TFTP server is required with network access to the Advanced Management Module (AMM) or the Management network on each device. In order to update devices using the network, each device must have a valid IP address and be reachable from end to end by ping, HTTP, FTP, or TFTP, depending upon the update method. A unique IBM ToolsCenter bootable CD/DVD can be created to update the firmware for most of the components for System x® and BladeCenter servers. The ToolsCenter Creation tools can be found at the following address: http://ibm.com/support/entry/portal/docdisplay?lndocid=TOOL-CENTER20 IBM BladeCenter Foundation for Cloud: Integration Guide
    • Table 4 shows the supported components of the BladeCenter Foundation for Cloud. If you deviate from the suggestion outlined in the table, you might have unexpected results. The firmware levels in Table 4 can be used for small, medium, and large BladeCenter Foundation for Cloud configurations (current as of August 2011).Table 4 Firmware levels Product Firmware Version Management x3550 M3 UEFI v1.09 Server IMM v1.22 QLogic 8 GB FC v2.24 ServeRAID M5015 v12.12.0-0047 Windows drivers Broadcom NetXtreme II v5.2.17.0c QLogic StorPort driver v9.1.8.25 ServeRAID M5015 v4.17.2 Broadcom NetXtreme v2.1.5a update Chassis / BladeCenter AMM Firmware v3.62c Networking switches IBM BNT 10-Port 10 Gb Virtual BladeOS (TFTP server v6.7.1.0 Fabric required) Detailed instructions can be found at: ftp://ftp.software.ibm.co m/systems/support/system_ x_pdf/46m1525.pdf and: http://www.bladenetwork.n et/IBM-BladeCenter-suppor t.html Server Connectivity Module v1.1.3.0 QLogic Virtual Fabric Extension v9.0.3.02 Module Blade server BladeCenter HS22V UEFI v1.14 IMM v1.28 DSA v3.46 Virtual Fabric Advanced II adapter Emulex Release 2.3 OCM 5.1.42-12 IBM BladeCenter Foundation for Cloud: Integration Guide 21
    • Additional References IBM BladeCenter Foundation for Cloud home page http://ibm.com/systems/bladecenter/solutions/infrastructure/virtualization/inte gratedcloudplatform/ BladeCenter H: http://ibm.com/support/fixcentral/systemx/selectFixes BladeCenter HS22V firmware updates: http://ibm.com/support/fixcentral/systemx/selectFixes#Network Announcement Letter, IBM BladeCenter Foundation for Cloud models http://ibm.com/common/ssi/cgi-bin/ssialias?infotype=dd&subtype=ca&&htmlfid=897/ ENUS111-156 Announcement Letter, IBM BladeCenter Foundation for Cloud Chassis http://ibm.com/common/ssi/cgi-bin/ssialias?infotype=dd&subtype=ca&&htmlfid=897/ ENUS111-15822 IBM BladeCenter Foundation for Cloud: Integration Guide
    • Appendix A. Small configuration parts catalog Table 5 contains the parts catalog for an IBM BladeCenter Foundation for Cloud small configuration.Table 5 Small parts configuration catalog Part # Description Quantity Management server 7944-DDx Director 6.2, AEM 4.3, vSphere Client 4.1, DS Storage Manager 10.7 1 Chassis / Networking (1 chassis) 88524Tx IBM BladeCenter H 1 68Y6601 IBM BladeCenter H 2980 W AC Power Modules w/Fan Pack 1 2019A1X IBM BladeCenter Advanced Management Module 1 46M0902 IBM UltraSlim Enhanced SATA Multi-Burner 1 46C7191 BNT Virtual Fabric 10 Gb Switch Module for IBM BladeCenter 2 39Y9324 Server Connectivity Module for IBM BladeCenter 2 46M6172 QLogic Virtual Fabric Extension Module for IBM BladeCenter 2 44X1964 IBM 8 Gb SFP+ SW Optic Transceiver 4 44W4408 10 GbE 850 nm Fiber SFP+ Transceiver (SR) for IBM BladeCenter 8 2019B1X IBM BladeCenter Open Fabric Manager 1 Blade Server (4 servers) 7871B6x IBM BladeCenter HS22V 4 8 GB (1 x 8 GB, 2Rx4, 1.35 V) PC3L-10600 CL9 ECC DDR3 1333 MHz VLP 46C0568 48 RDIMM 81Y6042 Addl Intel Xeon Processor E5649 6C 2.53 GHz 12 MB Cache 1333 MHz 80w 4 90Y3566 Emulex 10 GbE Virtual Fabric Adapter Advanced II - IBM BladeCenter 4 41Y8296 IBM USB Memory Key for VMware ESXi 4.1 Update 1 4 95Y1111 IBM Sys Dir Std Ed for IBM x86, V6.x, Per Mgd Svr with 1 Year SW S&S 4 IBM BladeCenter Foundation for Cloud: Integration Guide 23
    • Appendix B. Medium configuration parts catalog Table 6 contains the parts catalog for an IBM BladeCenter Foundation for Cloud medium configuration.Table 6 Medium!parts configuration catalog Part # Description Quantity Management Server 7944-DDx Director 6.2, AEM 4.3, vSphere Client 4.1, DS Storage Manager 10.7 1 Chassis / Networking (1 chassis) 88524Tx IBM BladeCenter H 1 68Y6601 IBM BladeCenter H 2980 W AC Power Modules w/Fan Pack 1 2019A1X IBM BladeCenter Advanced Management Module 1 46M0902 IBM UltraSlim Enhanced SATA Multi-Burner 1 46C7191 BNT Virtual Fabric 10 Gb Switch Module for IBM BladeCenter 2 39Y9324 Server Connectivity Module for IBM BladeCenter 2 46M6172 QLogic Virtual Fabric Extension Module for IBM BladeCenter 2 44X1964 IBM 8 Gb SFP+ SW Optic Transceiver 4 44W4408 10 GbE 850 nm Fiber SFP+ Transceiver (SR) for IBM BladeCenter 8 2019B1X IBM BladeCenter Open Fabric Manager 1 Blade Server (14 servers) 7871B6x IBM BladeCenter HS22V 14 8 GB (1 x 8 GB, 2Rx4, 1.35 V) PC3L-10600 CL9 ECC DDR3 1333 MHz VLP 46C0568 168 RDIMM 81Y6042 Addl Intel Xeon Processor E5649 6C 2.53 GHz 12 MB Cache 1333 MHz 80w 14 90Y3566 Emulex 10 GbE Virtual Fabric Adapter Advanced II - IBM BladeCenter 14 41Y8296 IBM USB Memory Key for VMware ESXi 4.1 Update 1 14 95Y1111 IBM Sys Dir Std Ed for IBM x86, V6.x, Per Mgd Svr with 1 Year SW S&S 1424 IBM BladeCenter Foundation for Cloud: Integration Guide
    • Appendix C. Large configuration parts catalog Table 7 contains the parts catalog for an IBM BladeCenter Foundation for Cloud large configuration.Table 7 Large parts configuration catalog Part # Description Quantity Management Server 7944-DDx Director 6.2, AEM 4.3, vSphere Client 4.1, DS Storage Manager 10.7 1 Chassis / Networking (2 chassis) 88524Tx IBM BladeCenter H 2 68Y6601 IBM BladeCenter H 2980 W AC Power Modules w/Fan Pack 2 2019A1X IBM BladeCenter Advanced Management Module 2 46M0902 IBM UltraSlim Enhanced SATA Multi-Burner 2 46C7191 BNT Virtual Fabric 10 Gb Switch Module for IBM BladeCenter 4 39Y9324 Server Connectivity Module for IBM BladeCenter 4 46M6172 QLogic Virtual Fabric Extension Module for IBM BladeCenter 4 44X1964 IBM 8 Gb SFP+ SW Optic Transceiver 8 44W4408 10 GbE 850 nm Fiber SFP+ Transceiver (SR) for IBM BladeCenter 16 2019B1X IBM BladeCenter Open Fabric Manager 2 Blade Server (28 servers) 7871B6x IBM BladeCenter HS22V 28 8 GB (1 x 8 GB, 2Rx4, 1.35 V) PC3L-10600 CL9 ECC DDR3 1333 MHz VLP 46C0568 336 RDIMM 81Y6042 Addl Intel Xeon Processor E5649 6C 2.53 GHz 12 MB Cache 1333 MHz 80w 28 90Y3566 Emulex 10 GbE Virtual Fabric Adapter Advanced II - IBM BladeCenter 28 41Y8296 IBM USB Memory Key for VMware ESXi 4.1 Update 1 28 95Y1111 IBM Sys Dir Std Ed for IBM x86, V6.x, Per Mgd Svr with 1 Year SW S&S 28 IBM BladeCenter Foundation for Cloud: Integration Guide 25
    • The author who wrote this paper Stephen Smith is a Senior Technical Writer at the IBM ITSO, Raleigh Center. His background in IT technical writing extends over 25 years, during which he authored over 100 publications covering a wide assortment of technologies, most notably IBM products and services. Thanks to the following people for their contributions to this project: David Watts Harsh Kachhy David Tareen Laura RobinsonNow you can become a published author, too! Here’s an opportunity to spotlight your skills, grow your career, and become a published author—all at the same time! Join an ITSO residency project and help write a book in your area of expertise while honing your experience using leading-edge technologies. Your efforts will help to increase product acceptance and customer satisfaction as you expand your network of technical contacts and relationships. Residencies run from two to six weeks in length, and you can participate either in person or as a remote resident working from your home base. Learn more about the residency program, browse the residency index, and apply online at: ibm.com/redbooks/residencies.htmlStay connected to IBM Redbooks Find us on Facebook: http://www.facebook.com/IBMRedbooks Follow us on Twitter: http://twitter.com/ibmredbooks Look for us on LinkedIn: http://www.linkedin.com/groups?home=&gid=2130806 Explore new Redbooks® publications, residencies, and workshops with the IBM Redbooks weekly newsletter: https://www.redbooks.ibm.com/Redbooks.nsf/subscribe?OpenForm Stay current on recent Redbooks publications with RSS Feeds: http://www.redbooks.ibm.com/rss.html26 IBM BladeCenter Foundation for Cloud: Integration Guide
    • NoticesThis information was developed for products and services offered in the U.S.A.IBM may not offer the products, services, or features discussed in this document in other countries. Consultyour local IBM representative for information on the products and services currently available in your area. Anyreference to an IBM product, program, or service is not intended to state or imply that only that IBM product,program, or service may be used. Any functionally equivalent product, program, or service that does notinfringe any IBM intellectual property right may be used instead. However, it is the users responsibility toevaluate and verify the operation of any non-IBM product, program, or service.IBM may have patents or pending patent applications covering subject matter described in this document. Thefurnishing of this document does not give you any license to these patents. You can send license inquiries, inwriting, to:IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A.The following paragraph does not apply to the United Kingdom or any other country where suchprovisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATIONPROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS ORIMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT,MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer ofexpress or implied warranties in certain transactions, therefore, this statement may not apply to you.This information could include technical inaccuracies or typographical errors. Changes are periodically madeto the information herein; these changes will be incorporated in new editions of the publication. IBM may makeimprovements and/or changes in the product(s) and/or the program(s) described in this publication at any timewithout notice.Any references in this information to non-IBM websites are provided for convenience only and do not in anymanner serve as an endorsement of those websites. The materials at those websites are not part of thematerials for this IBM product and use of those websites is at your own risk.IBM may use or distribute any of the information you supply in any way it believes appropriate without incurringany obligation to you.Information concerning non-IBM products was obtained from the suppliers of those products, their publishedannouncements or other publicly available sources. IBM has not tested those products and cannot confirm theaccuracy of performance, compatibility or any other claims related to non-IBM products. Questions on thecapabilities of non-IBM products should be addressed to the suppliers of those products.This information contains examples of data and reports used in daily business operations. To illustrate themas completely as possible, the examples include the names of individuals, companies, brands, and products.All of these names are fictitious and any similarity to the names and addresses used by an actual businessenterprise is entirely coincidental.COPYRIGHT LICENSE:This information contains sample application programs in source language, which illustrate programmingtechniques on various operating platforms. You may copy, modify, and distribute these sample programs inany form without payment to IBM, for the purposes of developing, using, marketing or distributing applicationprograms conforming to the application programming interface for the operating platform for which the sampleprograms are written. These examples have not been thoroughly tested under all conditions. IBM, therefore,cannot guarantee or imply reliability, serviceability, or function of these programs.© Copyright International Business Machines Corporation 2011. All rights reserved.Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted byGSA ADP Schedule Contract with IBM Corp. 27
    • This document REDP-4773-00 was created or updated on September 1, 2011.Send us your comments in one of the following ways: ® Use the online Contact us review Redbooks form found at: ibm.com/redbooks Send your comments in an email to: redbooks@us.ibm.com Mail your comments to: IBM Corporation, International Technical Support Organization Dept. HYTD Mail Station P099 2455 South Road Poughkeepsie, NY 12601-5400 U.S.A. Redpaper ™TrademarksIBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business MachinesCorporation in the United States, other countries, or both. These and other IBM trademarked terms aremarked on their first occurrence in this information with the appropriate symbol (® or ™), indicating USregistered or common law trademarks owned by IBM at the time this information was published. Suchtrademarks may also be registered or common law trademarks in other countries. A current list of IBMtrademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtmlThe following terms are trademarks of the International Business Machines Corporation in the United States,other countries, or both: BladeCenter® IBM® System Storage® IBM Systems Director Active Energy Redbooks® System x® Manager™ Redbooks (logo) ®The following terms are trademarks of other companies:BNT, and Server Mobility are trademarks or registered trademarks of Blade Network Technologies, Inc., anIBM Company.Intel Xeon, Intel, Intel logo, Intel Inside logo, and Intel Centrino logo are trademarks or registered trademarksof Intel Corporation or its subsidiaries in the United States and other countries.Windows, and the Windows logo are trademarks of Microsoft Corporation in the United States, othercountries, or both.Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, IntelSpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or itssubsidiaries in the United States and other countries.Other company, product, or service names may be trademarks or service marks of others.28 IBM BladeCenter Foundation for Cloud: Integration Guide