Deploying software FCoE in vSphere 5


Published on

Deploying software FCoE in vSphere 5 on Cisco Nexus 5000 and 10Gb Intel Ethernet CNAs


Comments are closed

  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide
  • Network Admins Now have to Expand Their Knowledge To Include StorageUnified Networking enables cost-effective connectivity to the LAN and the SAN on the same Ethernet fabric; customers can use NFS, iSCSI, or Fibre Channel over Ethernet (FCoE) to carry storage traffic over Ethernet. These solutions simplify the data center by reducing equipment needs and costsIntel’s Unified Networking solutions are enabled through a combination of standard Intel® Ethernet products along with trusted network protocols integrated in the Operating systems. Thus, Unified Networking is available with our Ethernet switching products, as well as on every Server either through LAN-on-Motherboard (LOM) implementation or via an add-in Network Interface Card (NIC) or Converged Network Adapter (CNA).Unlike other 10GbE vendors, Intel has delivered high quality Ethernet products for over 30 years and our Unified Networking solutions are built on the same founding principles that made us successful in Ethernet.iSCSI simplifies SAN connectivityiSCSI uses Ethernet to carry storage traffic, extending the familiarity and simplicity of Ethernet to storage networking, without the need for SAN-specific adapters or switches. Intel® Ethernet Server Adapters are the easiest, most reliable, and most cost-effective way of connecting servers to iSCSI SANs.Open FCoE consolidates LANs and legacy SANsIntel’s Open FCoE solution enables Intel® Ethernet 10 Gigabit Server products (LOM or NICs) to support Fibre Channel payload encapsulated in Ethernet frames. There is no upgrade charge for Open FCoE. Just as iSCSI, now customers can easily connect to an FCoE network with Intel 10GbE solutions (82599 and X540 based).Unified Networking BenefitsSeamless integration with OS and hypervisor vendors providing broad ecosystem supportScalable solution with intelligent storage hardware offloads offering the best price / performance solutionEvery server with a Intel® 82599 Ethernet Controller ships with a high performance iSCSI & FCoE solutionValidation across the industry, including OS vendors and storage vendorsWorld class iSCSI and FCoE performance with native OS initiators and intelligent CPU and Networking hardware offloadsPlugs into existing management toolsLow power and low cost
  • vSphere 4.0 introduced support for hardware Fibre Channel over Ethernet (FCoE) adaptors. vSphere 5.0 will take the adoption of FCoE to a new level by introducing a software FCoE adaptor. The software FCoE adaptor will require a network adaptor that can support partial FCoE offload capabilities before it can be enabled. After the software FCoE adaptor has been enabled, a new adaptor is created. After the creation of the adapter, devices that are presented to this particular adapter will be recognized by vSphere, enabling the creation of a new datastore. The software FCoE adapter will enable you to use FCoE capabilities without the need to resort to specific FCoE hardware adapters, creating a more agile and flexible infrastructure.A software FCoE adapter uses the native FCoE protocol stack in ESXi for the protocol processing. The software FCoE adapter is used with a NIC that offers Data Center Bridging (DCB) and I/O offload capabilities. For information on NICs supporting software FCoE, see the vSphere Compatibility Guide.Before you activate the software FCoE adapters, you need to connect the VMkernelto physical FCoE NICs installed on your host.FCoE is really two different protocols:FIP (FCoE initiation protocol)It is the control plane protocolIt is used to discover the FC entities connected to an Ethernet cloudIt is used to login to and logout from the FC fabricFCoEIs the data plane protocolIt is used to carry most of the FC frames and all the SCSI trafficConfiguration Guidelines for Software FCoEWhen setting up your network environment to work with ESXi software FCoE, follow the guidelines and best practices that VMware offers.Network Switch GuidelinesFollow these guidelines when you configure a network switch for software FCoE environment:On the ports that communicate with your ESXi host, disable the Spanning Tree Protocol (STP). Having the STP enabled might delay the FCoE Initialization Protocol (FIP) response at the switch and cause an all paths down (APD) condition. The FIP is a protocol that FCoE uses to discover and initialize FCoE entities on the Ethernet.Turn on Priority-based Flow Control (PFC) and set it to AUTO.VMware recommends that you use the following firmware on the FCoE switch:Cisco Nexus 5000: version 4.1(3)N2 or higher.Brocade FCoE switch: version 6.3.1 or higher.
  • Deploying software FCoE in vSphere 5

    1. 1. Deploying software FCoE in vSphere 5 on Cisco Nexus 5000 and 10Gb Intel Ethernet CNAs Brian Johnson Intel Corporation October 20121
    2. 2. Unified Networking with LAN and Storage over 10 Gigabit Ethernet (10GbE) Discrete Networking and Storage Unified Networking Provides a Infrastructures Common Ethernet Fabric Compute Storage Storage Network Ethernet with Open FCoE LAN Network Fibre Channel Compute Networking Ethernet Storage Trend1: Spending on Ethernet-based storage, which includes NAS, iSCSI SAN, and Fibre Channel over Ethernet (FCoE), will surpass spending on FC SAN storage by 2015 Business Benefits2: Reduced IT costs through management automation and infrastructure simplification with industry standard components to converge network and storage resources 1. Worldwide Enterprise Storage Systems 2012–2016 Forecast2 ● Smart Clouds Start With Intel Inside® ● VMworld2012 2. Intel IT Using Converged Network Adapters for FCoE Network Unification Feb 2012
    3. 3. Intel® Ethernet Converged Network Adapters Flexibility with a balance between hardware performance and software extensibility Native Software Open FCoE Initiator in VMware* vSphere* 5.1 Optimized Drivers & Initiators Open FCoE  iSCSI  NAS Intelligent Use of Offloads Performance  Scalability Open Industry Standards Flexibility  Interoperability Flexible Deployment Options Standard PCI Express* Custom PCI Express LAN-on-Motherboard (LOM) Converged Network Adapters Converged Network Adapters3 ● Smart Clouds Start With Intel Inside® ● VMworld2012
    4. 4. Intel® Ethernet FCoE Adapter Configuration1 Use VMware* vSphere* Client to configure Intel® Ethernet FCoE adapters 1. Setup Physical Network switch ports for DCB and FCoE support –- The switch configures DCB on the Intel® Ethernet Converged Network Adapter X520 FCoE adapter, so proper network and switch is required prior to activating the adapter. 2. Set Up Networking for FCoE -- Connect the VMkernel to Uplink Ports that will be used for FCoE for FIP (FCoE initiation protocol) to communicate with the switch using LLDP to setup DCB on the Intel Ethernet FCoE adapter 3. Activate Software FCoE Adapters –- Up to four software FCoE adapters per host 4. Intel Ethernet FCoE Adapters are now enabled and ready to use 1Intel® Ethernet FCoE Adapters are supported on and the Intel® Ethernet Converged Network Adapter X520 and X5404 ● Smart Clouds Start With Intel Inside® ● VMworld2012
    5. 5. FCoE and LACP Configuration FABRIC A FABRIC B Port Channel 1 FCoE VLAN 20 FCoE VLAN 21 VPC Domain and Peer Links Interface Port Channel 5 No FC or FCoE VLANs Permitted Interface Port Channel 5 Port Channel 1 Config Both Switches: Port Channel 5 Config Switch 1: switchport mode trunk Port Channel 5 Config Switch 2: switchport mode trunk switchport trunk allowed vlan 1,120,140 switchport mode trunk switchport trunk allowed 1,20,120,140 vpc peer-link switchport trunk allowed 1,21,120,140 spanning tree port type edge trunk spanning tree port type edge trunk vpc 5 vpc 5 Virtual Fibre Channel Interface (VFC) 5: Virtual Fibre Channel Interface (VFC) 5: bind interface po 5 bind interface po 5 no shut no shut LACP (802.3AD) Team Server 1 Add Second vDs for vDS1 vDS2 more FCoE Uplinks VMware* ESXi 5.1 Only Two Uplinks per vDs for FCoE when using LACP5 ● Smart Clouds Start With Intel Inside® ● VMworld2012
    6. 6. 10Gb Intel® Ethernet CNAs Simplify Unify Amplify Intel® Ethernet Converged Optimized Drivers & Intel® Xeon® processor E5 Network Adapters Initiators Up to Up to Up to 80% 20% 2x Reduction Lower Improved Total infrastructure costs2 in network cables and I/O bandwidth using Intel® vs separate data and switch ports1 Xeon® processor E5 Family3 storage networksSoftware and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark* and MobileMark* are measured using specific computersystems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating yourcontemplated purchases, including the performance of that product when combined with other products. For more information go to 1. Intel 10GbE ROI Calculator. See back up foil “IT Savings with Unified Network“ for more details.6 ● Smart Clouds Start With Intel Inside® ● VMworld2012 2. Intel IT Proof of Concept with 10GbE and FCoE. See back up foil “IT Savings with Unified Network“ for more details. 3. Max. I/O R/W bandwidth Intel® Xeon® E5-2680 vs. Intel® Xeon® X5670. See backup slide “Xeon® Processor Performance Leadership Claims” for details
    7. 7. Q&A7 ● Smart Clouds Start With Intel Inside® ● VMworld2012
    8. 8. Learn More! Visit: Follow Us On Twitter: @IntelITS, @thehevy Facebook: Intel Server RoomOther brands and names are the property of their respective owners.8 ● Smart Clouds Start With Intel Inside® ● VMworld2012
    9. 9. Legal Disclaimer• INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTELS TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.• UNLESS OTHERWISE AGREED IN WRITING BY INTEL, THE INTEL PRODUCTS ARE NOT DESIGNED NOR INTENDED FOR ANY APPLICATION IN WHICH THE FAILURE OF THE INTEL PRODUCT COULD CREATE A SITUATION WHERE PERSONAL INJURY OR DEATH MAY OCCUR.• Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any features or instructions marked "reserved" or "undefined". Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information.• The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published specifications. Current characterized errata are available on request.• Contact your local Intel sales office or your distributor to obtain the latest specifications and before placing your product order.• Copies of documents which have an order number and are referenced in this document, or other Intel literature, may be obtained by calling 1-800-548-4725, or go to:• Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark* and MobileMark*, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products.• Intel processor numbers are not a measure of performance. Processor numbers differentiate features within each processor family, not across different processor families. Go to:• Intel product plans in this presentation do not constitute Intel plan of record product roadmaps. Please contact your Intel representative to obtain Intels current plan of record product roadmaps.• Intel® Virtualization Technology requires a computer system with an enabled Intel® processor, BIOS, virtual machine monitor (VMM). Functionality, performance or other benefits will vary depending on hardware and software configurations. Software applications may not be compatible with all operating systems. Consult your PC manufacturer. For more information, visit• Intel, Sponsors of Tomorrow. and the Intel logo are trademarks of Intel Corporation in the United States and other countries.• *Other names and brands may be claimed as the property of others.• Copyright ©2011 Intel Corporation.10 ● Smart Clouds Start With Intel Inside® ● VMworld2012
    10. 10. Risk Factors The above statements and any others in this document that refer to plans and expectations for the first quarter, the year and the future are forward-looking statements that involve a number of risks and uncertainties. Many factors could affect Intel’s actual results, and variances from Intel’s current expectations regarding such factors could cause actual results to differ materially from those expressed in these forward-looking statements. Intel presently considers the following to be the important factors that could cause actual results to differ materially from the corporation’s expectations. Demand could be different from Intels expectations due to factors including changes in business and economic conditions; customer acceptance of Intel’s and competitors’ products; changes in customer order patterns including order cancellations; and changes in the level of inventory at customers. Intel operates in intensely competitive industries that are characterized by a high percentage of costs that are fixed or difficult to reduce in the short term and product demand that is highly variable and difficult to forecast. Revenue and the gross margin percentage are affected by the timing of Intel product introductions and the demand for and market acceptance of Intels products; actions taken by Intels competitors, including product offerings and introductions, marketing programs and pricing pressures and Intel’s response to such actions; and Intel’s ability to respond quickly to technological developments and to incorporate new features into its products. The gross margin percentage could vary significantly from expectations based on capacity utilization; variations in inventory valuation, including variations related to the timing of qualifying products for sale; changes in revenue levels; product mix and pricing; the timing and execution of the manufacturing ramp and associated costs; start-up costs; excess or obsolete inventory; changes in unit costs; defects or disruptions in the supply of materials or resources; product manufacturing quality/yields; and impairments of long- lived assets, including manufacturing, assembly/test and intangible assets. Expenses, particularly certain marketing and compensation expenses, as well as restructuring and asset impairment charges, vary depending on the level of demand for Intels products and the level of revenue and profits. The majority of Intel’s non-marketable equity investment portfolio balance is concentrated in companies in the flash memory market segment, and declines in this market segment or changes in management’s plans with respect to Intel’s investments in this market segment could result in significant impairment charges, impacting restructuring charges as well as gains/losses on equity investments and interest and other. Intels results could be impacted by adverse economic, social, political and physical/infrastructure conditions in countries where Intel, its customers or its suppliers operate, including military conflict and other security risks, natural disasters, infrastructure disruptions, health concerns and fluctuations in currency exchange rates. Intel’s results could be affected by the timing of closing of acquisitions and divestitures. Intels results could be affected by adverse effects associated with product defects and errata (deviations from published specifications), and by litigation or regulatory matters involving intellectual property, stockholder, consumer, antitrust and other issues, such as the litigation and regulatory matters described in Intels SEC reports. An unfavorable ruling could include monetary damages or an injunction prohibiting us from manufacturing or selling one or more products, precluding particular business practices, impacting Intel’s ability to design its products, or requiring other remedies such as compulsory licensing of intellectual property. A detailed discussion of these and other factors that could affect Intel’s results is included in Intel’s SEC filings, including the report on Form 10-Q for the quarter ended September 25, 2010. Rev. 1/13/1111 ● Smart Clouds Start With Intel Inside® ● VMworld2012