Copyright © 2012 Solarflare Communications, Slide 1March 20th, 2012OPEN CLOUD INFRASTRUCTURE BUILT ONRED HAT TECHNOLOGIESB...
Copyright © 2012 Solarflare Communications, Slide 2March 20th, 2012Network Hardware Choices Matter: KVM Support• Clouds an...
Copyright © 2012 Solarflare Communications, Slide 3March 20th, 2012Introducing Solarflare• High-performance, low-latency10...
Copyright © 2012 Solarflare Communications, Slide 4March 20th, 2012Broad Platform Support for Linux and OpenSource• High p...
Copyright © 2012 Solarflare Communications, Slide 5March 20th, 2012OpenStack and Cloud Computing• Cloud Networking– Virtua...
Copyright © 2012 Solarflare Communications, Slide 6March 20th, 2012Slide 6 of 9 | PROPRIETARY AND CONFIDENTIALSR-IOV for V...
Copyright © 2012 Solarflare Communications, Slide 7March 20th, 20122.79 3.365.88.1510.116.69.317.4 18.39.3216.833.40510152...
Copyright © 2012 Solarflare Communications, Slide 8March 20th, 2012• Solarflare achieved the three best SPECvirt_sc2010 re...
Copyright © 2012 Solarflare Communications, Slide 9March 20th, 2012Solarflare and Red Hat• Out-of-Box Accelerated Networki...
Copyright © 2012 Solarflare Communications, Slide 10March 20th, 2012Summary and Conclusions• Clouds and OpenStack promise ...
Copyright © 2012 Solarflare Communications, Slide 11March 20th, 2012BACKUP SLIDES
Copyright © 2012 Solarflare Communications, Slide 12March 20th, 2012VMVMNICVM VM VMdriverTCP/IPdriverTCP/IPdriverTCP/IPdri...
Upcoming SlideShare
Loading in...5
×

Redhat summit b tolleyv7

520

Published on

Maximizing Cloud Performance with Redhat KVM and SR-IOV

Published in: Technology, News & Politics
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
520
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
27
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide
  • High performance, low-latency < 7uS 1⁄2 RTT UDP latencyBidirectional line rate, both ports (40G) with < 20% CPU load – Stateless offloads (TSO, LRO, RSS)Performance scales with multiple CPU coresFull integration into Linux kernelDriver “intree” (kernel.org)Wide distribution and kernel supportIntegration with ethtool, MTD, hwmon (sensors)Actively improving Linux networkingSolarflare is the maintainer of “ethtool”Linux kernel RFS offload in hardware (w/Google)Multiple OpenSource and FreeBSD productsWe also do Windows and Solaris
  • Manage and configure LANs and IPFlat, Flat DHCP, VLAN DHCP, IPv6Programmatically allocate IPs and VLANsfor rapid provisioning of network capabilities and security featuresFloating IP addressesAbility to assign (and re-assign) IP addresses to VMsSecurity GroupsFlexibility to assign and control access to VM instances by creating separation between resource pools Role based access control (RBAC)Set up security by user, role, and project
  • TRADITIONALHypervisor emulates network hardwareFlexible!But, performance is poorLimits the workloads that can be virtualizedUses CPU cyclesTYPICAL with SR IOVNetwork driver binds directly to the PCIe VFNear native networking performanceBut, no longer virtualNo migrationPLUG INMaintains traditional software pathPlus VF pathNear native performanceKeep full virtualization features (e.g. migration)RSS within guest VMs127 VFs, 1024 VNICs
  • 1:30:Solarflare’s unique approach to SR-IOV combines the benefits of accelerated cut-through performance while maintaining full compatibility with hypervisor-based services and management tools. In addition to improved performance and superior manageability, Solarflare adapters scale up to 254 VFs, each of which can support multiple DMA channels (up to a total of 2048), providing far more scalable workload consolidation for large data center environments and virtual desktop (VDI) deployments than is otherwise available from competitive products. To further improve performance, Solarflare adapters utilize the available DMA channels within a VF to support Receive Side Scaling (RSS) for guest VMs, spreading VM workloads across many CPU cores enabling performance to scale with the number of CPU cores.This chart illustrates the dramatic performance difference between SR-IOV and hypervisor-based I/O. The data taken for uni-directional traffic and bi-directional traffic for both single-port and dual-port server adapters. The setup consisted of two back to back physical hosts with 4 VMs each, and performance data was taken for single-VM and quad-VM operation.The red bars illustrate Solarflare’s benchmark results demonstrate that with SR-IOV performance increases to near line-rate, as the red bars approach the 10Gbps, 20Gbps and 40Gbps I/O performance levels. This represents up to a 5x performance improvement with SR-IOV. In all cases, except one Solarflare SR-IOV benchmarks at near line rate performance. The one exception is for a single VM which cannot generate enough bandwidth.Thank you for listening to how you can increase your KVM I/O performance and scalability, while simplifying your SR-IOV configuration and management for VM migration.And now I would like to return you to our moderator Richio Aikawa. Richio…
  • Transcript of "Redhat summit b tolleyv7"

    1. 1. Copyright © 2012 Solarflare Communications, Slide 1March 20th, 2012OPEN CLOUD INFRASTRUCTURE BUILT ONRED HAT TECHNOLOGIESBruce Tolley, PhDOptimizing Server I/O For OpenStack: Platform Hardware ChoicesMatter!13 June 2013
    2. 2. Copyright © 2012 Solarflare Communications, Slide 2March 20th, 2012Network Hardware Choices Matter: KVM Support• Clouds and OpenStack promise the evolution of IT– Flexibility, automation, scale of compute, storage and networking• Server Virtualization in general enables the commoditization ofhardware, use of industry standard servers. The end of vendor lockin(?)• Need hardware support for KVM in the network interface software andhardware (NIC)– performance to deliver SLAs and QOS with a Cloud• Hypervisor bypass to eliminate bottlenecks• Plug-in architecture to support both app acceleration and hypervisorservices (e.g. migration)
    3. 3. Copyright © 2012 Solarflare Communications, Slide 3March 20th, 2012Introducing Solarflare• High-performance, low-latency10GbE server adapters• Power the networks at all thebanks and exchanges• Out of the box support: Red HatEnterprise Linux with KVM, RedHat Enterprise Virtualization forServers and Desktop• Partner with Arista, Azul, Cisco,Fusion-io, Juniper, Red Hat,Vmware• OEM with IBM and HP• Over 700 customers worldwide• OpenStack Partner
    4. 4. Copyright © 2012 Solarflare Communications, Slide 4March 20th, 2012Broad Platform Support for Linux and OpenSource• High performance, low-latency– < 7uS 1⁄2 RTT UDP latency• Full integration into Linux kernel• Actively improving Linux networking– Solarflare is the maintainer of “ethtool”– Linux kernel RFS offload in hardware (w/Google)• Multiple OpenSource and FreeBSD products• We also do Windows, Vmware, and Solaris
    5. 5. Copyright © 2012 Solarflare Communications, Slide 5March 20th, 2012OpenStack and Cloud Computing• Cloud Networking– Virtualization, democratization, scalability,– Commoditization of infrastructure• Programmable network features– LANs, IP addresses,VLANs– Security Groups, Role based access control(RBAC)• Need network interfaces hardware andsoftware(NICs) to support KVM• Near Bare metal performance  SLAs and QoSover Cloud infrastructure
    6. 6. Copyright © 2012 Solarflare Communications, Slide 6March 20th, 2012Slide 6 of 9 | PROPRIETARY AND CONFIDENTIALSR-IOV for Virtual Operating Systems (KVM)Solarflare HybridSR-IOV ModelTypical SR-IOVImplementationTraditional Virtualization(no SR-IOV)Full hypervisor-based servicesand management, but poornetwork performanceImproved performance, but lossof hypervisor-based servicesand management (eg, livemigration)Improved performance AND fullhypervisor-based services andmanagement
    7. 7. Copyright © 2012 Solarflare Communications, Slide 7March 20th, 20122.79 3.365.88.1510.116.69.317.4 18.39.3216.833.40510152025303540I/OPerformance(Gbps)SolarflareHybrid SR-IOV PerformanceAdvantageNo SR-IOVWith SR-IOV05101520253035401 VM 4 VMsNo SR-IOVWith SR-IOVBare Metal Performance for Guest ApplicationsTraffic Unidirectional Bi-directional Bi-directional Unidirectional Bi-directional Bi-directional10GbE ports 1 1 2 1 1 2* Solarflare test results• Solarflare scales and delivers near line-rate performance
    8. 8. Copyright © 2012 Solarflare Communications, Slide 8March 20th, 2012• Solarflare achieved the three best SPECvirt_sc2010 results for 2, 4, 8processor configurations• Industry-leading SPECvirt_sc2010 scores achieved with Red HatEnterprise Linux (RHEL) using KVM and Solarflare AdaptersFuture Proof for the Highest VM DensitySPECvirt Benchmarks2352 24424603 468274248956010002000300040005000600070008000900010000RHEL 6.2 (KVM)Intel x520RHEV 3 (KVM)SolarflareRHEL 6.1 (KVM)Intel x520RHEL 6.1 (KVM)SolarflareRHEL 6.1 (KVM)Intel x520RHEL 6.1 (KVM)Solarflare2 processors 4 processors 8 processorsSolarflare with SR-IOV delivers recordperformance with 21% increase!Comparison based on best performing systems published at www.spec.org as of 25 June 2012. SPEC® and the benchmark SPECvirt_sc® are registered trademarks of theStandard Performance Evaluation Corporation. For more information about SPECvirt_sc2010, see www.spec.org/virt_sc2010/.
    9. 9. Copyright © 2012 Solarflare Communications, Slide 9March 20th, 2012Solarflare and Red Hat• Out-of-Box Accelerated Networking Support for– Red Hat Enterprise Linux with KVM Hypervisor– Red Hat Enterprise Virtualization for Servers and Desktop– Red Hat Enterprise MRG– Red Hat Storage• Partnerships and Certifications– Red Hat OpenStack– Red Hat Enterprise Linux Certified– Red Hat Ready ISV Partner– Open Virtualization Alliance Member– RHEL and KVM product documentation including• Red Hat Performance Brief – “Using Solarflare OpenOnload to AchieveExtreme Low Latency on Red Hat Enterprise Linux 6”• Solarflare Solution Brief – “Unified SR-IOV for Red Hat Linux KVM”*Based on best performing systems published at www.spec.org as of Dec 6, 2012
    10. 10. Copyright © 2012 Solarflare Communications, Slide 10March 20th, 2012Summary and Conclusions• Clouds and OpenStack promise the evolution of IT– Flexibility, automation, scale of compute, storage, and networking• Server virtualization in general enables the commoditization ofhardware, use of industry standard servers. The end of vendor lock in(?)• Still need hardware support for KVM in the platform and the networkinterface software and hardware (NIC)– performance to deliver SLAs and QOS with a Cloud• Hypervisor bypass to eliminate bottlenecks• Plug-in architecture to support both app acceleration and hypervisorservices (e.g. VM and storage migration)Solarflare+Redhat Office of CTO: “Make the NICs Move, Adventuresin Performance Tuning”11:00 am, Friday, Room 304
    11. 11. Copyright © 2012 Solarflare Communications, Slide 11March 20th, 2012BACKUP SLIDES
    12. 12. Copyright © 2012 Solarflare Communications, Slide 12March 20th, 2012VMVMNICVM VM VMdriverTCP/IPdriverTCP/IPdriverTCP/IPdriverTCP/IPdriverTCP/IPKVM HostVNICVNICVNICVNICVNICVNICPF VF VF VFVNICVNICVNICVNICVNICVNICVNICVNICVNICBridgeImproving KVM Performance & Scalability• Core scaling enhancesperformance– Spreads I/O across all CPUcores– Improves 10GbE performancescalability– VM / vNIC core alignment– Mitigates hypervisor becomingI/O bottleneck• SR-IOV acceleration– Near native performance– VM direct access to VF / vNIC• More vNICs & VFs = betterscaling across all VMs– Solarflare = 2048 vNICs
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×